Baidu / Beihang University / Shanghai Jiao Tong University / Hong Kong University of Science and Technology (Guangzhou) / North Carolina State University / Nottingham Trent University / Silesian University of Technology / South China University of Technology
Released November 3, 2024
Chemical language model for molecular property prediction, pretrained on PubChem SMILES by masking whole functional groups rather than random tokens.
Baidu / City University of Hong Kong / Shanghai Jiao Tong University / Nottingham Trent University / Silesian University of Technology
Released May 13, 2024
RNA language model pretrained on 23 million non-coding sequences with motif-level masking, then steered by predicted RNA type at fine-tuning.