All Competitors

BERT-Large pretrained on the BREATHE literature corpus for biomedical question answering and embedding-based re-ranking of literature search.

Chemical language model pretrained on up to 77 million PubChem SMILES strings for molecular property prediction on the MoleculeNet benchmarks.

Chinese biomedical text encoder pretrained by masking whole medical entities and phrases, lifting clinical entity recognition and query understanding.

Biomedical language model pretrained from scratch on PubMed abstracts with a WordPiece vocabulary derived from biomedical text rather than the web.