All Competitors

Family of transformer-based DNA language models using BPE tokenization and BigBird sparse attention to reach context lengths up to 36,000 base pairs.

Masked DNA language model trained on over 800 vertebrate genomes and conditioned on species identity to learn conserved regulatory sequence features.

DNA foundation models from 500M to 2.5B parameters, trained on 3,200+ human genomes and 850 species for variant effect prediction.

Motif-oriented DNA pre-training framework that adds motif prediction to an ELECTRA generator-discriminator setup for motif-aware genomic embeddings.

Transformer that predicts gene expression and epigenomic signals from 200kb of DNA sequence, capturing distal enhancers up to 100kb from a promoter.

Bidirectional transformer for DNA using k-mer tokenization, fine-tunable for promoter, splice site, and transcription factor binding prediction.

Sparse attention transformer that extends BERT to 8x longer sequences via random, local, and global attention, with genomic sequence applications.