Multi-species genomics foundation model spanning representation learning, functional-track prediction, and sequence generation at 1 Mb context.
Multi-species genomic foundation model swapping k-mer tokenization for byte pair encoding, matching Nucleotide Transformer with 21x fewer parameters.
Family of transformer-based DNA language models using BPE tokenization and BigBird sparse attention to reach context lengths up to 36,000 base pairs.
DNA foundation models from 500M to 2.5B parameters, trained on 3,200+ human genomes and 850 species for variant effect prediction.