Artificial Intelligence Research Institute
AIRI Institute
A family of transformer-based DNA language models supporting context lengths up to 36,000 bp via BPE tokenization and BigBird sparse attention.