bio.rodeo
ModelsOrganizationsLeaderboardAbout
bio.rodeo

The authoritative source for evaluating biological foundation models. No hype, just honest analysis.

Categories
  • DNA & Gene
  • RNA
  • Protein
  • Small molecule
  • Single-cell
  • Spatial omics
  • Pathology
  • Imaging
  • Metabolomics
  • Biosignals
  • Language model
bio.rodeoModelsOrganizationsLeaderboardAboutFAQSubmit a modelContact
© 2026 Pulsatance. All rights reserved. ~
Built by Pulsatance
Single-cell foundation models
Single-cell

HitAnno

Tsinghua University

Hierarchical language model for atlas-level cell-type annotation of scATAC-seq data that annotates new query datasets without retraining.

Released: March 2026

Single-cell ATAC sequencing (scATAC-seq) profiles chromatin accessibility across thousands of cells, but assigning cell types to these profiles is harder than for transcriptomic data: accessibility matrices are sparse, high-dimensional, and binary-like, and reference atlases are scarce. As scATAC-seq atlases grow, there is a need for annotation methods that scale to atlas-level data and generalize to new datasets without per-dataset retraining.

HitAnno, developed by Rui Jiang's group in the Department of Automation at Tsinghua University and posted to bioRxiv in March 2026, addresses this with a hierarchical language model. It converts each cell's accessibility profile into a "cell sentence" built from selected cell-type-specific peaks, then applies a two-level attention mechanism that captures accessibility structure hierarchically — modeling co-accessibility among peaks and dependencies across higher-order peak sets.

Trained on a human atlas spanning 31 cell types, HitAnno can directly annotate new query datasets without retraining, offering a scalable and interpretable route to atlas-level scATAC-seq annotation through an accompanying online interface.

#Key Features

  • Cell-sentence representation: Encodes each cell's chromatin accessibility as a sentence of selected cell-type-specific peaks, casting annotation as a language-modeling problem.
  • Two-level hierarchical attention: Captures both local co-accessibility among peaks and higher-order dependencies across peak sets, supporting an interpretable annotation process.
  • Zero-shot annotation: After training on a 31-cell-type human atlas, annotates new query datasets directly without retraining.
  • Robust across settings: Annotates major and rare cell types reliably in intra-dataset, cross-donor, and inter-dataset scenarios.
  • Accessible interface: Available through an online tool for applying the model to user data.

#Technical Details

HitAnno is a hierarchical transformer-based language model for scATAC-seq annotation. It first selects cell-type-specific peaks and uses them to construct per-cell "cell sentences," which serve as input tokens. A two-level attention mechanism then processes these sentences hierarchically: lower-level attention captures co-accessibility patterns among individual peaks, while higher-level attention models dependencies across aggregated peak sets, yielding interpretable signals about which accessibility features drive each prediction. The model is trained on a human atlas comprising 31 cell types and is evaluated across intra-dataset, cross-donor, and inter-dataset annotation tasks, where it robustly labels both abundant and rare cell types. Once trained, it performs zero-shot annotation on previously unseen query datasets without additional fine-tuning.

#Applications

HitAnno is intended for researchers analyzing scATAC-seq data who need scalable, reference-based cell-type annotation. It is well suited to labeling large atlas-scale datasets, transferring annotations across donors and studies, and identifying rare populations that simpler methods miss. The accompanying online interface lowers the barrier for experimental groups to annotate new accessibility datasets without building bespoke pipelines, and its interpretable attention highlights the peaks underlying each call.

#Impact

By adapting the cell-sentence, language-model framing to chromatin accessibility and adding hierarchical attention, HitAnno extends atlas-level, retraining-free annotation — already common for scRNA-seq — into the scATAC-seq setting. Its emphasis on interpretability and robustness to rare cell types addresses recurring pain points in epigenomic annotation. As a preprint released under a CC-BY-NC license, its reported performance awaits peer review and broader independent benchmarking, and access is governed by non-commercial terms.

Citation

HitAnno: Atlas-level cell type annotation based on scATAC-seq data via a hierarchical language model

Wang, Z., et al. (2026) HitAnno: Atlas-level cell type annotation based on scATAC-seq data via a hierarchical language model. bioRxiv.

DOI: 10.64898/2026.03.10.710729

Recent citations

Papers that recently cited this model.

Not enough citation data yet.

Top citations

The most-cited papers that cite this model.

Not enough citation data yet.

Related models

Models with similar goals, methods, or subject matter.

  • Atacformer

    University of Virginia

    Transformer foundation model for single-cell ATAC-seq that embeds both cells and cis-regulatory elements for annotation and batch correction.

    Single-cellDNA & Gene
  • GENATATOR

    AIRI Institute

    Ab initio gene annotation model that predicts gene boundaries and exon-intron structure from raw DNA, generalizing zero-shot to unseen species.

    DNA & GeneRNA
  • TissueNarrator

    Carnegie Mellon University

    Spatial transcriptomics language model that reads tissue as spatial sentences to simulate cell profiles and run in silico perturbations.

    Spatial omicsSingle-cell
  • mLLMCelltype

    Texas A&M University

    Multi-LLM consensus framework for automated cell type annotation in scRNA-seq data, outperforming prior methods by ~15% in mean accuracy.

    Single-cell
  • scBERT

    Tencent AI Lab

    Pretrained transformer for cell type annotation of scRNA-seq data. Trained on 1.1M cells; outperforms supervised methods on cross-dataset transfer.

    Single-cell

Citations

Total Citations1
Influential0
References64

Fields of citing research

Not enough data

Openness

bio.rodeo opennessClosed · low usability and reproducibility
14Closed
Usability — can I run it?13
Reproducibility — can I retrain it?10
Model Openness Framework
Unclassified
Restrictive license on core components

Tags

cell_type_annotationchromatin_accessibilitylanguage_modelscatac_seqtransformerzero_shotzero_shot_annotation

Resources

Research Paper