bio.rodeo
ModelsOrganizationsLeaderboardAboutSign in
bio.rodeo

The authoritative source for evaluating biological foundation models. No hype, just honest analysis.

Categories
  • DNA & Gene
  • RNA
  • Protein
  • Small molecule
  • Single-cell
  • Spatial omics
  • Pathology
  • Imaging
  • Metabolomics
  • Biosignals
  • Language model
bio.rodeoModelsOrganizationsLeaderboardAboutFAQSubmit a modelContact
© 2026 Pulsatance. All rights reserved. ~
Built by Pulsatance
RNA foundation models
RNA

trRosettaRNA

Yang Lab

RNA 3D structure prediction pipeline pairing a transformer (RNAformer) that predicts inter-nucleotide geometries with Rosetta energy minimization.

Released: November 2023

trRosettaRNA is an automated deep learning pipeline for predicting RNA three-dimensional structures from sequence, developed by the Yang Lab at Shandong University. Published in Nature Communications in November 2023, it addresses a longstanding challenge in structural biology: unlike proteins, RNA 3D structure prediction has historically lagged behind sequence-level annotation, leaving the vast majority of functionally important RNA families without structural models.

The method works through a two-stage process. First, a transformer network called RNAformer predicts inter-nucleotide geometries — distances, orientations, torsion angles, and contact probabilities — directly from multiple sequence alignments (MSAs) and secondary structure predictions. These predicted geometries are then used as spatial restraints to guide Rosetta-based energy minimization, producing physically realistic 3D atomic coordinates. This hybrid strategy combines the pattern-recognition power of deep learning with the stereochemical rigor of physics-based modeling.

At the 15th Critical Assessment of Structure Prediction (CASP15), trRosettaRNA achieved performance competitive with top human expert groups and outperformed other fully automated deep learning methods by RMSD on the blind test targets. The authors also applied the method at scale, generating confident structural models for 467 Rfam families that previously lacked any experimentally determined structure.

#Key Features

  • RNAformer transformer architecture: A 48-block transformer network that jointly updates MSA and pairwise residue representations through row- and column-wise attention, closely analogous to AlphaFold 2's Evoformer but tailored to RNA nucleotide chemistry.
  • Multi-geometry output: Simultaneously predicts 2D geometry maps (inter-nucleotide distances, orientations, and contacts) and 1D backbone torsion angles, providing a comprehensive geometric description of the target RNA fold.
  • Physics-based refinement: Rosetta energy minimization with predicted geometry restraints produces all-atom 3D models that respect known RNA stereochemistry, generating 20 candidate structures per input and selecting by Rosetta energy score.
  • Self-distillation training: Beyond the 3,633 RNA chains in the PDB, training is extended through iterative self-distillation on the bpRNA database, with uncertain predictions filtered by Kullback-Leibler divergence to maintain data quality.
  • Fully automated pipeline: End-to-end workflow from sequence input to ranked 3D models requires no manual intervention, lowering the barrier to large-scale structural genomics studies.

#Technical Details

RNAformer processes two input representations derived from the MSA: a sequence-level MSA representation encoding nucleotide identity across aligned homologs, and a pairwise representation initialized from direct couplings in the MSA and predicted secondary structure probability matrices. Each of the 48 transformer blocks applies four sequential update operations — MSA row attention, MSA column attention, outer-product MSA-to-pair updates, and triangle-update pair-to-pair refinement using a Res2Net architecture — mirroring the Evoformer design philosophy. The network is cycled four times through these blocks during inference for iterative refinement. Final 2D geometry predictions (distance, dihedral orientation, and contact distributions) are read out from the pair representation; 1D backbone torsion angles are derived from row-wise weighted summation of the MSA representation.

Training used 3,633 non-redundant RNA chains from the PDB as the primary dataset, supplemented by self-distillation on predicted structures from bpRNA. The 3D structure generation stage uses L-BFGS optimization within Rosetta, incorporating RNAformer-derived distance and orientation restraints alongside physics-based RNA potentials. Twenty candidate structures are generated per query, and the lowest-energy model by Rosetta score is reported as the primary prediction. The web server at yanglab.qd.sdu.edu.cn accepts raw RNA sequences and returns ranked 3D models, making the tool broadly accessible without local installation.

#Applications

trRosettaRNA is suited for researchers who need 3D structural models of RNA sequences for which no experimental structure exists. Structural biologists can use predictions to guide cryo-EM data interpretation or to design crystallization constructs. RNA biologists working on regulatory non-coding RNAs, riboswitches, or CRISPR-associated RNAs can use the models to generate mechanistic hypotheses about structure-function relationships. The method is also applicable to drug discovery targeting RNA, where 3D structural context is increasingly sought for fragment screening and small-molecule design. At scale, the Rfam-wide application demonstrates utility for structural genomics efforts aimed at annotating entire RNA families.

#Impact

trRosettaRNA represents a meaningful advance in automated RNA 3D structure prediction, arriving alongside a broader wave of deep learning methods — including ARES, DeepFoldRNA, and RhoFold — that collectively elevated the field during and after CASP15. Its competitive showing in the CASP15 blind test against human expert predictions validated the two-stage hybrid approach as a viable alternative to purely physics-based or purely data-driven methods. The large-scale application to 467 uncharacterized Rfam families is a concrete contribution to structural genomics, providing the community with a first structural reference for many biologically important RNA classes. A key limitation is that the approach depends on the availability of informative MSAs; for highly divergent or orphan RNAs with few known homologs, prediction accuracy degrades. The method also produces static single-conformation models and does not capture the conformational dynamics that are often central to RNA function.

Citation

trRosettaRNA: automated prediction of RNA 3D structure with transformer network

Wang, W., Feng, C., Han, R., Wang, Z., Ye, L., Du, Z., Wei, H., Zhang, F., Peng, Z., & Yang, J. (2023). trRosettaRNA: automated prediction of RNA 3D structure with transformer network. Nature Communications, 14(1), 7266.

DOI: 10.1038/s41467-023-42528-4

Recent citations

Papers that recently cited this model.

  • SNORA23-KDM5C epigenetic axis mediates dual DNA repair pathways to drive radioresistance in esophageal squamous cell carcinoma.

    Baoqing Tian, Hua Zhang, Jiao Ren, et al.

    Cell Death and Differentiation · Jul 2026

    0
  • 3dDNAi: An Integrated Approach for 3D Structure Prediction of Single-Stranded DNAs.

    Yi Zhang, Yi Xiong, Yi Xiao

    Journal of Chemical Theory and Computation · Jul 2026

    0
  • Targeted Modulation of Eukaryotic Release Factor 1 (OseRF1) by an RNA Aptamer Enhances Drought Adaptation in Rice.

    Shuangfeng Dai, Mingming Chen, Haomin Chen, et al.

    Plant Biotechnology Journal · Jul 2026

    0

Top citations

The most-cited papers that cite this model.

  • Accurate RNA 3D structure prediction using a language model-based deep learning approach

    Tao Shen, Zhihang Hu, Fred Zhangzhi Peng, et al.

    Nature Methods · Jul 2022

    197
  • Strategies to overcome the challenges of low or no expression of heterologous proteins in Escherichia coli.

    Ruizhao Jiang, Shuting Yuan, Yilong Zhou, et al.

    Biotechnology Advances · Jul 2024

    77
  • Identification of RNA structures and their roles in RNA functions

    Xinang Cao, Yueying Zhang, Yiliang Ding, et al.

    Nature reviews. Molecular cell biology · Jun 2024

    70
  • Deep generative design of RNA aptamers using structural predictions

    Felix Wong, Dongchen He, Aarti Krishnan, et al.

    Nature Computational Science · Nov 2024

    67
  • RNA-Puzzles Round V: blind predictions of 23 RNA structures

    Fan Bu, Yagoub Ali Ibrahim Adam, R. Adamiak, et al.

    Nature Methods · Dec 2024

    50

Related models

Models with similar goals, methods, or subject matter.

  • RNAformer

    University of Freiburg

    RNA secondary structure prediction from a single sequence, without MSAs, using an axial-attention transformer trained with strict homology controls.

    RNA
  • RhoFold+

    ml4bio

    End-to-end RNA 3D structure prediction from sequence alone, coupling the RNA-FM language model with an Invariant Point Attention structure module.

    RNA
  • RNArefine

    National University of Singapore / Institute of Science Tokyo / Kyushu Institute of Technology

    Atomic-level refinement of RNA 3D structures, using geometric attention networks to guide physics-based Monte Carlo sampling and L-BFGS optimization.

    RNA
  • AIDO.RNA

    genbio.ai

    RNA foundation model with 1.6 billion parameters, pretrained on 42 million non-coding RNA sequences for structure prediction and RNA sequence design.

    RNA
  • RNA-MSM

    Peking University / Griffith University

    RNA language model trained on multiple sequence alignments of Rfam families, predicting secondary structure and solvent accessibility from homology.

    RNA
  • RIME

    Italian Institute of Technology

    RNA-RNA interaction prediction framework that scores pairing between long transcripts directly from sequence using Nucleotide Transformer embeddings.

    RNA

Citations

Total Citations204
Influential4
References53

GitHub

Stars37
Forks1
Open Issues1
Contributors1
Last Push3mo ago
LanguagePython
LicenseApache-2.0

Fields of citing research

  • Biology88%
  • Medicine75%
  • Computer Science68%
  • Chemistry16%
  • Engineering7%
  • Environmental Science5%
  • Materials Science3%
  • Physics2%

Share of papers citing this model.

Openness

bio.rodeo opennessOpen weights · open weights, closed recipe
72Open
Usability — can I run it?95
Reproducibility — can I retrain it?39
open weights, closed recipe
Model Openness Framework
Class III
Open Model

Tags

transformer

Resources

GitHub RepositoryResearch PaperOfficial WebsiteDocumentationDataset