bio.rodeo
ModelsOrganizationsLeaderboardAbout
bio.rodeo

The authoritative source for evaluating biological foundation models. No hype, just honest analysis.

Categories
  • DNA & Gene
  • RNA
  • Protein
  • Small molecule
  • Single-cell
  • Spatial omics
  • Pathology
  • Imaging
  • Metabolomics
  • Biosignals
  • Language model
bio.rodeoModelsOrganizationsLeaderboardAboutFAQSubmit a modelContact
© 2026 Pulsatance. All rights reserved. ~
Built by Pulsatance
RNA foundation models
RNA

mRNAutilus

Atom Bioworks / University of Pennsylvania / GenScript / Duke-NUS Medical School

Masked discrete-diffusion model over millions of full-length mRNAs, steered by Monte Carlo tree search for joint codon optimization and UTR design.

Released: May 2026
Parameters: 150 Million

Therapeutic mRNA design requires coordinating many interacting sequence features across an entire transcript: codon usage in the coding region, the 5' and 3' untranslated regions (UTRs), and the coupling between them jointly determine stability, translation efficiency, and ultimately protein expression. Most existing tools treat these problems in isolation — optimizing codons against a fixed reference index, or selecting UTRs from curated libraries — and therefore miss the interactions that govern real-world performance. mRNAutilus, introduced in May 2026 by researchers at Atom Bioworks with collaborators at the University of Pennsylvania, GenScript, and Duke-NUS Medical School, reframes mRNA construction as a single multi-objective generative problem over the full-length transcript.

The model pairs a pretrained masked discrete-diffusion model (MDM) — trained on roughly 5.5 million full-length mRNA sequences — with Monte Carlo Tree Guidance (MCTG), a search procedure that steers generation toward sequences that are Pareto-efficient across several therapeutic objectives. Rather than designing the coding sequence and UTRs separately, mRNAutilus performs simultaneous codon optimization and de novo UTR design, generating complete transcripts in one process. Lightweight regressors built over the diffusion model's embeddings score candidate sequences for half-life, translation efficiency, and protein abundance, providing the rewards that guide the tree search.

mRNAutilus sits within a fast-growing class of generative models for nucleic-acid design, alongside autoregressive and language-model approaches to mRNA optimization, but is distinguished by its discrete-diffusion backbone and its explicit multi-objective search over the whole transcript.

#Key Features

  • Whole-transcript generation: Designs the coding sequence and both UTRs jointly, capturing the coupling between codon usage and untranslated regions that sequential or library-based methods overlook.
  • Masked discrete diffusion: A non-autoregressive diffusion process over a codon/nucleotide vocabulary iteratively denoises masked positions, enabling flexible, in-place edits across a long sequence rather than left-to-right generation.
  • Monte Carlo Tree Guidance: Couples the pretrained model with regressor-derived rewards to explore the design space, maintaining a set of Pareto-optimal candidates across competing objectives.
  • Multi-objective optimization: Scores candidates for half-life, translation efficiency, and protein abundance, so designs balance stability and expression rather than maximizing a single proxy.
  • Strong empirical gains: Reported designs include luciferase mRNAs with roughly 400-fold higher expression than wild-type and SARS-CoV-2 Spike constructs exceeding commercially optimized baselines.

#Technical Details

mRNAutilus uses a ~150M-parameter BERT-style transformer as its diffusion backbone, with 20 attention heads, SwiGLU activations, Rotary Positional Embeddings, and FlashAttention-2, operating over a context of 7,500 tokens and an 86-token vocabulary spanning codons, nucleotides, and special tokens. Pretraining data was assembled from approximately 14.2 million full-length mRNA sequences and filtered down to 5,526,848 sequences. At generation time, Monte Carlo Tree Guidance runs selection, expansion, rollout, and backpropagation phases (with an exploration constant of 0.1) to manage Pareto-optimal sequence sets, using embedding-based regressors for half-life, translation efficiency, and protein abundance as the reward signals. Reported benchmarks include luciferase constructs around 400-fold above wild-type expression and Spike constructs nearly 2-fold above commercially optimized references, with additional demonstrations in prime-editing and proteome-modulation contexts.

#Applications

mRNAutilus targets the design of therapeutic and research mRNAs — vaccines, protein-replacement therapies, and genome-editing payloads such as prime editors — where stability and high protein expression are critical. By generating optimized coding sequences and UTRs together, it can serve mRNA therapeutics developers, synthetic-biology labs, and protein-expression workflows that would otherwise iterate manually over codon tables and UTR libraries.

#Impact

mRNAutilus advances mRNA design by treating codon optimization and UTR design as a unified, multi-objective generative task and demonstrating large expression gains on clinically relevant constructs. However, its practical reach is constrained by its release model: there is no public code or model weights, and access is provided only through the gated AutoNA web interface, with the paper and associated data released under a CC BY-NC-ND license. As an effectively closed release, it is best viewed as a demonstration of what discrete-diffusion-plus-search can achieve for mRNA engineering rather than a reproducible, openly extensible resource for the community.

Citation

mRNAutilus: Multi-Objective-Guided Discrete Generation of mRNA with Optimized Therapeutic Properties

Preprint

Patel, S., et al. (2026) mRNAutilus: Multi-Objective-Guided Discrete Generation of mRNA with Optimized Therapeutic Properties. arXiv.

DOI: 10.48550/arXiv.2605.31296

Recent citations

Papers that recently cited this model.

  • Multi-Objective-Guided Generative Design of mRNA with Therapeutic Properties

    Sawan Patel, Sophia Tang, Yinuo Zhang, et al.

    3

Top citations

The most-cited papers that cite this model.

  • Multi-Objective-Guided Generative Design of mRNA with Therapeutic Properties

    Sawan Patel, Sophia Tang, Yinuo Zhang, et al.

    3

Related models

Models with similar goals, methods, or subject matter.

  • mRNA-GPT

    Kitasato University / University of Tokyo / National Institute of Advanced Industrial Science and Technology

    GPT-style generative language model for mRNA coding sequences, pretrained across bacteria, eukaryotes, and archaea for de novo CDS design.

    RNA
  • mRNA-GPT

    Chinese Academy of Sciences

    Autoregressive model for therapeutic mRNA design that jointly generates 5' UTR, CDS, and 3' UTR, pretrained on 30 million full-length natural mRNAs.

    RNA
  • RNAJog

    Shanghai Jiao Tong University

    Autoregressive generative model that uses reinforcement learning to optimize mRNA codon sequences for MFE, CAI, and GC content.

    RNA
  • NUWA

    Kitasato University

    mRNA language foundation model trained on ~115M protein-coding sequences across the tree of life, unifying mRNA perception and generation.

    RNADNA & Gene
  • RNARL

    Shanghai Jiao Tong University / Fudan University / East China Normal University

    Reinforcement-learning generative framework for multi-objective RNA codon optimization that generalizes across six species and five RNA types.

    RNA

Citations

Total Citations8
Influential0
References49

Fields of citing research

  • Computer Science100%
  • Medicine100%

Share of papers citing this model.

Openness

bio.rodeo opennessClosed · low usability and reproducibility
7Closed
Usability — can I run it?7
Reproducibility — can I retrain it?6
Model Openness Framework
Unclassified
Restrictive license on core components

Tags

de_novo_designdiffusionfoundation_modelgenerativemrna_therapeuticssequence_optimizationtransformerutr_design

Resources

Research PaperDemoDataset