bio.rodeo
ModelsOrganizationsLeaderboardAboutSign in
bio.rodeo

The authoritative source for evaluating biological foundation models. No hype, just honest analysis.

Categories
  • DNA & Gene
  • RNA
  • Protein
  • Small molecule
  • Single-cell
  • Spatial omics
  • Pathology
  • Imaging
  • Metabolomics
  • Biosignals
  • Language model
bio.rodeoModelsOrganizationsLeaderboardAboutFAQSubmit a modelContact
© 2026 Pulsatance. All rights reserved. ~
Built by Pulsatance
Protein foundation models
Protein

ProteinDT

UC Berkeley

Text-guided protein design framework aligning language with sequences for text-conditioned generation, zero-shot editing, and property prediction.

Released: January 2025

ProteinDT is a multimodal protein design framework developed by Shengchao Liu and collaborators from UC Berkeley, NVIDIA Research, Mila, and other institutions, published in Nature Machine Intelligence in 2025. It addresses a fundamental challenge in protein engineering: enabling researchers to specify desired protein properties in natural language and receive valid, functional protein sequences in return — without requiring deep expertise in structural biology or sequence design.

The core innovation is a contrastive alignment between two modalities — natural language descriptions and protein sequences — that allows the two to share a common representation space. Once aligned, text descriptions can be used to steer both sequence generation and editing. This stands in contrast to purely sequence-based or structure-based design tools, which require domain-specific encoding of design goals rather than natural language inputs.

The training dataset, SwissProtCLAP, consists of approximately 441,000 text-protein pairs extracted from the SwissProt subset of UniProt, grounding the model's language understanding in curated scientific annotations covering a wide range of protein functions, stability properties, and binding characteristics.

#Key Features

  • Text-Guided Sequence Generation: Generates novel protein sequences conditioned on natural language descriptions, achieving over 90% accuracy on text-to-protein generation benchmarks across diverse functional categories.
  • Zero-Shot Protein Editing: Modifies existing protein sequences based on textual instructions across 12 distinct editing tasks, including stability enhancement, structure optimization, and peptide-binding modifications, without task-specific fine-tuning.
  • ProteinCLAP Alignment: A contrastive learning module (Contrastive Language and Protein Pretraining) aligns protein and text representations into a shared embedding space, enabling seamless cross-modal translation.
  • Multi-Task Property Prediction: Predicts protein properties by leveraging joint text-protein representations, achieving superior performance on 4 out of 6 benchmarks spanning structural, stability, and binding properties.
  • Dual Editing Strategies: Supports both latent interpolation (smooth transitions between representations) and latent optimization (direct optimization toward a target description), giving users flexibility for different design scenarios.

#Technical Details

ProteinDT is built around a three-stage pipeline. First, ProteinCLAP trains a contrastive alignment between a protein sequence encoder and a text encoder, using paired SwissProtCLAP data to bring semantically related text-protein pairs close in embedding space. Second, a protein facilitator module learns to generate protein sequence representations from text embeddings alone, effectively bridging the gap between language and the protein embedding space learned by ProteinCLAP. Third, a conditional protein decoder translates these representations into full amino acid sequences.

For editing tasks, ProteinDT operates in the shared latent space rather than at the sequence level. Latent optimization iteratively adjusts a protein's representation toward a target text description, then decodes the modified representation back to a sequence. Benchmarking demonstrates best hit ratio across 12 zero-shot editing tasks evaluated under 21 distinct evaluation methods. For property prediction, the model leverages the aligned cross-modal embeddings as features, outperforming sequence-only baselines on tasks requiring understanding of stability and binding context.

#Applications

ProteinDT is primarily aimed at drug discovery and protein therapeutics, where researchers need to engineer candidates with specified binding affinities, thermostability profiles, or reduced immunogenicity. By accepting natural language specifications — for example, "high binding affinity to target receptor with improved thermal stability" — the framework lowers the barrier to entry for wet-lab biologists who are not fluent in sequence-based design. It is also applicable to synthetic biology workflows for designing novel enzymes with custom catalytic properties, and to functional annotation tasks where predicted property scores supplement experimental characterization.

#Impact

ProteinDT was among the first frameworks to demonstrate that natural language can serve as a practical interface for protein sequence design, influencing subsequent work on multimodal biological foundation models. Published in Nature Machine Intelligence, the work established contrastive text-protein alignment as a viable pretraining strategy and opened a research direction distinct from structure-conditioned design methods. A key limitation is that ProteinDT operates at the sequence level and does not predict or optimize three-dimensional structure directly; users requiring structural validation of generated sequences must pair it with a structure prediction tool such as ESMFold or AlphaFold 2. The reliance on SwissProt annotations also means that protein functions poorly covered by curated databases may be underrepresented in the model's generalization capacity.

Citation

A text-guided protein design framework

Liu, S., Li, Y., Li, Z., Gitter, A., Zhu, Y., Lu, J., Xu, Z., Nie, W., Ramanathan, A., Xiao, C., Tang, J., Guo, H., & Anandkumar, A. (2025). A text-guided protein design framework. Nature Machine Intelligence.

DOI: 10.1038/s42256-025-01011-z

Recent citations

Papers that recently cited this model.

  • Artificial intelligence tools for enzyme engineering and metabolic engineering.

    M. Volk, Vishal Kaushik Pillalamarri, Ruihan Guo, et al.

    Current Opinion in Biotechnology · Jun 2026

    0
  • AMix-2: Establishing Protein as a Native Modality in Large Language Models

    Keyue Qiu, Yixin Wu, Lihao Wang, et al.

    May 2026

    0
  • TIGER: Text-Informed Generalized Enzyme-Reaction Retrieval

    Yuhang Zhang, Keyan Ding, Peilin Chen, et al.

    May 2026

    0

Top citations

The most-cited papers that cite this model.

  • Machine learning for functional protein design

    Pascal Notin, Nathan J. Rollins, Yarin Gal, et al.

    Nature Biotechnology · Feb 2024

    250
  • Protein Design with Guided Discrete Diffusion

    Nate Gruver, S. Stanton, Nathan C Frey, et al.

    Neural Information Processing Systems · May 2023

    220
  • Protein generation with evolutionary diffusion: sequence is all you need

    Sarah Alamdari, Nitya Thakkar, R. van den Berg, et al.

    bioRxiv · Nov 2024

    211
  • Scientific Large Language Models: A Survey on Biological & Chemical Domains

    Qiang Zhang, Keyan Ding, Tianwen Lv, et al.

    ACM Computing Surveys · Jan 2024

    172Influential
  • BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associations

    Qizhi Pei, Wei Zhang, Jinhua Zhu, et al.

    Conference on Empirical Methods in Natural Language Processing · Oct 2023

    141

Related models

Models with similar goals, methods, or subject matter.

  • ProtST

    DeepGraphLearning

    Multi-modal protein language model trained on sequences paired with biomedical text, enabling zero-shot function prediction and text-based retrieval.

    Protein
  • PTM-dCN

    Shanghai Jiao Tong University

    Latent diffusion model for PTM-aware protein sequence design, using ControlNet-style conditioning to steer generation toward chosen PTM sites.

    Protein
  • HD-Prot

    The Hong Kong Polytechnic University / genbio.ai / Mohamed bin Zayed University of Artificial Intelligence

    Multimodal protein language model that adds a continuous-token diffusion head to a discrete pLM, modeling structure without vector quantization.

    Protein
  • ProtGPT2

    University of Bayreuth

    Autoregressive protein language model based on GPT-2 that generates de novo protein sequences sampling unexplored regions of protein space.

    Protein
  • ProtLiD

    National University of Singapore

    370M-parameter ligand-conditioned discrete diffusion model that co-designs protein sequence and structure under explicit small-molecule constraints.

    Protein
  • Pinal

    Westlake University

    De novo protein design from natural language: a 16B-parameter framework turning text descriptions into sequences via structure-conditioned generation.

    Protein

Citations

Total Citations106
Influential10
References149

GitHub

Stars107
Forks10
Open Issues3
Contributors2
Last Push1y ago
LanguagePython
LicenseMIT

HuggingFace

Downloads0
Likes3
Last Modified2y ago

Fields of citing research

  • Computer Science98%
  • Biology73%
  • Medicine33%
  • Chemistry21%
  • Engineering6%
  • Materials Science4%
  • Physics4%
  • Environmental Science2%

Share of papers citing this model.

Openness

bio.rodeo opennessFully open · usable and reproducible
52Partial
Usability — can I run it?61
Reproducibility — can I retrain it?54
Model Openness Framework
Unclassified
Restrictive license on core components

Tags

contrastive_learningdrug_discoveryfoundation_modelmultimodal

Resources

GitHub RepositoryResearch PaperResearch PaperOfficial WebsiteHuggingFace ModelDataset