Academic

Shanghai Jiao Tong University

A comprehensive research university in Shanghai, spanning engineering, computer science, and clinical medicine across its schools and hospitals.

Location: Shanghai, China
Website
24 models(10 Imaging, 6 Language model, 4 Pathology, 4 Biosignals, 3 Protein, 3 Single-cell, 2 RNA, 1 Small molecule)

Models (24)

IgGM2

Tencent AI for Life Science Lab / Shanghai Jiao Tong University / Zhejiang University / Beijing Zhongguancun Academy

Released July 9, 2026

All-atom foundation model for immune-receptor design that predicts structures and co-designs CDR sequences for antibodies, nanobodies, and TCRs.

Protein

RNAJog

Shanghai Jiao Tong University

Released June 20, 2026

2

Autoregressive generative model that uses reinforcement learning to optimize mRNA codon sequences for MFE, CAI, and GC content.

RNA

RNARL

Shanghai Jiao Tong University / Fudan University / East China Normal University

Released June 13, 2026

146

Reinforcement-learning generative framework for multi-objective RNA codon optimization that generalizes across six species and five RNA types.

RNA

PTM-dCN

Shanghai Jiao Tong University

Released May 11, 2026

53

Latent diffusion model for PTM-aware protein sequence design, using ControlNet-style conditioning to steer generation toward chosen PTM sites.

Protein

MAP

Shanghai Jiao Tong University

Released February 25, 2026

71

Knowledge-graph-grounded model that predicts single-cell transcriptomic responses to small molecules, with zero-shot prediction for unprofiled drugs.

Single-cellSmall molecule

PanFoMa

Shanghai Jiao Tong University / Jiangxi University of Finance and Economics / Shenzhen University / University of Technology Sydney / Chongqing University of Posts and Telecommunications

Released December 2, 2025

822

Pan-cancer single-cell foundation model with a hybrid Transformer-Mamba architecture, released with the PanFoMaBench cancer evaluation benchmark.

Single-cell

ProteinAE

Chinese University of Hong Kong / Tencent AI Lab / Shanghai Jiao Tong University

Released October 12, 2025

421

Protein structure autoencoder compressing backbone coordinates into a latent space, paired with a latent diffusion model for generative design.

Protein

DenseFormer-MoE

Shanghai Jiao Tong University

Released October 1, 2025

27

Brain MRI foundation model pairing DenseNet and Vision Transformer backbones with mixture of experts for disease diagnosis and brain age prediction.

Imaging

scYeast

Shanghai Jiao Tong University

Released August 20, 2025

5

Single-cell foundation model for yeast that injects regulatory network priors into transformer attention for zero-shot and fine-tuned analysis.

Single-cell

EyeCLIP

The Hong Kong Polytechnic University / EPFL / Clemson University / Zhejiang University School of Medicine / Shanghai Jiao Tong University / Monash University

Released June 21, 2025

6385

CLIP-based vision-language foundation model for eye imaging, enabling zero-shot disease detection and cross-modal retrieval across 11 modalities.

ImagingLanguage model

Chiron-o1

Shanghai AI Laboratory / Fudan University / Shanghai Jiao Tong University

Released June 20, 2025

141160

Medical multimodal LLM (2B and 8B) trained for generalizable, step-by-step clinical reasoning via Mentor-Intern Collaborative Search.

PathologyImaging

BEPH

Shanghai Jiao Tong University

Released March 10, 2025

9577

Histopathology foundation model pretrained with BEiT masked image modeling on 11M+ tissue image tiles for cancer diagnosis and survival prediction.

Pathology

M3FM

University of Oxford / GSK.ai / Amazon Web Services / University of Rochester / Tencent AI Lab / Shanghai Jiao Tong University / Westlake University

Released February 6, 2025

1.4K19

Multimodal medical imaging foundation model for zero-shot clinical diagnosis and report generation from chest X-ray and CT in English and Chinese.

ImagingLanguage model

ECGFM-KED

Shanghai Jiao Tong University

Released December 18, 2024

5143

Knowledge-enhanced ECG foundation model aligning a ResNet encoder with LLM-generated disease descriptions for zero- and few-shot interpretation.

Biosignals

AnyECG

Zhejiang University / University of Illinois Urbana-Champaign / Shanghai Jiao Tong University / Hong Kong University of Science and Technology

Released November 17, 2024

54

ECG foundation model that learns discrete rhythm tokens from noisy real-world recordings for arrhythmia classification and anomaly detection.

Biosignals

NeuroLM

Shanghai Jiao Tong University / Microsoft

Released August 27, 2024

162

Multi-task EEG foundation model that treats brain signals as a foreign language, pairing a text-aligned neural tokenizer with a GPT-2 backbone.

BiosignalsLanguage model

LaBraM

Shanghai Jiao Tong University

Released May 29, 2024

21644

EEG foundation model that learns transferable brain-signal representations with a vector-quantized tokenizer and masked transformer pretraining.

Biosignals

UniBrain

Shanghai Jiao Tong University / University of Science and Technology of China / Shanghai AI Laboratory / Shanghai Sixth People's Hospital

Released September 13, 2023

39

Vision-language pre-training framework for universal brain MRI diagnosis, learning from imaging-report pairs to cover more than ten brain diseases.

Imaging

RadFM

Shanghai Jiao Tong University / Shanghai AI Laboratory

Released August 4, 2023

927559

Radiology foundation model that reads interleaved 2D and 3D scans with text for diagnosis, visual question answering, and report generation.

ImagingLanguage model

Endo-FM

Chinese University of Hong Kong / Shanghai Jiao Tong University

Released June 29, 2023

135230

Endoscopy video foundation model that learns spatial-temporal representations from unlabeled clips for classification, segmentation, and detection.

Imaging

MedLSAM

Shanghai AI Laboratory / Shanghai Jiao Tong University / University of Science and Technology of China / Sichuan University

Released June 26, 2023

37522

3D CT localization foundation model that pairs MedLAM with SAM to segment any anatomical structure at a fixed, dataset-independent annotation cost.

Imaging

MedBLIP

Shanghai Jiao Tong University

Released May 18, 2023

61357

Vision-language framework for 3D medical image diagnosis and visual question answering, bridging frozen image encoders and LLMs, shown on brain MRI.

ImagingLanguage model

MedVInT

Shanghai Jiao Tong University / Shanghai AI Laboratory

Released May 17, 2023

188236

Generative medical visual question answering model that pairs a vision encoder with a language model, trained on the 227k-pair PMC-VQA dataset.

PathologyLanguage model

PMC-CLIP

Shanghai Jiao Tong University

Released March 13, 2023

20241

Biomedical vision-language model trained contrastively on 1.6M figure-caption pairs mined from PubMed Central open-access articles.

PathologyImaging