Harvard Medical School / Brigham and Women's Hospital / Stanford University
A weakly supervised pathology foundation model pretrained on 60,530 whole-slide images across 19 anatomical sites for cancer detection, prognosis, and molecular prediction.
CHIEF (Clinical Histopathology Imaging Evaluation Foundation) is a general-purpose pathology foundation model for systematic cancer evaluation from hematoxylin and eosin (H&E)-stained whole-slide images (WSIs). Rather than building a bespoke model for each diagnostic question, CHIEF extracts versatile imaging representations that transfer across cancer detection, tumor-origin identification, molecular-profile prediction, and survival estimation, addressing the field's reliance on narrow, task-specific classifiers that generalize poorly to new cohorts.
Developed by Kun-Hsing Yu's group in the Department of Biomedical Informatics at Harvard Medical School, with collaborators at Brigham and Women's Hospital and Stanford University School of Medicine, CHIEF was published in Nature in September 2024. It joins a wave of pathology foundation models such as UNI and CONCH but is distinguished by its explicit two-stage design that couples tile-level self-supervision with weakly supervised whole-slide pretraining, and by its emphasis on prognosis and genomic prediction rather than diagnosis alone.
The model was validated on more than 19,000 WSIs drawn from 32 independent slide sets spanning 24 hospitals and patient cohorts worldwide, demonstrating generalizability well beyond its training distribution.
CHIEF pairs a CTransPath patch encoder (a hybrid CNN-transformer producing 768-dimensional tile features) with an attention-based multiple-instance-learning aggregator that pools thousands of tiles into a single whole-slide embedding. Tile-level self-supervision draws on roughly 15 million unlabeled image tiles, while the weakly supervised whole-slide stage uses 60,530 WSIs spanning 19 anatomical sites (approximately 44 TB of high-resolution imaging). Across evaluation tasks, CHIEF reached a macro-average AUROC of 0.9397 for cancer detection across 15 datasets, 0.9853 ± 0.0245 for tumor-origin prediction, a macro-average AUROC of 0.7043 for prevalent genomic mutations, and an average survival concordance index of 0.74. Reported gains over state-of-the-art baselines reached up to 36.1% on cancer classification, genomic-profile, and survival tasks.
CHIEF is designed for computational pathology and oncology research, where a single pretrained feature extractor can be adapted to diverse downstream tasks with limited labeled data. Use cases include automated cancer detection and grading, predicting tumor origin for cancers of unknown primary, inferring actionable genomic alterations (such as IDH status in glioma or microsatellite instability in colorectal cancer) directly from H&E slides, and stratifying patient prognosis. Researchers and clinical-AI developers benefit from reduced annotation burden and a consistent backbone across studies, while the released weights and containers lower the barrier to building cohort-specific tools.
CHIEF demonstrates that a unified, weakly supervised foundation model can match or exceed task-specific systems across the breadth of cancer diagnosis and prognosis, reinforcing the shift toward foundation models in computational pathology. Its publication in Nature and validation across dozens of international cohorts have made it a widely referenced benchmark alongside UNI and CONCH. The authors note remaining limitations, including the value of incorporating more non-malignant and rare-disease slides and extending prognostic modeling beyond standard-of-care settings, but CHIEF stands as an influential step toward generalizable, slide-level AI for oncology.
Wang, X., et al. (2024) A Pathology Foundation Model for Cancer Diagnosis and Prognosis Prediction. Nature.
DOI: 10.1038/s41586-024-07894-zPapers that recently cited this model.
The most-cited papers that cite this model.
Not enough data