University of North Carolina at Chapel Hill
A tissue-aware foundation model that enhances brain MRI quality across motion correction, super-resolution, denoising and harmonization, boosting downstream segmentation, registration and diagnosis.
BME-X (Brain MRI Enhancement) is a foundation model for improving the quality of brain magnetic resonance images and, in turn, the accuracy of the downstream analyses that depend on them. Real-world MRI is routinely degraded by subject motion, low spatial resolution, scanner noise and inter-site contrast variation. These artifacts are particularly severe in the most challenging populations to image, such as fetuses, neonates and patients who cannot remain still, and they propagate into errors in tissue segmentation, image registration and clinical diagnosis. BME-X tackles all of these enhancement problems with a single, fixed pretrained model rather than a separate network per artifact or per cohort.
Developed by the Developing Brain Computing Lab of Yue Sun, Limei Wang, Gang Li, Weili Lin and Li Wang at the University of North Carolina at Chapel Hill, BME-X was published in Nature Biomedical Engineering in December 2024. Its central idea is "tissue awareness": a first network predicts a tissue-label map, and a second network conditions on those labels to reconstruct an anatomically faithful, high-quality image. This design keeps cortical and subcortical structure intact while removing degradation, so the enhanced images preserve tissue volumes without introducing systematic bias.
By covering motion correction, super-resolution, denoising, harmonization and contrast enhancement in one framework, BME-X sits alongside other medical-imaging foundation models but is distinguished by its lifespan-spanning generalization, validated from fetal brains through to elderly adults.
BME-X uses a DU-Net (densely connected U-Net) convolutional backbone for both the tissue-classification stage and the tissue-aware enhancement stage. The tissue map predicted from a degraded input is concatenated with the low-quality image and fed to the enhancement network, which outputs the restored volume. The released models were trained on developing-brain data, including 52 fetal participants (21–36 gestational weeks) and 464 participants aged 0–6 years from the Baby Connectome Project, then validated on a large, deliberately diverse benchmark: roughly 2,088 synthesized corrupted images plus 10,963 in vivo images drawn from 19 public datasets spanning fetuses to individuals over 86 years old. Across six image-quality metrics, BME-X significantly outperformed competing methods such as Pix2Pix, CycleGAN, DU-Net and NLUP (P < 0.001), and crucially improved the accuracy of downstream tissue segmentation, parcellation and registration on the enhanced images.
BME-X is intended for neuroimaging researchers and clinicians who need reliable analysis from imperfect MRI. By restoring motion-corrupted, low-resolution or noisy scans before processing, it improves the robustness of automated pipelines for brain tissue segmentation, cortical parcellation and inter-subject or longitudinal registration, and it can salvage scans that would otherwise be discarded, an especially valuable capability for fetal, neonatal and uncooperative patients. Its harmonization and 3 T-to-7 T synthesis abilities also help pool data across scanners and sites for large multi-site studies, while preserving tissue volumes makes it suitable as a preprocessing step ahead of diagnostic assessment of conditions such as multiple sclerosis and gliomas.
BME-X demonstrates that a single tissue-aware foundation model can replace a patchwork of artifact- and cohort-specific enhancement tools while improving the end-to-end accuracy of clinical and research neuroimaging workflows. Its lifespan-wide validation and demonstrated robustness to pathology address a long-standing gap in MRI restoration, where most prior methods were narrowly tuned to one age range or one type of degradation. With openly released MIT-licensed code, multiple pretrained checkpoints, Docker deployment and full documentation, BME-X is positioned for practical adoption, and its publication in Nature Biomedical Engineering signals the growing role of foundation models in medical image enhancement. A key limitation is that the released models are specialized to brain MRI and were trained primarily on developing-brain data, so application to other organs or modalities would require further adaptation.
Sun, Y., et al. (2024) A foundation model for enhancing magnetic resonance images and downstream segmentation, registration and diagnostic tasks. Nature Biomedical Engineering.
DOI: 10.1038/s41551-024-01283-7Papers that recently cited this model.
The most-cited papers that cite this model.
Not enough data