Chinese University of Hong Kong, Shenzhen / West China Hospital of Sichuan University / University College Dublin / Shenzhen University / Nanjing University of Posts and Telecommunications / North Sichuan Medical College / Shenzhen Research Institute of Big Data / Harbin Institute of Technology (Shenzhen) / Wuhan University / King Abdullah University of Science and Technology / Beijing University of Posts and Telecommunications / University of Science and Technology of China / Chinese Academy of Sciences
Released November 25, 2024
Ultrasound foundation model pretrained by federated learning across 16 institutions, transferring to disease diagnosis and lesion segmentation.
Shenzhen Research Institute of Big Data / Chinese University of Hong Kong, Shenzhen
Released June 27, 2024
Open medical multimodal LLMs (7B and 34B) for visual question answering over radiology, pathology, and endoscopy images, trained on PubMedVision.
Chinese University of Hong Kong, Shenzhen / Sun Yat-sen University / Shenzhen Research Institute of Big Data
Released February 17, 2023
Medical vision-language pretraining unifying fusion-encoder and dual-encoder designs, handling image-only, text-only, and paired inputs in one model.
Shenzhen Research Institute of Big Data / Chinese University of Hong Kong, Shenzhen / Sun Yat-sen University
Released September 15, 2022
Medical vision-language pretraining framework that injects structured medical knowledge into radiology image-text learning for VQA and retrieval.
Shenzhen Research Institute of Big Data / Chinese University of Hong Kong, Shenzhen / Sun Yat-sen University
Released September 15, 2022
Self-supervised medical vision-and-language pretraining via multi-modal masked autoencoders that reconstruct masked image patches and text tokens.