Shenzhen Research Institute of Big Data
Research institute focused on big data and AI, affiliated with the Chinese University of Hong Kong, Shenzhen
Models (4)
HuatuoGPT-Vision
Shenzhen Research Institute of Big Data / Chinese University of Hong Kong, Shenzhen
Released June 27, 2024
A family of open medical multimodal LLMs (7B and 34B) trained on PubMedVision, a 1.3M-sample medical VQA dataset distilled from PubMed image-text pairs.
PTUnifier
Chinese University of Hong Kong, Shenzhen / Sun Yat-sen University / Shenzhen Research Institute of Big Data
Released February 17, 2023
Prompt-based medical vision-language pretraining that unifies fusion-encoder and dual-encoder architectures, handling image-only, text-only, and image-text inputs in one model.
ARL (Align, Reason and Learn)
Shenzhen Research Institute of Big Data / Chinese University of Hong Kong, Shenzhen / Sun Yat-sen University
Released September 15, 2022
Knowledge-enhanced medical vision-and-language pre-training framework that aligns, reasons over, and learns from structured medical knowledge for radiology image-text tasks.
M3AE
Shenzhen Research Institute of Big Data / Chinese University of Hong Kong, Shenzhen / Sun Yat-sen University
Released September 15, 2022
Self-supervised medical vision-and-language pretraining via multi-modal masked autoencoders that reconstruct masked image patches and text tokens.