Academic

Shenzhen Research Institute of Big Data

Research institute focused on big data and AI, affiliated with the Chinese University of Hong Kong, Shenzhen

Location: Shenzhen, China
4 models(4 Language model, 3 Pathology, 1 Imaging)

Models (4)

HuatuoGPT-Vision

Shenzhen Research Institute of Big Data / Chinese University of Hong Kong, Shenzhen

Released June 27, 2024

1871.9K399

A family of open medical multimodal LLMs (7B and 34B) trained on PubMedVision, a 1.3M-sample medical VQA dataset distilled from PubMed image-text pairs.

PathologyLanguage model

PTUnifier

Chinese University of Hong Kong, Shenzhen / Sun Yat-sen University / Shenzhen Research Institute of Big Data

Released February 17, 2023

5278

Prompt-based medical vision-language pretraining that unifies fusion-encoder and dual-encoder architectures, handling image-only, text-only, and image-text inputs in one model.

PathologyLanguage model

ARL (Align, Reason and Learn)

Shenzhen Research Institute of Big Data / Chinese University of Hong Kong, Shenzhen / Sun Yat-sen University

Released September 15, 2022

10938

Knowledge-enhanced medical vision-and-language pre-training framework that aligns, reasons over, and learns from structured medical knowledge for radiology image-text tasks.

ImagingLanguage model

M3AE

Shenzhen Research Institute of Big Data / Chinese University of Hong Kong, Shenzhen / Sun Yat-sen University

Released September 15, 2022

183132

Self-supervised medical vision-and-language pretraining via multi-modal masked autoencoders that reconstruct masked image patches and text tokens.

PathologyLanguage model