bio.rodeo
ModelsOrganizationsProvidersLeaderboardAboutSign in
bio.rodeo

The authoritative source for evaluating biological foundation models. No hype, just honest analysis.

Categories
  • DNA & Gene
  • RNA
  • Protein
  • Small molecule
  • Single-cell
  • Spatial omics
  • Pathology
  • Imaging
  • Metabolomics
  • Biosignals
  • Language model
bio.rodeoModelsOrganizationsProvidersLeaderboardAboutFAQSubmit a modelContact
© 2026 Pulsatance. All rights reserved. ~
Built by Pulsatance
Small molecule foundation models
Small moleculeLanguage model

PKAG-DDI

Huazhong Agricultural University

Drug-drug interaction event text generation from two molecular structures, conditioned on biological functions selected for each drug in the pair.

Released: July 2025

When patients take several drugs at once, the resulting drug-drug interactions (DDIs) can alter absorption, metabolism, or pharmacodynamic effect in ways that matter clinically. Computational DDI methods have overwhelmingly framed this as classification: assign a drug pair to one of a fixed set of interaction-event labels, then look the label up in a separate table to recover what it means. That framing breaks down against databases such as DDInter2.0, whose event descriptions are detailed free text rather than a countable set of classes, and it forces clinicians to translate a label back into a mechanism.

PKAG-DDI reframes the task as generation: given two drug molecules, produce the natural-language description of the interaction event directly. Its central observation is that each drug plays a distinct role in an interaction — one may be a gastric alkalinizer, the other pH-sensitive — and that naming those two biological functions as explicit context substantially improves what a language model can say about the pair. Because such functions are specialist knowledge that is usually unavailable for a new drug pair, the model learns to select them itself. It was developed by Ziyan Wang, Zhankun Xiong, Feng Huang, and Wen Zhang at Huazhong Agricultural University and published at ACL 2025.

PKAG-DDI is a task-specialized system rather than a general-purpose backbone. It composes existing pretrained components — a frozen molecular graph encoder and graph-to-sequence adapter taken from MolTC, and a Galactica 1.3B language model — and adds two new trained modules on top. Trained once, it generates interaction text for drug pairs never seen during training without per-pair retraining.

#Key Features

  • Generation instead of classification: Outputs the interaction-event description as free text, removing the label-to-text lookup step and accommodating databases whose event descriptions cannot be reduced to discrete classes.
  • Pairwise knowledge selector (PKS): A cross-attention module that conditions each drug's representation on its partner bidirectionally, then scores every biological function in a fixed knowledge set for each drug. A reuse strategy computes both directions from one shared attention matrix.
  • Pairwise knowledge integration: Rather than dumping all candidates into the prompt, the model marginalizes over the top-K × top-K function pairs weighted by their joint selection probability, so mismatched or noisy functions contribute less to each generated token.
  • Inductive generalization: Evaluated under cold-start and scaffold splits where test drugs are entirely absent from training, the settings that matter for genuinely new compounds.
  • Efficient selection over dense retrieval: Treating knowledge lookup as selection over a fixed function set cuts inference wall-clock time roughly in half against a BERT-encoder retriever variant while improving top-2 accuracy.

#Technical Details

Drug pairs enter as both SMILES strings and 2D molecular graphs. The graph encoder and adapter are frozen at MolTC's pretrained weights; the adapter and the Galactica 1.3B language model are fine-tuned on DDI-event data using LoRA, with training on two A800 GPUs. The selector is trained separately, supervised by BM25-matched gold biological functions, and combines graph-derived node prototype representations with molecular fingerprints through an MLP classifier. The authors recommend K = 2, since roughly 97% of drugs in the data carry fewer than three annotated biological functions.

Two datasets were constructed from professional databases. The MecDDI set covers 1,685 drugs, 1,061 biological function types, and 152,922 DDIs spanning 103 event types; the DDInter2.0 set covers 1,683 drugs and 152,887 DDIs with longer, less summarizable descriptions. On DDInter2.0 the model reaches 92.39 BLEU-2 under random split versus 83.18 for MolTC, with larger relative margins in the inductive settings (44.18 vs. 37.34 BLEU-2 cold-start). Scored as classification on MecDDI it remains competitive with dedicated classifiers (95.05% accuracy random split, 44.39% cold-start). An oracle variant supplied with ground-truth biological functions scores far higher, quantifying how much headroom remains in the selection step.

#Applications

The intended user is a pharmacologist or clinical decision-support developer who needs an interpretable statement about why two drugs interact, not just that they do — particularly for compounds too new to appear in curated interaction databases. Stratifying DDInter2.0 by clinical risk level, generation quality was highest for major-risk interactions, the tier where an explanation is most consequential.

#Impact

PKAG-DDI is an early demonstration that DDI-event prediction can be posed as text generation without sacrificing the classification accuracy that established methods deliver, and that explicitly modeling each drug's asymmetric role is what makes that work. Its limits are stated plainly by the authors: the selector operates over a fixed knowledge set and cannot be updated dynamically, so a drug whose biological function falls outside that set is out of scope, and all evaluation is retrospective against database annotations rather than prospective clinical validation. Code is public; trained checkpoints and the processed datasets are distributed through a HuggingFace dataset repository, though the repository carries no license file.

Citations

DOI: 10.18653/v1/2025.acl-long.539

Preprint

DOI: 10.48550/arXiv.2507.19011

Recent citations

Papers that recently cited this model.

Not enough citation data yet.

Top citations

The most-cited papers that cite this model.

Not enough citation data yet.

Where to run PKAG-DDI

Providers that host PKAG-DDI for inference, fine-tuning, or weight download.

No providers recorded yet. Browse all providers

Fields of citing research

Not enough data

Openness

bio.rodeo opennessClosed · low usability and reproducibility
28Closed
Usability — can I run it?23
Reproducibility — can I retrain it?18

Tags

drug_drug_interactiongenerativegraph_neural_networkretrieval_augmentedtext_generation

Resources

GitHub RepositoryResearch PaperDataset