bio.rodeo
ModelsOrganizationsProvidersLeaderboardAboutSign in
bio.rodeo

The authoritative source for evaluating biological foundation models. No hype, just honest analysis.

Categories
  • DNA & Gene
  • RNA
  • Protein
  • Small molecule
  • Single-cell
  • Spatial omics
  • Pathology
  • Imaging
  • Metabolomics
  • Biosignals
  • Language model
bio.rodeoModelsOrganizationsProvidersLeaderboardAboutFAQSubmit a modelTermsPrivacyContact
© 2026 Pulsatance. All rights reserved. ~
Built by Pulsatance
models / protein / gate
Protein
University of MissouriReleased February 2025

GATE

Graph transformer that scores the accuracy of predicted protein complex structures, ranking model pools using pairwise structural similarity graphs.

The short version

  • —Picks the best model out of a large pool of predicted complex structures
  • —Builds a graph whose nodes are candidate models and whose edges are their mutual similarity
  • —Fuses single-model quality scores with cross-model geometry in one estimator
  • —Trained on one CASP round and tested blind on the next, with no retuning
24Openness

Where to run it

No providers recorded yet. Browse all providers

Structure prediction has largely stopped being the bottleneck; choosing among predictions has not. A pipeline built on AlphaFold 2 or AlphaFold 3 can sample thousands of candidate structures for one protein complex, and the confidence scores those methods emit are useful but imperfect, particularly for multi-chain assemblies where interface accuracy and monomer accuracy diverge. Estimation of model accuracy — picking good structures out of a large pool without knowing the answer — is therefore a distinct problem with its own track at the CASP community assessment.

GATE, short for Graph-based estimAtion of proTein complex modEl accuracy, is a graph transformer built for that task by Jian Liu, Pawan Neupane and Jianlin Cheng at the University of Missouri. Its central idea is that a pool of candidate structures carries information no single structure does: predictors converge on the correct fold and scatter on incorrect ones, so how similar a model is to its peers is evidence about its quality. GATE encodes the pool as a graph — one node per structural model, edges weighted by pairwise similarity — and lets a transformer combine that consensus signal with per-model quality features.

Posted as a preprint in February 2025 and published in Bioinformatics Advances later that year, it sits in the same group's ecosystem as MULTICOM4, whose extensive AlphaFold-based sampling produces exactly the large, heterogeneous model pools GATE is designed to triage.

#Key Features

  • Consensus captured as graph structure: Pairwise similarity between candidate models becomes edge weights rather than a hand-computed average score, letting attention weigh which neighbors are informative instead of treating all comparisons equally.
  • Single-model and multi-model features together: Node features carry intrinsic per-structure quality estimates while the graph carries inter-model geometry, so the estimator does not have to choose between the two families of quality signal.
  • Complex-aware, not monomer-only: The method targets multi-chain assemblies, where interface quality drives usefulness and single-chain accuracy measures mislead; separate entry points handle multimers and tertiary structures.
  • Ensembles existing quality predictors: Features are drawn from established estimators including GCPNet-EMA, EnQA, DProQA and VoroMQA, so GATE aggregates complementary views rather than replacing them.
  • Released with trained checkpoints: The repository ships pretrained weights and inference scripts, so the model applies to a new pool without retraining.

#Technical Details

GATE constructs a graph in which each node is one candidate structural model of a target complex and each edge encodes the structural similarity between the two models it connects. Node features are quality estimates produced by a panel of existing single-model and multi-model tools, and a graph transformer propagates information across the pairwise similarity graph to output a predicted accuracy score per model, which is then used to rank the pool.

On the CASP15 dataset the model achieved a Pearson correlation of 0.748 with true accuracy and a ranking loss of 0.1191, the best figures among the methods compared. The stronger evidence is CASP16, a genuinely blind assessment: trained on CASP15 data and applied without adjustment, GATE ranked fifth by the summed z-scores across metrics, and on per-target TM-score-based measures it recorded the highest Pearson correlation of any participating method at 0.7076, a Spearman correlation of 0.4514 (fourth), a ranking loss of 0.1221 (third) and an area under the curve of 0.6680 (third). The published version adds evaluation on large in-house datasets generated by extensive AlphaFold-based sampling with MULTICOM4, confirming behavior on model pools far larger than CASP supplies. Deployment is heavyweight: the pipeline orchestrates several third-party predictors in separate conda environments and expects roughly 2.5 TB of sequence and structure databases.

#Applications

The concrete use is model selection. A structural biologist or drug-discovery team that has sampled a large pool of complex predictions must send a small number of structures downstream — to interface analysis, docking, mutational interpretation, or experimental follow-up — and GATE ranks the pool so the chosen few are more likely to be right. It also serves as a quality gate in automated prediction servers, where a numeric accuracy estimate decides whether a prediction is reported confidently, flagged, or discarded. Because it consumes any set of PDB-format models, it is agnostic to which predictor generated them.

#Impact

GATE's contribution is showing that the geometry of a prediction pool, treated explicitly as a graph rather than collapsed into a consensus average, is a strong accuracy signal for multi-chain assemblies — demonstrated where such claims are hardest to fake, in a blind assessment on targets released after training. Its practical reach is limited by weight rather than method: the multi-terabyte database requirement and multi-environment installation put it out of reach for casual use, and it inherits the failure modes of the predictors it aggregates. The repository ships no LICENSE file, so despite the code and checkpoints being publicly downloadable, the terms of reuse are undefined.

At a glance

Released
February 2025
Category
Protein
Organization
University of Missouri

Links

GitHub RepositoryResearch PaperbioRxiv Preprint

Tags

graph_neural_networkmodel_quality_assessmentprotein_complexstructure_predictiontransformer

Something wrong?

Much of this page is generated or calculated automatically. Flag anything that looks off and we will re-run it.