Graph transformer that scores the accuracy of predicted protein complex structures, ranking model pools using pairwise structural similarity graphs.
No providers recorded yet. Browse all providers
Structure prediction has largely stopped being the bottleneck; choosing among predictions has not. A pipeline built on AlphaFold 2 or AlphaFold 3 can sample thousands of candidate structures for one protein complex, and the confidence scores those methods emit are useful but imperfect, particularly for multi-chain assemblies where interface accuracy and monomer accuracy diverge. Estimation of model accuracy — picking good structures out of a large pool without knowing the answer — is therefore a distinct problem with its own track at the CASP community assessment.
GATE, short for Graph-based estimAtion of proTein complex modEl accuracy, is a graph transformer built for that task by Jian Liu, Pawan Neupane and Jianlin Cheng at the University of Missouri. Its central idea is that a pool of candidate structures carries information no single structure does: predictors converge on the correct fold and scatter on incorrect ones, so how similar a model is to its peers is evidence about its quality. GATE encodes the pool as a graph — one node per structural model, edges weighted by pairwise similarity — and lets a transformer combine that consensus signal with per-model quality features.
Posted as a preprint in February 2025 and published in Bioinformatics Advances later that year, it sits in the same group's ecosystem as MULTICOM4, whose extensive AlphaFold-based sampling produces exactly the large, heterogeneous model pools GATE is designed to triage.
GATE constructs a graph in which each node is one candidate structural model of a target complex and each edge encodes the structural similarity between the two models it connects. Node features are quality estimates produced by a panel of existing single-model and multi-model tools, and a graph transformer propagates information across the pairwise similarity graph to output a predicted accuracy score per model, which is then used to rank the pool.
On the CASP15 dataset the model achieved a Pearson correlation of 0.748 with true accuracy and a ranking loss of 0.1191, the best figures among the methods compared. The stronger evidence is CASP16, a genuinely blind assessment: trained on CASP15 data and applied without adjustment, GATE ranked fifth by the summed z-scores across metrics, and on per-target TM-score-based measures it recorded the highest Pearson correlation of any participating method at 0.7076, a Spearman correlation of 0.4514 (fourth), a ranking loss of 0.1221 (third) and an area under the curve of 0.6680 (third). The published version adds evaluation on large in-house datasets generated by extensive AlphaFold-based sampling with MULTICOM4, confirming behavior on model pools far larger than CASP supplies. Deployment is heavyweight: the pipeline orchestrates several third-party predictors in separate conda environments and expects roughly 2.5 TB of sequence and structure databases.
The concrete use is model selection. A structural biologist or drug-discovery team that has sampled a large pool of complex predictions must send a small number of structures downstream — to interface analysis, docking, mutational interpretation, or experimental follow-up — and GATE ranks the pool so the chosen few are more likely to be right. It also serves as a quality gate in automated prediction servers, where a numeric accuracy estimate decides whether a prediction is reported confidently, flagged, or discarded. Because it consumes any set of PDB-format models, it is agnostic to which predictor generated them.
GATE's contribution is showing that the geometry of a prediction pool, treated explicitly as a graph rather than collapsed into a consensus average, is a strong accuracy signal for multi-chain assemblies — demonstrated where such claims are hardest to fake, in a blind assessment on targets released after training. Its practical reach is limited by weight rather than method: the multi-terabyte database requirement and multi-environment installation put it out of reach for casual use, and it inherits the failure modes of the predictors it aggregates. The repository ships no LICENSE file, so despite the code and checkpoints being publicly downloadable, the terms of reuse are undefined.
Much of this page is generated or calculated automatically. Flag anything that looks off and we will re-run it.