Send to

Choose Destination
Bioinformatics. 2018 Aug 29. doi: 10.1093/bioinformatics/bty760. [Epub ahead of print]

Comparative analysis of methods for evaluation of protein models against native structures.

Author information

Institute of Biotechnology, Life Sciences Center, Vilnius University, Sauletekio 7, Vilnius LT, Lithuania.
Genome Center, UC Davis, 451 Health Sciences Drive, Davis, California, USA.



Measuring discrepancies between protein models and native structures is at the heart of development of protein structure prediction methods and comparison of their performance. A number of different evaluation methods have been developed, however their comprehensive and unbiased comparison has not been performed.


We carried out a comparative analysis of several popular model assessment methods (RMSD, TM-score, GDT, QCS, CAD-score, LDDT, SphereGrinder and RPF) to reveal their relative strengths and weaknesses. The analysis, performed on a large and diverse model set derived in the course of three latest community-wide CASP experiments (CASP10-12), had two major directions. First, we looked at general differences between the scores by analyzing distribution, correspondence and correlation of their values as well as differences in selecting best models. Second, we examined the score differences taking into account various structural properties of models (stereochemistry, hydrogen bonds, packing of domains and chain fragments, missing residues, protein length and secondary structure). Our results provide a solid basis for an informed selection of the most appropriate score or combination of scores depending on the task at hand.

Supplementary information:

Supplementary data are available at Bioinformatics online.

Supplemental Content

Full text links

Icon for Silverchair Information Systems
Loading ...
Support Center