13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
TS Analysis (refienement targets) : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores

  • Targets:
    • TBM easy
    • TBM hard
    • TBM/FM
    • FM
The ranking of the groups is performed on the basis of analysis of combined zscores according to the following formula used by the assessors: (0.46*RMS_CA + 0.2*SG + 0.17*GDT_HA + 0.15*QCS + 0.02*Molprb-Score)
    #     GR
    code
    GR
    name
    Domains Count     SUM Zscore
    (>-2.0)
    Rank SUM Zscore
    (>-2.0)
    AVG Zscore
    (>-2.0)
    Rank AVG Zscore
    (>-2.0)
    SUM Zscore
    (>0.0)
    Rank SUM Zscore
    (>0.0)
    AVG Zscore
    (>0.0)
    Rank AVG Zscore
    (>0.0)
1 086 BAKER 29 20.6386 2 0.7117 2 23.6473 1 0.8154 1
2 356 FEIGLAB 29 21.3158 1 0.7350 1 22.9048 2 0.7898 2
3 425 BAKER-AUTOREFINE 29 18.1908 3 0.6273 3 21.3874 3 0.7375 3
4 156 Seok-server 29 15.0090 4 0.5176 4 17.8233 4 0.6146 4
5 068 Seok 29 7.9530 10 0.2742 11 14.6388 5 0.5048 5
6 117 Jones-UCL 29 9.5902 7 0.3307 8 13.5831 6 0.4684 8
7 312 MUFold_server 27 -2.4648 16 0.0569 15 12.6791 7 0.4696 7
8 174 Zhang-Refinement 27 6.8539 11 0.4020 5 11.8047 8 0.4372 9
9 344 Kiharalab 29 9.9016 6 0.3414 7 11.7274 9 0.4044 11
10 390 Bhattacharya 29 10.7601 5 0.3710 6 11.7046 10 0.4036 12
11 217 Boniecki_pred 28 5.4682 13 0.2667 12 11.4498 11 0.4089 10
12 460 McGuffin 29 9.3605 9 0.3228 10 10.9511 12 0.3776 13
13 102 Bhattacharya-Server 29 9.4762 8 0.3268 9 10.5298 13 0.3631 14
14 190 DC_refine 29 6.4821 12 0.2235 13 9.7246 14 0.3353 15
15 004 YASARA 28 3.9078 14 0.2110 14 9.2504 15 0.3304 16
16 112 AWSEM 27 -6.8054 18 -0.1039 17 7.9501 16 0.2944 17
17 433 AIR 29 -5.1335 17 -0.1770 20 7.4131 17 0.2556 18
18 208 KIAS-Gdansk 29 -9.1654 19 -0.3160 22 7.2979 18 0.2517 19
19 328 Kiharalab_RF2 29 -12.9075 21 -0.4451 23 6.9539 19 0.2398 21
20 270 Huang 29 0.0207 15 0.0007 16 6.5223 20 0.2249 22
21 358 Spider 25 -11.6290 20 -0.1452 19 5.5906 21 0.2236 23
22 457 Wallner 19 -22.0696 23 -0.1089 18 4.6110 22 0.2427 20
23 431 Laufer 29 -36.4095 28 -1.2555 31 4.4866 23 0.1547 24
24 195 Seminoles 26 -33.8549 26 -1.0713 27 2.9144 24 0.1121 25
25 281 SHORTLE 29 -32.4475 25 -1.1189 28 2.8695 25 0.0989 26
26 196 Grudinin 29 -16.3150 22 -0.5626 24 2.2291 26 0.0769 28
27 288 UNRES 29 -36.0529 27 -1.2432 30 2.1900 27 0.0755 29
28 359 3DCNN 23 -25.1571 24 -0.5720 25 1.7149 28 0.0746 30
29 492 wf-BAKER-UNRES 25 -36.6215 29 -1.1449 29 1.4905 29 0.0596 31
30 197 MESHI 3 -52.6615 30 -0.2205 21 1.4381 30 0.4794 6
31 329 D-Haven 5 -52.7562 31 -0.9512 26 0.4610 31 0.0922 27
32 122 Forbidden 1 -58.0000 32 -2.0000 32 0.0000 32 0.0000 32
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis