13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
Menu
Multimer Predictions Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate zscores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate zscores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
Targets:
  • easy
  • medium
  • hard
  • X-ray
  • NMR
  • CryoEM
Groups:
  • CASP groups on all targets
  • CASP+CAPRI groups on CAPRI targets only
The final ranking was based on the models designated "1" according to the formula: Z-score(F1) + Z-score(Jaccard score) + Z-score(lDDT(oligo)) + Z-score(GDT_TS) .
    #     GR
    name		     GR
    code		     Targets Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 Venclovas 366 42 31.3987 1 0.7476 2 35.9656 1 0.8563 1
2 Seok 068 42 19.2971 2 0.4595 3 25.4996 2 0.6071 4
3 BAKER 086 27 -9.1063 8 0.7738 1 22.8661 3 0.8469 2
4 Kiharalab 344 41 8.3336 3 0.2520 5 20.8150 4 0.5077 5
5 D-Haven 329 42 5.3015 4 0.1262 7 17.8609 5 0.4253 7
6 Elofsson 192 42 1.3394 5 0.0319 8 13.9652 6 0.3325 10
7 Bates_BMM 163 42 -5.0670 6 -0.1206 11 13.5546 7 0.3227 11
8 SBROD 135 36 -20.6776 9 -0.2410 14 12.9496 8 0.3597 8
9 Seok-assembly 470 42 -6.3881 7 -0.1521 12 12.7337 9 0.3032 12
10 Grudinin 196 37 -25.3271 10 -0.4142 18 10.7912 10 0.2917 13
11 Seok-naive_assembly 432 30 -26.2677 11 -0.0756 10 10.5773 11 0.3526 9
12 YASARA 004 19 -41.9861 13 0.2113 6 8.8115 12 0.4638 6
13 KIAS-Gdansk 208 23 -42.5218 14 -0.1966 13 6.2189 13 0.2704 14
14 McGuffin 460 30 -38.3658 12 -0.4789 19 6.0302 14 0.2010 16
15 BAKER-ROSETTASERVER 368 9 -62.6986 17 0.3668 4 5.9063 15 0.6563 3
16 chuo-u 047 25 -42.9829 15 -0.3593 15 5.7182 16 0.2287 15
17 PepBuilderJ 397 28 -43.9836 16 -0.5708 20 4.3366 17 0.1549 19
18 Spider 358 12 -70.8710 18 -0.9059 21 1.1927 18 0.0994 20
19 Jones-UCL 117 5 -75.8361 20 -0.3672 16 0.8127 19 0.1625 18
20 DL-Haven 351 2 -80.8191 21 -0.4095 17 0.3450 20 0.1725 17
21 Forbidden 122 9 -74.8320 19 -0.9813 22 0.1581 21 0.0176 22
22 AWSEM 112 1 -81.9995 22 0.0005 9 0.0640 22 0.0640 21
23 comp_biolo_course 452 1 -83.4412 23 -1.4412 23 0.0000 23 0.0000 23
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis