13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
Menu
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
    • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
      The ranking of the groups is based on the analysis of zscores for GDT_TS.
    • TBM-easy
    • TBM-hard
    • TBM/FM
    • FM
    • FM_sp (Combination of EUs: T0953s2-D23, T0984, T1000, T1002)
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 145 QUARK 112 133.8670 1 1.1952 1 133.8717 1 1.1953 1
2 261 Zhang-Server 112 132.1309 2 1.1797 2 132.1309 2 1.1797 2
3 324 RaptorX-DeepModeller 112 119.2505 3 1.0647 3 120.7841 3 1.0784 3
4 221 RaptorX-TBM 112 93.5465 4 0.8352 4 96.9804 4 0.8659 4
5 368 BAKER-ROSETTASERVER 111 81.2479 5 0.7500 5 93.6164 5 0.8434 5
6 498 RaptorX-Contact 112 75.5552 6 0.6746 6 89.1295 6 0.7958 6
7 243 MULTICOM-CONSTRUCT 112 63.2711 7 0.5649 7 68.4483 7 0.6111 7
8 058 MULTICOM_CLUSTER 112 61.5832 8 0.5498 8 66.2267 8 0.5913 8
9 149 Zhou-SPOT-3D 112 54.4687 10 0.4863 11 64.9761 9 0.5801 9
10 023 MULTICOM-NOVEL 112 59.1006 9 0.5277 9 64.5563 10 0.5764 10
11 156 Seok-server 112 39.7977 15 0.3553 16 64.0220 11 0.5716 11
12 441 FALCON 112 43.3594 12 0.3871 12 62.0630 12 0.5541 13
13 164 Yang-Server 109 47.7029 11 0.4927 10 61.7834 13 0.5668 12
14 246 IntFOLD5 112 43.1527 13 0.3853 13 58.7882 14 0.5249 14
15 116 Zhang-CEthreader 112 41.8141 14 0.3733 14 57.1949 15 0.5107 15
16 160 CMA-align 107 24.3738 16 0.3213 17 46.1968 16 0.4317 18
17 266 slbio_server 99 -14.4253 20 0.1169 19 43.1003 17 0.4354 17
18 124 AWSEM-Suite 111 14.3526 17 0.1473 18 35.8641 18 0.3231 20
19 337 FALCON-TBM 112 -6.4756 18 -0.0578 21 35.6381 19 0.3182 21
20 470 Seok-assembly 81 -61.3392 26 0.0082 20 32.2053 20 0.3976 19
21 402 RBO-Aleph 104 -22.8419 21 -0.0658 22 30.4018 21 0.2923 24
22 004 YASARA 101 -29.6794 23 -0.0760 24 30.3746 22 0.3007 23
23 488 Delta-Gelly-Server 110 -29.5720 22 -0.2325 26 28.4853 23 0.2590 25
24 347 MESHI-server 57 -89.4154 28 0.3611 15 26.3146 24 0.4617 16
25 110 Distill 112 -7.3987 19 -0.0661 23 24.2394 25 0.2164 26
26 085 BhageerathH-Plus 112 -31.5380 24 -0.2816 27 19.8253 26 0.1770 27
27 312 MUFold_server 112 -47.2943 25 -0.4223 28 19.2060 27 0.1715 28
28 432 Seok-naive_assembly 53 -126.1074 36 -0.1530 25 16.5613 28 0.3125 22
29 152 PconsC4 111 -73.8292 27 -0.6471 29 11.1110 29 0.1001 30
30 407 rawMSA 100 -98.2956 30 -0.7430 30 10.2109 30 0.1021 29
31 041 FALCON-Contact 112 -115.0799 33 -1.0275 34 7.4247 31 0.0663 31
32 497 GaussDCA 111 -109.7835 31 -0.9710 33 3.0737 32 0.0277 32
33 365 3D-JIGSAW_SL1 112 -93.2545 29 -0.8326 31 3.0156 33 0.0269 34
34 282 PRAYOG 98 -114.1652 32 -0.8792 32 2.6510 34 0.0271 33
35 007 ACOMPMOD 112 -117.0645 34 -1.0452 35 2.2178 35 0.0198 35
36 378 Cao-server 112 -144.4453 37 -1.2897 38 0.8806 36 0.0079 36
37 257 NOCONTACT 107 -159.9040 38 -1.4010 39 0.2413 37 0.0023 37
38 348 HMSCasper-Refiner 112 -119.2106 35 -1.0644 36 0.1956 38 0.0017 38
39 458 FOLDNET 74 -169.2696 39 -1.2604 37 0.0014 39 0.0000 39
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis