13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
  • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
      The ranking of the groups is based on the analysis of zscores for GDT_TS.
    • TBM
    • TBM/FM
    • FM
    • FM_sp (Combination of EUs: T0953s2-D23, T0984, T1000, T1002)
    #     GR
    code
    GR
    name
    Domains Count     SUM Zscore
    (>-2.0)
    Rank SUM Zscore
    (>-2.0)
    AVG Zscore
    (>-2.0)
    Rank AVG Zscore
    (>-2.0)
    SUM Zscore
    (>0.0)
    Rank SUM Zscore
    (>0.0)
    AVG Zscore
    (>0.0)
    Rank AVG Zscore
    (>0.0)
1 145 QUARK 112 133.8364 1 1.1950 1 133.8411 1 1.1950 1
2 261 Zhang-Server 112 132.1278 2 1.1797 2 132.1278 2 1.1797 2
3 324 RaptorX-DeepModeller 112 119.1360 3 1.0637 3 120.6696 3 1.0774 3
4 221 RaptorX-TBM 112 90.9425 4 0.8120 4 96.3764 4 0.8605 4
5 368 BAKER-ROSETTASERVER 111 81.1656 5 0.7492 5 93.5149 5 0.8425 5
6 498 RaptorX-Contact 112 75.4141 6 0.6733 6 88.9884 6 0.7945 6
7 243 MULTICOM-CONSTRUCT 112 63.2000 7 0.5643 7 68.3772 7 0.6105 7
8 058 MULTICOM_CLUSTER 112 58.7532 8 0.5246 8 65.3967 8 0.5839 8
9 149 Zhou-SPOT-3D 112 54.3837 10 0.4856 11 64.9085 9 0.5795 9
10 023 MULTICOM-NOVEL 112 56.6803 9 0.5061 9 64.1360 10 0.5726 10
11 156 Seok-server 112 39.7069 15 0.3545 16 63.9311 11 0.5708 11
12 441 FALCON 112 43.2277 12 0.3860 12 62.0212 12 0.5538 13
13 164 Yang-Server 109 47.5957 11 0.4917 10 61.6762 13 0.5658 12
14 246 IntFOLD5 112 43.0044 13 0.3840 13 58.6399 14 0.5236 14
15 116 Zhang-CEthreader 112 41.7569 14 0.3728 14 57.1377 15 0.5102 15
16 160 CMA-align 107 24.2370 16 0.3200 17 46.0600 16 0.4305 18
17 266 slbio_server 99 -14.4831 20 0.1163 19 43.0425 17 0.4348 17
18 124 AWSEM-Suite 111 14.3025 17 0.1469 18 35.8140 18 0.3226 20
19 337 FALCON-TBM 112 -6.6333 18 -0.0592 21 35.6381 19 0.3182 21
20 470 Seok-assembly 81 -61.3392 26 0.0082 20 32.2053 20 0.3976 19
21 402 RBO-Aleph 104 -22.9685 21 -0.0670 22 30.3946 21 0.2923 24
22 004 YASARA 101 -30.0637 23 -0.0798 24 30.3746 22 0.3007 23
23 488 Delta-Gelly-Server 110 -29.7816 22 -0.2344 26 28.4853 23 0.2590 25
24 347 MESHI-server 57 -89.5497 28 0.3588 15 26.2448 24 0.4604 16
25 110 Distill 112 -7.5317 19 -0.0672 23 24.2194 25 0.2162 26
26 085 BhageerathH-Plus 112 -33.2129 24 -0.2965 27 19.8253 26 0.1770 27
27 312 MUFold_server 112 -47.3633 25 -0.4229 28 19.1134 27 0.1707 28
28 432 Seok-naive_assembly 53 -126.1074 36 -0.1530 25 16.5613 28 0.3125 22
29 152 PconsC4 111 -73.8761 27 -0.6475 29 11.1110 29 0.1001 30
30 407 rawMSA 100 -98.2998 30 -0.7430 30 10.2109 30 0.1021 29
31 041 FALCON-Contact 112 -115.7484 33 -1.0335 34 7.4247 31 0.0663 31
32 497 GaussDCA 111 -109.9158 31 -0.9722 33 3.0737 32 0.0277 32
33 365 3D-JIGSAW_SL1 112 -93.4620 29 -0.8345 31 3.0156 33 0.0269 34
34 282 PRAYOG 98 -114.3041 32 -0.8807 32 2.6510 34 0.0271 33
35 007 ACOMPMOD 112 -117.3321 34 -1.0476 35 2.2178 35 0.0198 35
36 378 Cao-server 112 -144.6172 37 -1.2912 38 0.8806 36 0.0079 36
37 257 NOCONTACT 107 -160.0579 38 -1.4024 39 0.2413 37 0.0023 37
38 348 HMSCasper-Refiner 112 -119.3676 35 -1.0658 36 0.1956 38 0.0017 38
39 458 FOLDNET 74 -169.2696 39 -1.2604 37 0.0014 39 0.0000 39
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis