13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
Menu
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
    • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
      The ranking of the groups is based on the analysis of zscores for GDT_TS.
    • TBM-easy
    • TBM-hard
    • TBM/FM
    • FM
    • FM_sp (Combination of EUs: T0953s2-D23, T0984, T1000, T1002)
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 261 Zhang-Server 112 132.6209 1 1.1841 1 132.6209 1 1.1841 1
2 145 QUARK 112 131.6219 2 1.1752 2 131.6219 2 1.1752 2
3 324 RaptorX-DeepModeller 112 114.7367 3 1.0244 3 116.7373 3 1.0423 3
4 368 BAKER-ROSETTASERVER 111 89.7130 4 0.8262 4 97.7540 4 0.8807 4
5 221 RaptorX-TBM 112 82.7882 5 0.7392 5 87.2915 5 0.7794 5
6 498 RaptorX-Contact 112 67.6364 6 0.6039 6 82.1049 6 0.7331 6
7 243 MULTICOM-CONSTRUCT 112 65.8426 7 0.5879 7 69.7089 7 0.6224 7
8 058 MULTICOM_CLUSTER 112 63.9007 8 0.5705 8 67.1328 8 0.5994 8
9 149 Zhou-SPOT-3D 112 56.4068 10 0.5036 10 65.0740 9 0.5810 9
10 023 MULTICOM-NOVEL 112 60.3510 9 0.5388 9 64.6985 10 0.5777 10
11 441 FALCON 112 49.5615 12 0.4425 13 61.1362 11 0.5459 11
12 116 Zhang-CEthreader 112 49.8817 11 0.4454 12 60.3833 12 0.5391 12
13 164 Yang-Server 109 47.7535 13 0.4932 11 58.2443 13 0.5344 13
14 156 Seok-server 112 23.3542 16 0.2085 17 54.9090 14 0.4903 15
15 246 IntFOLD5 112 35.9820 14 0.3213 15 52.6490 15 0.4701 16
16 160 CMA-align 107 29.1808 15 0.3662 14 47.6708 16 0.4455 18
17 470 Seok-assembly 81 -45.6567 26 0.2018 18 41.5832 17 0.5134 14
18 337 FALCON-TBM 112 7.0875 18 0.0633 21 39.5237 18 0.3529 21
19 266 slbio_server 99 -23.1532 21 0.0288 22 39.4650 19 0.3986 20
20 124 AWSEM-Suite 111 17.7769 17 0.1782 19 38.7978 20 0.3495 22
21 004 YASARA 101 -24.2111 22 -0.0219 23 31.1627 21 0.3085 23
22 488 Delta-Gelly-Server 110 -18.7805 20 -0.1344 26 28.7726 22 0.2616 24
23 402 RBO-Aleph 104 -26.2449 23 -0.0985 24 26.5770 23 0.2555 25
24 432 Seok-naive_assembly 53 -109.4388 32 0.1615 20 23.8398 24 0.4498 17
25 347 MESHI-server 57 -93.2615 29 0.2937 16 23.1508 25 0.4062 19
26 110 Distill 112 -14.8946 19 -0.1330 25 21.0294 26 0.1878 26
27 085 BhageerathH-Plus 112 -27.6825 24 -0.2472 27 20.2862 27 0.1811 27
28 312 MUFold_server 112 -42.8204 25 -0.3823 28 18.3550 28 0.1639 28
29 407 rawMSA 100 -91.4269 28 -0.6743 29 14.7443 29 0.1474 29
30 152 PconsC4 111 -85.1241 27 -0.7489 30 9.5887 30 0.0864 30
31 007 ACOMPMOD 112 -104.3684 31 -0.9319 33 7.0846 31 0.0633 31
32 041 FALCON-Contact 112 -126.5265 35 -1.1297 35 4.2367 32 0.0378 32
33 365 3D-JIGSAW_SL1 112 -104.3345 30 -0.9316 32 3.5366 33 0.0316 34
34 282 PRAYOG 98 -118.0238 33 -0.9186 31 3.2525 34 0.0332 33
35 497 GaussDCA 111 -119.9718 34 -1.0628 34 3.0896 35 0.0278 35
36 257 NOCONTACT 107 -171.6563 38 -1.5108 39 0.6405 36 0.0060 36
37 348 HMSCasper-Refiner 112 -133.9604 36 -1.1961 36 0.5919 37 0.0053 37
38 378 Cao-server 112 -146.4133 37 -1.3073 37 0.3560 38 0.0032 38
39 458 FOLDNET 74 -176.0717 39 -1.3523 38 0.0374 39 0.0005 39
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis