13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
Menu
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
    • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
      The ranking of the groups is based on the analysis of zscores for GDT_TS.
    • TBM-easy
    • TBM-hard
    • TBM/FM
    • FM
    • FM_sp (Combination of EUs: T0953s2-D23, T0984, T1000, T1002)
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 145 QUARK 45 73.5485 1 1.6344 1 73.5532 1 1.6345 1
2 261 Zhang-Server 45 69.2671 2 1.5393 2 69.2671 2 1.5393 2
3 324 RaptorX-DeepModeller 45 61.9434 3 1.3765 3 63.0717 3 1.4016 3
4 498 RaptorX-Contact 45 58.6870 4 1.3042 4 60.6071 4 1.3468 4
5 368 BAKER-ROSETTASERVER 44 42.2092 5 1.0048 5 46.9008 5 1.0659 5
6 221 RaptorX-TBM 45 39.6614 6 0.8814 6 41.7155 6 0.9270 6
7 149 Zhou-SPOT-3D 45 24.6379 7 0.5475 7 28.8353 7 0.6408 7
8 116 Zhang-CEthreader 45 16.9394 9 0.3764 9 22.9089 8 0.5091 8
9 058 MULTICOM_CLUSTER 45 17.1057 8 0.3801 8 21.3806 9 0.4751 10
10 164 Yang-Server 44 13.4434 12 0.3510 11 21.3386 10 0.4850 9
11 124 AWSEM-Suite 45 16.7691 10 0.3726 10 20.8277 11 0.4628 11
12 243 MULTICOM-CONSTRUCT 45 14.9067 11 0.3313 12 19.8842 12 0.4419 12
13 023 MULTICOM-NOVEL 45 12.9107 13 0.2869 13 17.8057 13 0.3957 13
14 441 FALCON 45 -0.0134 15 -0.0003 16 15.4266 14 0.3428 14
15 246 IntFOLD5 45 5.4360 14 0.1208 14 15.3151 15 0.3403 15
16 156 Seok-server 45 -6.7587 17 -0.1502 18 14.7592 16 0.3280 16
17 488 Delta-Gelly-Server 45 -7.8632 18 -0.1747 19 12.3162 17 0.2737 19
18 160 CMA-align 43 -1.8451 16 0.0501 15 11.5583 18 0.2688 20
19 152 PconsC4 45 -8.5447 19 -0.1899 20 10.3288 19 0.2295 21
20 402 RBO-Aleph 42 -17.1594 22 -0.2657 21 9.3779 20 0.2233 22
21 470 Seok-assembly 31 -36.7114 32 -0.2810 23 8.6675 21 0.2796 18
22 266 slbio_server 41 -24.5933 27 -0.4047 27 7.5231 22 0.1835 23
23 407 rawMSA 43 -17.8992 23 -0.3232 25 7.4504 23 0.1733 25
24 337 FALCON-TBM 45 -12.0539 20 -0.2679 22 5.9573 24 0.1324 26
25 041 FALCON-Contact 45 -22.6834 25 -0.5041 31 5.8392 25 0.1298 28
26 004 YASARA 40 -23.3033 26 -0.3326 26 5.1913 26 0.1298 27
27 110 Distill 45 -13.4110 21 -0.2980 24 4.1438 27 0.0921 29
28 347 MESHI-server 10 -70.0776 39 -0.0078 17 2.8883 28 0.2888 17
29 497 GaussDCA 45 -28.5671 28 -0.6348 32 2.6978 29 0.0600 30
30 432 Seok-naive_assembly 14 -68.8498 38 -0.4893 30 2.4347 30 0.1739 24
31 312 MUFold_server 45 -30.2131 30 -0.6714 34 2.3479 31 0.0522 32
32 282 PRAYOG 38 -31.2449 31 -0.4538 28 2.2133 32 0.0582 31
33 085 BhageerathH-Plus 45 -21.7707 24 -0.4838 29 1.8830 33 0.0418 33
34 378 Cao-server 45 -40.4879 33 -0.8997 35 0.8806 34 0.0196 34
35 007 ACOMPMOD 45 -52.6447 36 -1.1699 39 0.2119 35 0.0047 35
36 348 HMSCasper-Refiner 45 -30.0691 29 -0.6682 33 0.1956 36 0.0043 36
37 365 3D-JIGSAW_SL1 45 -41.3534 34 -0.9190 36 0.0000 37 0.0000 37
38 458 FOLDNET 33 -55.7042 37 -0.9607 37 0.0000 37 0.0000 37
39 257 NOCONTACT 45 -51.4004 35 -1.1422 38 0.0000 37 0.0000 37
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis