14th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
Menu
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
    • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
      The ranking of the groups is based on the analysis of zscores for GDT_TS.
    • TBM-easy
    • TBM-hard
    • TBM/FM
    • FM
    • Multidom
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 324 Zhang-Server 96 85.8948 1 0.8947 1 87.0931 1 0.9072 1
2 042 QUARK 96 84.2077 2 0.8772 2 86.3225 2 0.8992 2
3 209 BAKER-ROSETTASERVER 96 74.3917 4 0.7749 4 81.5069 3 0.8490 3
4 031 Zhang-CEthreader 96 76.7221 3 0.7992 3 80.7560 4 0.8412 4
5 226 Zhang-TBM 96 72.7140 5 0.7574 5 75.4230 5 0.7857 5
6 238 tFold 96 59.9952 7 0.6250 7 66.6000 6 0.6937 6
7 183 tFold-CaT 96 59.7782 8 0.6227 8 66.1733 7 0.6893 7
8 351 tFold-IDT 96 59.1395 9 0.6160 9 65.5247 8 0.6825 8
9 487 RaptorX 96 61.0541 6 0.6360 6 64.1112 9 0.6678 9
10 435 Zhang_Ab_Initio 96 52.0941 11 0.5426 11 58.9274 10 0.6138 10
11 140 Yang-Server 96 54.9395 10 0.5723 10 57.9476 11 0.6036 11
12 013 FEIG-S 96 44.2108 13 0.4605 13 55.7960 12 0.5812 12
13 377 Yang_FM 96 51.5261 12 0.5367 12 55.4557 13 0.5777 13
14 367 FoldX 96 42.0965 16 0.4385 16 52.7864 14 0.5499 14
15 222 TOWER 96 42.8349 15 0.4462 15 52.5711 15 0.5476 15
16 460 Yang_TBM 96 40.3934 19 0.4208 19 50.4824 16 0.5259 16
17 252 MULTICOM-DEEP 96 43.9770 14 0.4581 14 49.9381 17 0.5202 17
18 326 FALCON-DeepFolder 96 33.8908 22 0.3530 22 49.6956 18 0.5177 18
19 187 MULTICOM-HYBRID 96 41.9587 17 0.4371 17 48.3062 19 0.5032 19
20 337 CATHER 96 37.9892 20 0.3957 20 47.3440 20 0.4932 20
21 198 MULTICOM-CONSTRUCT 96 40.5021 18 0.4219 18 46.7462 21 0.4869 21
22 319 MULTICOM-DIST 96 29.5182 23 0.3075 24 43.6461 22 0.4546 23
23 468 FALCON-geom 90 17.6371 24 0.3293 23 43.4691 23 0.4830 22
24 075 MULTICOM-CLUSTER 96 35.2993 21 0.3677 21 42.8233 24 0.4461 24
25 070 Seok-server 96 17.4845 25 0.1821 26 38.8618 25 0.4048 25
26 277 FALCON-TBM 84 -21.7644 28 0.0266 27 31.2740 26 0.3723 27
27 278 BAKER-ROBETTA 86 -37.9663 30 -0.2089 29 19.0958 27 0.2220 29
28 050 IntFOLD6 96 -37.8021 29 -0.3938 33 16.2680 28 0.1695 31
29 097 AWSEM-Suite 95 -19.2035 26 -0.1811 28 16.0217 29 0.1686 32
30 364 Kiharalab_Z_Server 96 -20.4597 27 -0.2131 30 14.0413 30 0.1463 33
31 451 Seok-assembly 38 -124.3604 37 -0.2200 31 10.0169 31 0.2636 28
32 081 MUFOLD 94 -83.9148 31 -0.8502 35 7.7067 32 0.0820 35
33 211 MESHI_server 38 -130.5493 39 -0.3829 32 7.5264 33 0.1981 30
34 275 MULTICOM-AI 17 -153.1992 45 0.2824 25 6.8272 34 0.4016 26
35 437 MUFOLD2 96 -97.9940 33 -1.0208 38 6.4749 35 0.0674 36
36 033 ishidalab 44 -141.1745 43 -0.8449 34 5.3096 36 0.1207 34
37 063 ACOMPMOD 96 -131.8044 41 -1.3730 44 5.2425 37 0.0546 38
38 052 GAPF_LNCC_SERVER 88 -103.2281 34 -0.9912 37 4.7032 38 0.0534 39
39 259 AWSEM-CHEN 94 -86.9295 32 -0.8822 36 3.8288 39 0.0407 41
40 138 LAW 96 -107.9109 36 -1.1241 40 1.6039 40 0.0167 42
41 491 Seok-naive_assembly 25 -170.7082 46 -1.1483 41 1.4068 41 0.0563 37
42 170 BhageerathH-Plus 96 -139.2460 42 -1.4505 46 1.2500 42 0.0130 43
43 195 ShanghaiTech 21 -179.1807 47 -1.3896 45 0.8626 43 0.0411 40
44 317 MASS 96 -106.3397 35 -1.1077 39 0.6128 44 0.0064 44
45 151 RBO-PSP-CP 95 -127.6652 38 -1.3228 42 0.5848 45 0.0062 45
46 305 CAO-SERVER 96 -150.2121 44 -1.5647 47 0.1905 46 0.0020 46
47 169 3D-JIGSAW-SwarmLoop 96 -130.8422 40 -1.3629 43 0.0098 47 0.0001 47
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2020, University of California, Davis