14th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
Menu
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
    • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
      The ranking of the groups is based on the analysis of zscores for GDT_TS.
    • TBM-easy
    • TBM-hard
    • TBM/FM
    • FM
    • Multidom
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 042 QUARK 38 43.5675 1 1.1465 1 43.6742 1 1.1493 1
2 324 Zhang-Server 38 42.2557 2 1.1120 2 42.2557 2 1.1120 2
3 031 Zhang-CEthreader 38 36.3818 3 0.9574 3 38.8477 3 1.0223 3
4 226 Zhang-TBM 38 33.5740 4 0.8835 4 34.5835 4 0.9101 4
5 435 Zhang_Ab_Initio 38 31.3312 5 0.8245 5 32.6380 5 0.8589 5
6 183 tFold-CaT 38 27.0909 6 0.7129 6 28.0501 6 0.7382 6
7 209 BAKER-ROSETTASERVER 38 21.8615 9 0.5753 9 27.7256 7 0.7296 7
8 238 tFold 38 24.6871 7 0.6497 7 27.0153 8 0.7109 8
9 351 tFold-IDT 38 22.4421 8 0.5906 8 24.8725 9 0.6545 9
10 140 Yang-Server 38 21.0374 10 0.5536 10 22.9073 10 0.6028 10
11 377 Yang_FM 38 19.5553 13 0.5146 14 22.5597 11 0.5937 11
12 187 MULTICOM-HYBRID 38 19.7322 11 0.5193 11 22.2780 12 0.5863 12
13 460 Yang_TBM 38 18.1665 17 0.4781 18 21.8754 13 0.5757 13
14 252 MULTICOM-DEEP 38 18.2396 16 0.4800 17 21.3371 14 0.5615 14
15 367 FoldX 38 19.7155 12 0.5188 13 21.0658 15 0.5544 15
16 319 MULTICOM-DIST 38 18.6553 15 0.4909 16 20.8300 16 0.5482 16
17 326 FALCON-DeepFolder 38 18.8653 14 0.4965 15 20.6228 17 0.5427 17
18 222 TOWER 38 16.8890 18 0.4444 20 19.5776 18 0.5152 19
19 198 MULTICOM-CONSTRUCT 38 16.3240 19 0.4296 21 19.1628 19 0.5043 20
20 075 MULTICOM-CLUSTER 38 15.2539 20 0.4014 22 18.9636 20 0.4990 22
21 337 CATHER 38 12.9290 22 0.3402 24 18.2195 21 0.4795 23
22 468 FALCON-geom 35 9.7537 23 0.4501 19 17.5882 22 0.5025 21
23 013 FEIG-S 38 7.6262 24 0.2007 25 16.4404 23 0.4326 24
24 487 RaptorX 38 13.4333 21 0.3535 23 15.9087 24 0.4186 25
25 277 FALCON-TBM 33 -6.6371 28 0.1019 26 12.7773 25 0.3872 26
26 070 Seok-server 38 -5.9998 26 -0.1579 28 11.1465 26 0.2933 27
27 364 Kiharalab_Z_Server 38 -0.4377 25 -0.0115 27 6.8827 27 0.1811 29
28 097 AWSEM-Suite 38 -6.2763 27 -0.1652 29 6.0294 28 0.1587 30
29 451 Seok-assembly 12 -54.0168 42 -0.1681 30 3.4763 29 0.2897 28
30 050 IntFOLD6 38 -31.0623 32 -0.8174 35 3.0733 30 0.0809 31
31 278 BAKER-ROBETTA 36 -29.0562 31 -0.6960 33 1.7700 31 0.0492 32
32 063 ACOMPMOD 38 -52.4444 41 -1.3801 46 1.4497 32 0.0382 33
33 437 MUFOLD2 38 -46.9201 37 -1.2347 42 1.3346 33 0.0351 34
34 275 MULTICOM-AI 2 -70.9615 45 0.5192 12 1.0385 34 0.5192 18
35 170 BhageerathH-Plus 38 -47.7165 38 -1.2557 43 0.8448 35 0.0222 35
36 138 LAW 38 -26.0962 29 -0.6867 32 0.8374 36 0.0220 36
37 317 MASS 38 -26.9864 30 -0.7102 34 0.3976 37 0.0105 37
38 305 CAO-SERVER 38 -46.8167 36 -1.2320 41 0.1905 38 0.0050 38
39 259 AWSEM-CHEN 38 -37.3259 33 -0.9823 37 0.0507 39 0.0013 39
40 169 3D-JIGSAW-SwarmLoop 38 -48.4117 39 -1.2740 44 0.0098 40 0.0003 40
41 195 ShanghaiTech 3 -72.0591 47 -0.6864 31 0.0000 41 0.0000 41
42 211 MESHI_server 4 -71.7105 46 -0.9276 36 0.0000 41 0.0000 41
43 052 GAPF_LNCC_SERVER 34 -44.7976 35 -1.0823 38 0.0000 41 0.0000 41
44 151 RBO-PSP-CP 38 -44.5365 34 -1.1720 39 0.0000 41 0.0000 41
45 491 Seok-naive_assembly 7 -70.4992 44 -1.2142 40 0.0000 41 0.0000 41
46 081 MUFOLD 37 -50.1078 40 -1.3002 45 0.0000 41 0.0000 41
47 033 ishidalab 11 -69.2052 43 -1.3823 47 0.0000 41 0.0000 41
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2020, University of California, Davis