14th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
Menu
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
    • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
      The ranking of the groups is based on the analysis of zscores for GDT_TS.
    • TBM-easy
    • TBM-hard
    • TBM/FM
    • FM
    • Multidom
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 427 AlphaFold2 92 244.0217 1 2.6524 1 244.0217 1 2.6524 1
2 473 BAKER 92 90.8241 2 0.9872 2 92.1241 2 1.0013 2
3 403 BAKER-experimental 92 88.9672 3 0.9670 3 91.4731 3 0.9943 3
4 480 FEIG-R2 92 72.5351 4 0.7884 4 74.5627 4 0.8105 4
5 129 Zhang 92 67.9065 5 0.7381 5 68.8922 5 0.7488 5
6 009 tFold_human 92 61.2858 7 0.6661 8 65.2157 6 0.7089 7
7 420 MULTICOM 92 63.2689 6 0.6877 7 64.0531 7 0.6962 8
8 042 QUARK 92 60.0226 10 0.6524 11 62.9711 8 0.6845 9
9 324 Zhang-Server 92 60.8875 8 0.6618 9 62.9122 9 0.6838 10
10 488 tFold-IDT_human 92 57.6435 11 0.6266 12 62.0795 10 0.6748 11
11 368 tFold-CaT_human 92 60.5423 9 0.6581 10 61.8464 11 0.6722 12
12 334 FEIG-R3 92 48.4424 20 0.5265 23 58.5809 12 0.6367 13
13 039 ropius0QA 92 55.7086 12 0.6055 13 57.8135 13 0.6284 14
14 293 MUFOLD_H 92 47.7806 21 0.5194 24 55.9608 14 0.6083 15
15 031 Zhang-CEthreader 92 49.5742 18 0.5389 21 55.9467 15 0.6081 16
16 032 MESHI 92 53.0953 14 0.5771 15 55.9047 16 0.6077 17
17 216 EMAP_CHAE 92 53.1597 13 0.5778 14 55.4235 17 0.6024 18
18 209 BAKER-ROSETTASERVER 92 46.1861 25 0.5020 28 55.2993 18 0.6011 19
19 379 Wallner 92 51.7365 15 0.5624 16 55.1852 19 0.5998 20
20 498 VoroMQA-select 92 51.4288 17 0.5590 18 54.5710 20 0.5932 21
21 220 McGuffin 92 49.5443 19 0.5385 22 53.7394 21 0.5841 22
22 253 Bhattacharya 92 51.5239 16 0.5600 17 52.9898 22 0.5760 23
23 067 ProQ2 92 47.7403 22 0.5189 25 52.3893 23 0.5694 25
24 339 ProQ3D 92 46.1913 24 0.5021 27 52.3390 24 0.5689 26
25 200 Bilbul2020 90 44.6502 27 0.5406 20 51.7027 25 0.5745 24
26 257 P3De 92 42.0842 34 0.4574 36 51.4179 26 0.5589 27
27 343 VoroCNN-select 92 44.9630 26 0.4887 29 51.2603 27 0.5572 28
28 226 Zhang-TBM 92 46.2470 23 0.5027 26 51.2506 28 0.5571 29
29 375 Ornate-select 92 41.7744 35 0.4541 37 50.0525 29 0.5440 31
30 362 Seok-refine 92 44.5467 29 0.4842 31 49.9288 30 0.5427 32
31 314 FEIG-R1 92 43.5177 31 0.4730 33 49.9051 31 0.5424 33
32 018 UNRES-template 92 40.2097 36 0.4371 38 49.7258 32 0.5405 34
33 026 NOVA 92 44.5255 30 0.4840 32 48.8017 33 0.5305 35
34 409 UOSHAN 92 44.5739 28 0.4845 30 48.7853 34 0.5303 36
35 024 DeepPotential 92 42.1109 33 0.4577 35 47.4492 35 0.5158 37
36 335 FEIG 92 35.0730 42 0.3812 47 47.2221 36 0.5133 38
37 062 SBROD-select 92 42.5695 32 0.4627 34 46.9970 37 0.5108 39
38 238 tFold 92 38.1540 38 0.4147 41 46.8745 38 0.5095 40
39 183 tFold-CaT 92 39.1858 37 0.4259 39 45.8442 39 0.4983 41
40 015 AP_1 92 32.1613 49 0.3496 53 45.6962 40 0.4967 43
41 351 tFold-IDT 92 36.6808 40 0.3987 45 45.5232 41 0.4948 46
42 304 Jones-UCL 91 35.0931 41 0.4076 43 45.3339 42 0.4982 42
43 487 RaptorX 92 38.0443 39 0.4135 42 44.0923 43 0.4793 48
44 005 Seder2020 92 34.4341 44 0.3743 49 44.0278 44 0.4786 49
45 435 Zhang_Ab_Initio 92 31.4388 50 0.3417 55 42.7313 45 0.4645 51
46 288 DATE 91 33.2561 45 0.3874 46 42.7127 46 0.4694 50
47 428 Seder2020hard 92 32.3221 48 0.3513 52 41.0799 47 0.4465 53
48 254 ropius0 92 25.3021 52 0.2750 58 40.3513 48 0.4386 56
49 101 Destini 91 29.3494 51 0.3445 54 40.1099 49 0.4408 55
50 140 Yang-Server 92 34.6484 43 0.3766 48 39.9200 50 0.4339 57
51 328 FoldXpro 92 24.7245 53 0.2687 59 39.1549 51 0.4256 58
52 125 PreferredFold 92 32.8701 46 0.3573 50 38.0691 52 0.4138 59
53 367 FoldX 92 23.0517 55 0.2506 62 37.8784 53 0.4117 60
54 222 TOWER 92 22.7629 56 0.2474 64 37.4481 54 0.4070 61
55 377 Yang_FM 92 32.4712 47 0.3529 51 37.1656 55 0.4040 62
56 013 FEIG-S 92 21.7130 58 0.2360 66 36.9980 56 0.4022 63
57 326 FALCON-DeepFolder 92 17.9097 62 0.1947 72 36.2895 57 0.3945 66
58 193 Seok 91 16.8610 63 0.2073 70 35.5224 58 0.3904 67
59 460 Yang_TBM 92 24.4840 54 0.2661 60 34.7367 59 0.3776 69
60 468 FALCON-geom 86 2.5490 67 0.1692 73 31.4848 60 0.3661 70
61 337 CATHER 92 20.5535 60 0.2234 68 31.3900 61 0.3412 74
62 187 MULTICOM-HYBRID 92 20.7438 59 0.2255 67 31.1606 62 0.3387 75
63 252 MULTICOM-DEEP 92 22.5575 57 0.2452 65 30.9342 63 0.3362 76
64 061 191227 92 14.9225 65 0.1622 75 30.0908 64 0.3271 77
65 198 MULTICOM-CONSTRUCT 92 19.2096 61 0.2088 69 28.1637 65 0.3061 78
66 319 MULTICOM-DIST 92 15.0275 64 0.1633 74 27.3434 66 0.2972 79
67 472 Elofsson 58 -52.8421 79 0.2613 61 26.3792 67 0.4548 52
68 075 MULTICOM-CLUSTER 92 12.2185 66 0.1328 77 25.2627 68 0.2746 82
69 070 Seok-server 92 -5.0902 70 -0.0553 85 24.8347 69 0.2699 83
70 277 FALCON-TBM 80 -33.7528 74 -0.1219 86 22.3455 70 0.2793 81
71 071 Kiharalab 92 -0.9724 69 -0.0106 83 19.8335 71 0.2156 86
72 392 trfold 92 -0.9041 68 -0.0098 82 19.1046 72 0.2077 88
73 217 CAO-QA1 92 -61.4662 81 -0.6681 105 17.6990 73 0.1924 90
74 376 E2E 92 -42.0501 78 -0.4571 100 17.1459 74 0.1864 91
75 055 Takeda-Shitaka-Lab 36 -103.0079 92 0.2498 63 14.3631 75 0.3990 64
76 003 SHORTLE 40 -95.9072 86 0.2023 71 14.3142 76 0.3579 72
77 066 LamoureuxLab 28 -119.5506 103 0.3018 57 13.8758 77 0.4956 44
78 323 DellaCorteLab 92 -25.6276 73 -0.2786 94 13.7254 78 0.1492 95
79 192 AILON 92 -21.6079 71 -0.2349 89 13.6624 79 0.1485 96
80 298 Huang 34 -114.2383 93 0.0518 79 13.5614 80 0.3989 65
81 341 Risoluto 92 -25.4820 72 -0.2770 93 13.1758 81 0.1432 97
82 029 Venclovas 33 -116.6064 98 0.0422 81 11.7335 82 0.3556 73
83 336 Bates_BMM 66 -97.7002 88 -0.6924 106 10.9318 83 0.1656 94
84 278 BAKER-ROBETTA 83 -57.0409 80 -0.4704 101 10.7738 84 0.1298 99
85 448 BaiduUSA 82 -41.1104 77 -0.2574 91 9.9483 85 0.1213 100
86 453 DMP2 54 -90.7236 84 -0.2727 92 9.2277 86 0.1709 93
87 279 PierceLab 17 -142.7883 117 0.4242 40 8.4125 87 0.4949 45
88 221 Kozakov-Vajda 17 -149.1255 123 0.0514 80 8.2623 88 0.4860 47
89 099 Fernandez-Recio 18 -140.6830 113 0.4065 44 8.0200 89 0.4456 54
90 173 Vakser 36 -119.2834 101 -0.2023 88 7.7329 90 0.2148 87
91 050 IntFOLD6 92 -65.2831 82 -0.7096 108 7.5588 91 0.0822 109
92 352 laufer_ros 32 -127.6198 106 -0.2381 90 7.3329 92 0.2292 85
93 177 Zou 20 -141.0654 114 0.1467 76 7.2919 93 0.3646 71
94 097 AWSEM-Suite 91 -38.6415 76 -0.4027 97 7.1182 94 0.0782 110
95 451 Seok-assembly 36 -130.0745 109 -0.5021 102 6.6098 95 0.1836 92
96 476 ict-ams 62 -99.7884 89 -0.6417 104 6.6091 96 0.1066 103
97 364 Kiharalab_Z_Server 92 -35.1244 75 -0.3818 96 6.6068 97 0.0718 112
98 182 Zhang-Assembly 11 -155.8982 129 0.5547 19 6.1018 98 0.5547 30
99 483 HMSCasper-MSA 69 -96.4529 87 -0.7312 110 5.6911 99 0.0825 108
100 342 CUTSP 64 -90.9206 85 -0.5456 103 4.9412 100 0.0772 111
101 103 CAPRI-Shen 15 -154.4039 127 -0.0269 84 4.4348 101 0.2957 80
102 275 MULTICOM-AI 17 -148.8869 122 0.0655 78 4.3434 102 0.2555 84
103 014 xianmingpan 86 -118.1516 99 -1.2343 123 4.1748 103 0.0485 118
104 131 PerezLab_Gators 57 -142.3927 116 -1.2700 127 3.8670 104 0.0678 113
105 250 ferrari 30 -132.5109 110 -0.2837 95 3.5953 105 0.1198 101
106 477 CoDock 18 -150.7136 124 -0.1508 87 3.5428 106 0.1968 89
107 081 MUFOLD 90 -102.3107 90 -1.0923 118 3.4725 107 0.0386 120
108 132 PBuild 60 -128.9315 108 -1.0822 117 3.4010 108 0.0567 116
109 096 UNRES-contact 92 -69.2093 83 -0.7523 111 3.3956 109 0.0369 121
110 052 GAPF_LNCC_SERVER 84 -118.5851 100 -1.2213 122 3.0428 110 0.0362 122
111 211 MESHI_server 34 -139.6638 112 -0.6960 107 2.9608 111 0.0871 106
112 285 Kiharalab_Assembly 20 -153.0343 126 -0.4517 99 2.8481 112 0.1424 98
113 349 Spider 87 -114.8691 95 -1.2054 121 2.6662 113 0.0306 123
114 437 MUFOLD2 92 -114.4011 94 -1.2435 124 2.5142 114 0.0273 125
115 063 ACOMPMOD 92 -143.0870 119 -1.5553 137 2.3911 115 0.0260 126
116 467 ricardo 22 -165.0173 131 -1.1371 120 2.1961 116 0.0998 105
117 360 UNRES 92 -116.3687 97 -1.2649 126 2.0878 117 0.0227 128
118 259 AWSEM-CHEN 90 -102.4286 91 -1.0937 119 2.0498 118 0.0228 127
119 033 ishidalab 40 -146.6285 120 -1.0657 116 2.0406 119 0.0510 117
120 387 edmc_pf 17 -162.2886 130 -0.7229 109 1.9867 120 0.1169 102
121 354 FALCON 5 -172.3408 136 0.3318 56 1.9437 121 0.3887 68
122 340 Pharmulator 92 -120.3052 105 -1.3077 130 1.7996 122 0.0196 129
123 373 HMSCasper-Seq 90 -128.8764 107 -1.3875 132 1.7444 123 0.0194 130
124 155 CLUSPRO 15 -167.5098 134 -0.9007 112 1.2837 124 0.0856 107
125 491 Seok-naive_assembly 25 -167.3220 132 -1.3329 131 0.9899 125 0.0396 119
126 191 htjcadd 9 -175.4421 139 -1.0491 115 0.9157 126 0.1017 104
127 138 LAW 92 -119.7559 104 -1.3017 129 0.8336 127 0.0091 131
128 080 FOLDYNE 1 -181.2721 144 0.7279 6 0.7279 128 0.7279 6
129 369 DELCLAB 92 -142.9543 118 -1.5539 136 0.7148 129 0.0078 132
130 195 ShanghaiTech 21 -176.2628 140 -1.6316 140 0.6208 130 0.0296 124
131 151 RBO-PSP-CP 91 -138.3967 111 -1.4989 134 0.5070 131 0.0056 133
132 027 SSThread 7 -172.8904 137 -0.4129 98 0.4032 132 0.0576 115
133 458 HMSCasper-PSSM 91 -147.0200 121 -1.5936 138 0.3878 133 0.0043 134
134 317 MASS 92 -119.4362 102 -1.2982 128 0.3850 134 0.0042 135
135 378 Zhanglab_SLU 5 -178.7803 142 -0.9561 114 0.3002 135 0.0600 114
136 170 BhageerathH-Plus 92 -151.1105 125 -1.6425 141 0.2420 136 0.0026 136
137 305 CAO-SERVER 92 -154.8392 128 -1.6830 143 0.1516 137 0.0016 138
138 196 bioinsilico_sbi 45 -175.1681 138 -1.8037 145 0.1002 138 0.0022 137
139 060 m3g 6 -177.5659 141 -0.9277 113 0.0000 139 0.0000 139
140 301 Gonglab-THU 92 -115.4307 96 -1.2547 125 0.0000 139 0.0000 139
141 004 GAPF_LNCC 9 -179.4543 143 -1.4949 133 0.0000 139 0.0000 139
142 169 3D-JIGSAW-SwarmLoop 92 -142.3178 115 -1.5469 135 0.0000 139 0.0000 139
143 054 SFGroup 1 -183.5959 145 -1.5959 139 0.0000 139 0.0000 139
144 242 trioFold 47 -168.1907 135 -1.6636 142 0.0000 139 0.0000 139
145 107 FoldEM 65 -167.3723 133 -1.7442 144 0.0000 139 0.0000 139
146 412 YBA 2 -183.7117 146 -1.8558 146 0.0000 139 0.0000 139
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2020, University of California, Davis