14th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
Menu
Interdomain Predictions Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate zscores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate zscores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
Targets:
  • easy
  • medium
  • hard
  • X-ray
  • NMR
  • CryoEM
The final ranking was based on the models designated "1" according to the formula: Z-score(F1) + Z-score(Jaccard score) + Z-score(QS_best).
    #     GR
    name		     GR
    code		     Targets Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 AlphaFold2 427 10 33.3062 1 3.5306 1 35.3062 1 3.5306 1
2 BAKER-experimental 403 11 14.3640 2 1.3058 3 15.7170 2 1.4288 3
3 MULTICOM 420 10 6.6589 3 0.8659 5 8.9860 3 0.8986 5
4 BAKER 473 10 5.5888 5 0.7589 7 8.7590 4 0.8759 6
5 ProQ3D 339 10 6.0021 4 0.8002 6 8.5411 5 0.8541 7
6 FEIG-R3 334 10 4.5714 14 0.6571 15 8.1780 6 0.8178 8
7 BAKER-ROSETTASERVER 209 10 5.0208 8 0.7021 10 7.8402 7 0.7840 9
8 EMAP_CHAE 216 10 5.3828 6 0.7383 8 7.8057 8 0.7806 10
9 VoroCNN-select 343 11 4.5118 15 0.4102 40 7.5861 9 0.6896 16
10 tFold-CaT_human 368 10 4.9217 11 0.6922 12 7.5320 10 0.7532 11
11 UOSHAN 409 10 4.0330 18 0.6033 19 7.2491 11 0.7249 12
12 Ornate-select 375 11 5.2280 7 0.4753 32 7.1811 12 0.6528 18
13 Bhattacharya 253 10 4.7168 12 0.6717 13 7.1549 13 0.7155 14
14 ProQ2 067 10 4.9810 9 0.6981 11 7.1470 14 0.7147 15
15 FEIG-R1 314 10 4.6217 13 0.6622 14 6.8338 15 0.6834 17
16 NOVA 026 10 4.3867 16 0.6387 16 6.3867 16 0.6387 19
17 Bilbul2020 200 10 3.9685 20 0.5969 21 6.3768 17 0.6377 20
18 RaptorX 487 10 4.0337 17 0.6034 18 6.3226 18 0.6323 21
19 DATE 288 10 3.4626 22 0.5463 23 6.3098 19 0.6310 22
20 VoroMQA-select 498 10 2.8959 27 0.4896 28 6.1055 20 0.6106 24
21 McGuffin 220 10 3.9923 19 0.5992 20 6.0525 21 0.6052 25
22 SBROD-select 062 11 4.9613 10 0.4510 36 6.0038 22 0.5458 36
23 tFold_human 009 10 3.3758 24 0.5376 25 5.9840 23 0.5984 26
24 DeepPotential 024 10 3.3887 23 0.5389 24 5.9364 24 0.5936 27
25 MUFOLD_H 293 10 3.6501 21 0.5650 22 5.9156 25 0.5916 28
26 ropius0QA 039 10 2.6934 31 0.4693 33 5.7912 26 0.5791 29
27 tFold-IDT_human 488 10 2.4473 33 0.4447 37 5.7811 27 0.5781 30
28 FEIG 335 10 2.2350 34 0.4235 38 5.7803 28 0.5780 31
29 Yang_TBM 460 10 2.8630 28 0.4863 29 5.6513 29 0.5651 32
30 tFold 238 10 2.6852 32 0.4685 34 5.6190 30 0.5619 33
31 MESHI 032 10 2.1204 35 0.4120 39 5.6149 31 0.5615 34
32 191227 061 10 3.2508 26 0.5251 27 5.5996 32 0.5600 35
33 tFold-CaT 183 10 1.7367 39 0.3737 44 5.4314 33 0.5431 37
34 Yang-Server 140 10 3.2977 25 0.5298 26 5.4168 34 0.5417 38
35 CATHER 337 10 2.7920 30 0.4792 31 5.3518 35 0.5352 39
36 Zhang 129 10 1.8801 37 0.3880 41 5.1758 36 0.5176 40
37 Wallner 379 10 1.1896 42 0.3190 46 5.1257 37 0.5126 41
38 Yang_FM 377 10 2.8029 29 0.4803 30 5.0546 38 0.5055 43
39 ropius0 254 10 0.8442 43 0.2844 48 4.7823 39 0.4782 47
40 AP_1 015 10 1.2265 41 0.3227 45 4.7230 40 0.4723 48
41 Jones-UCL 304 10 0.3615 48 0.2362 54 4.6801 41 0.4680 49
42 Seder2020 005 10 -1.8514 60 0.0149 76 4.4174 42 0.4417 51
43 Seok-server 070 9 -2.1238 62 0.2085 58 4.3515 43 0.4835 45
44 tFold-IDT 351 10 -0.1126 50 0.1887 59 4.3303 44 0.4330 53
45 Seok 193 11 1.6652 40 0.1514 65 4.3231 45 0.3930 60
46 FoldXpro 328 10 -0.3340 53 0.1666 63 4.2882 46 0.4288 54
47 FoldX 367 10 0.4216 46 0.2422 52 4.0823 47 0.4082 57
48 FEIG-R2 480 10 -0.8146 55 0.1185 68 4.0565 48 0.4057 58
49 Zhang-CEthreader 031 10 0.4009 47 0.2401 53 3.8922 49 0.3892 61
50 AILON 192 10 0.5262 45 0.2526 51 3.8868 50 0.3887 62
51 UNRES-template 018 11 1.7699 38 0.1609 64 3.8805 51 0.3528 66
52 P3De 257 10 -0.7658 54 0.1234 67 3.8467 52 0.3847 63
53 FALCON-geom 468 9 -3.2024 67 0.0886 70 3.8225 53 0.4247 56
54 Seok-refine 362 10 0.5573 44 0.2557 50 3.6817 54 0.3682 65
55 Zhang-Server 324 9 -2.7348 64 0.1406 66 3.6233 55 0.4026 59
56 Elofsson 472 7 -5.7863 76 0.3162 47 3.5061 56 0.5009 44
57 Destini 101 10 -1.1320 56 0.0868 71 3.4957 57 0.3496 67
58 E2E 376 11 -1.4162 57 -0.1287 83 3.4484 58 0.3135 75
59 Zhang_Ab_Initio 435 10 -0.2025 51 0.1798 61 3.4217 59 0.3422 70
60 PreferredFold 125 11 2.0074 36 0.1825 60 3.2729 60 0.2975 77
61 TOWER 222 10 0.1541 49 0.2154 55 3.2571 61 0.3257 71
62 Zhang-TBM 226 10 -0.3210 52 0.1679 62 3.2510 62 0.3251 72
63 FALCON-DeepFolder 326 10 -1.8141 59 0.0186 75 3.1741 63 0.3174 73
64 Seder2020hard 428 9 -3.6309 69 0.0410 73 3.1419 64 0.3491 68
65 FALCON-TBM 277 9 -4.3311 72 -0.0368 78 3.1265 65 0.3474 69
66 MULTICOM-HYBRID 187 9 -4.8647 75 -0.0961 81 2.8506 66 0.3167 74
67 FEIG-S 013 10 -2.0412 61 -0.0041 77 2.8007 67 0.2801 78
68 trfold 392 10 -1.5546 58 0.0445 72 2.5526 68 0.2553 80
69 MULTICOM-DEEP 252 9 -4.3356 73 -0.0373 79 2.4091 69 0.2677 79
70 QUARK 042 10 -2.9039 66 -0.0904 80 2.0731 70 0.2073 84
71 MULTICOM-DIST 319 10 -3.2267 68 -0.1227 82 2.0627 71 0.2063 85
72 AWSEM-Suite 097 10 -4.7083 74 -0.2708 91 1.9617 72 0.1962 86
73 Risoluto 341 11 -2.3636 63 -0.2149 87 1.9082 73 0.1735 89
74 Kiharalab 071 11 -2.8249 65 -0.2568 90 1.8749 74 0.1704 90
75 MULTICOM-CLUSTER 075 10 -3.8551 70 -0.1855 85 1.5291 75 0.1529 91
76 BaiduUSA 448 8 -9.0884 82 -0.3860 96 1.4686 76 0.1836 87
77 Vakser 173 3 -15.6767 110 0.1078 69 1.4407 77 0.4802 46
78 Fernandez-Recio 099 1 -18.5616 120 1.4384 2 1.4384 78 1.4384 2
79 Kiharalab_Z_Server 364 10 -6.9461 78 -0.4946 97 1.4067 79 0.1407 93
80 DellaCorteLab 323 11 -4.1550 71 -0.3777 95 1.2864 80 0.1169 95
81 CUTSP 342 6 -11.2278 88 -0.2046 86 1.2642 81 0.2107 83
82 MULTICOM-CONSTRUCT 198 9 -6.5957 77 -0.2884 92 1.2553 82 0.1395 94
83 SHORTLE 003 2 -16.7593 113 0.6204 17 1.2527 83 0.6263 23
84 Seok-assembly 451 4 -14.5817 105 -0.1454 84 1.2262 84 0.3066 76
85 DMP2 453 6 -11.4312 89 -0.2385 89 1.0791 85 0.1799 88
86 Zou 177 1 -18.9274 121 1.0726 4 1.0726 86 1.0726 4
87 edmc_pf 387 2 -17.0724 115 0.4638 35 1.0235 87 0.5118 42
88 UNRES-contact 096 10 -7.8918 80 -0.5892 101 0.9949 88 0.0995 96
89 LamoureuxLab 066 2 -17.4835 116 0.2582 49 0.8964 89 0.4482 50
90 ferrari 250 2 -17.5695 117 0.2153 56 0.8496 90 0.4248 55
91 Gonglab-THU 301 10 -7.8703 79 -0.5870 100 0.7303 91 0.0730 98
92 Kozakov-Vajda 221 1 -19.2841 122 0.7159 9 0.7159 92 0.7159 13
93 Venclovas 029 3 -15.9432 111 0.0189 74 0.6721 93 0.2240 82
94 HMSCasper-MSA 483 8 -10.5750 84 -0.5719 99 0.6064 94 0.0758 97
95 Takeda-Shitaka-Lab 055 4 -14.8644 107 -0.2161 88 0.5965 95 0.1491 92
96 UNRES 360 11 -10.7957 87 -0.9814 117 0.5747 96 0.0522 103
97 Spider 349 10 -11.7335 90 -0.9734 116 0.5426 97 0.0543 102
98 xianmingpan 014 9 -12.0429 92 -0.8937 112 0.5113 98 0.0568 101
99 IntFOLD6 050 10 -8.7186 81 -0.6719 102 0.4757 99 0.0476 104
100 CoDock 477 1 -19.6135 125 0.3865 42 0.4348 100 0.4348 52
101 Zhang-Assembly 182 1 -19.6161 126 0.3839 43 0.3839 101 0.3839 64
102 LAW 138 10 -10.6783 86 -0.8678 110 0.3808 102 0.0381 106
103 MASS 317 9 -12.4913 94 -0.9435 115 0.3189 103 0.0354 108
104 HMSCasper-Seq 373 10 -11.8696 91 -0.9870 118 0.2720 104 0.0272 111
105 ACOMPMOD 063 9 -13.8830 100 -1.0981 121 0.2681 105 0.0298 109
106 ict-ams 476 8 -12.1954 93 -0.7744 106 0.2290 106 0.0286 110
107 BAKER-ROBETTA 278 10 -9.5029 83 -0.7503 105 0.2290 106 0.0229 112
108 PierceLab 279 1 -19.7896 127 0.2104 57 0.2247 108 0.2247 81
109 Bates_BMM 336 6 -15.5076 109 -0.9179 114 0.2247 109 0.0374 107
110 Seok-naive_assembly 491 3 -18.5109 119 -0.8370 107 0.2061 110 0.0687 99
111 ishidalab 033 5 -16.5317 112 -0.9063 113 0.2061 110 0.0412 105
112 Huang 298 3 -16.8749 114 -0.2916 93 0.1784 112 0.0595 100
113 MUFOLD 081 10 -10.6047 85 -0.8605 109 0.1731 113 0.0173 115
114 AWSEM-CHEN 259 10 -13.2150 96 -1.1215 122 0.1560 114 0.0156 116
115 PBuild 132 6 -15.1036 108 -0.8506 108 0.1313 115 0.0219 113
116 MUFOLD2 437 10 -12.7647 95 -1.0765 120 0.1133 116 0.0113 117
117 RBO-PSP-CP 151 10 -14.1938 102 -1.2194 126 0.0836 117 0.0084 118
118 MULTICOM-AI 275 1 -20.3743 130 -0.3743 94 0.0203 118 0.0203 114
119 laufer_ros 352 1 -20.5669 131 -0.5669 98 0.0000 119 0.0000 119
120 MESHI_server 211 2 -19.3799 123 -0.6900 103 0.0000 119 0.0000 119
121 CLUSPRO 155 1 -20.7216 132 -0.7216 104 0.0000 119 0.0000 119
122 Kiharalab_Assembly 285 1 -20.8698 133 -0.8698 111 0.0000 119 0.0000 119
123 3D-JIGSAW-SwarmLoop 169 9 -13.2825 97 -1.0314 119 0.0000 119 0.0000 119
124 BhageerathH-Plus 170 10 -13.4537 98 -1.1454 123 0.0000 119 0.0000 119
125 GAPF_LNCC_SERVER 052 9 -14.4309 104 -1.1590 124 0.0000 119 0.0000 119
126 HMSCasper-PSSM 458 10 -14.1433 101 -1.2143 125 0.0000 119 0.0000 119
127 Pharmulator 340 10 -14.2158 103 -1.2216 127 0.0000 119 0.0000 119
128 DELCLAB 369 11 -13.5325 99 -1.2302 128 0.0000 119 0.0000 119
129 ricardo 467 1 -21.2572 135 -1.2572 129 0.0000 119 0.0000 119
130 CAO-SERVER 305 10 -14.7258 106 -1.2726 130 0.0000 119 0.0000 119
131 trioFold 242 3 -19.8667 128 -1.2889 131 0.0000 119 0.0000 119
132 FoldEM 107 6 -17.9193 118 -1.3199 132 0.0000 119 0.0000 119
133 ShanghaiTech 195 3 -20.0086 129 -1.3362 133 0.0000 119 0.0000 119
134 PerezLab_Gators 131 2 -21.0300 134 -1.5150 134 0.0000 119 0.0000 119
135 GAPF_LNCC 004 1 -21.5333 136 -1.5333 135 0.0000 119 0.0000 119
136 bioinsilico_sbi 196 6 -19.3806 124 -1.5634 136 0.0000 119 0.0000 119
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2020, University of California, Davis