14th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
Menu
TS Analysis : Group performance based on combined z-scores
Results Home
Table Browser
Estimate of Model Accuracy Results
RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
GDT_TS based
Assessors' formula
Models:
Analysis on the models designated as "1"
Analysis on the models with the best scores
Groups:
All groups on 'all groups' targets
Server groups on 'all groups' + 'server only' targets
Targets:
The ranking of the groups is performed on the basis of analysis of combined zscores according to the following formula used by the assessors:
for
TBM
domains (
GDT_HA
+ (
SG
+
lDDT
+
CAD
)/3 +
ASE
)
for
TBM + TBM/FM
domains (
GDT_HA
+ (
SG
+
lDDT
+
CAD
)/3 +
ASE
)
for
FM + TBM/FM
domains (
GDT_TS
+
QCS
+ 0.1*
Molprobity
)
for
FM
domains (
GDT_TS
+
QCS
+ 0.1*
Molprobity
)
#
GR
code
GR
name
Domains Count
SUM Zscore
(>-2.0)
Rank SUM Zscore
(>-2.0)
AVG Zscore
(>-2.0)
Rank AVG Zscore
(>-2.0)
SUM Zscore
(>0.0)
Rank SUM Zscore
(>0.0)
AVG Zscore
(>0.0)
Rank AVG Zscore
(>0.0)
1
427
AlphaFold2
23
72.7423
1
3.1627
1
73.1263
1
3.1794
1
2
403
BAKER-experimental
23
29.3544
2
1.2763
3
30.1617
2
1.3114
3
3
473
BAKER
23
28.5485
3
1.2412
4
29.5853
3
1.2863
4
4
480
FEIG-R2
23
23.8974
4
1.0390
5
24.3727
4
1.0597
5
5
042
QUARK
23
21.8233
5
0.9488
6
22.4019
5
0.9740
6
6
324
Zhang-Server
23
21.3322
6
0.9275
7
21.8136
6
0.9484
8
7
129
Zhang
23
20.2609
7
0.8809
10
20.7864
7
0.9038
10
8
024
DeepPotential
23
18.2855
8
0.7950
11
19.0069
9
0.8264
12
9
031
Zhang-CEthreader
23
17.1828
9
0.7471
12
20.1211
8
0.8748
11
10
009
tFold_human
23
16.8172
10
0.7312
13
18.0037
10
0.7828
13
11
226
Zhang-TBM
23
16.1050
11
0.7002
14
17.1815
11
0.7470
14
12
488
tFold-IDT_human
23
14.3833
12
0.6254
15
15.7990
13
0.6869
16
13
067
ProQ2
23
13.0303
13
0.5665
20
13.9889
15
0.6082
21
14
435
Zhang_Ab_Initio
23
12.8138
14
0.5571
21
15.8620
12
0.6897
15
15
368
tFold-CaT_human
23
12.6847
15
0.5515
22
13.7262
17
0.5968
23
16
362
Seok-refine
23
12.6208
16
0.5487
23
13.9279
16
0.6056
22
17
039
ropius0QA
23
12.5290
17
0.5447
24
14.3421
14
0.6236
19
18
498
VoroMQA-select
23
12.2854
18
0.5341
25
13.3205
18
0.5792
24
19
420
MULTICOM
23
11.1945
19
0.4867
26
12.5921
20
0.5475
27
20
200
Bilbul2020
23
11.1900
20
0.4865
27
12.9003
19
0.5609
26
21
216
EMAP_CHAE
23
10.3662
21
0.4507
28
12.1451
24
0.5280
31
22
409
UOSHAN
23
10.1776
22
0.4425
29
12.1778
22
0.5295
29
23
125
PreferredFold
23
9.5509
23
0.4153
30
11.4404
28
0.4974
35
24
220
McGuffin
23
9.4267
24
0.4099
31
11.2741
30
0.4902
37
25
288
DATE
23
9.3873
25
0.4081
32
12.3253
21
0.5359
28
26
253
Bhattacharya
23
9.3134
26
0.4049
33
10.6397
32
0.4626
39
27
005
Seder2020
23
9.0849
27
0.3950
34
11.9056
25
0.5176
32
28
026
NOVA
23
8.8195
28
0.3835
35
10.5602
33
0.4591
40
29
183
tFold-CaT
23
8.5461
29
0.3716
36
10.4147
35
0.4528
42
30
379
Wallner
23
8.4798
30
0.3687
37
11.3922
29
0.4953
36
31
062
SBROD-select
23
8.3905
31
0.3648
38
10.2751
38
0.4467
45
32
351
tFold-IDT
23
8.3427
32
0.3627
39
9.8608
40
0.4287
47
33
238
tFold
23
8.2796
33
0.3600
41
10.4146
36
0.4528
43
34
018
UNRES-template
23
7.9694
34
0.3465
42
11.5031
26
0.5001
33
35
254
ropius0
23
7.6960
35
0.3346
43
11.4759
27
0.4990
34
36
032
MESHI
23
7.4413
36
0.3235
44
10.3155
37
0.4485
44
37
376
E2E
23
7.3710
37
0.3205
45
12.1496
23
0.5282
30
38
015
AP_1
23
7.1150
38
0.3093
46
10.8171
31
0.4703
38
39
343
VoroCNN-select
23
6.2382
39
0.2712
50
8.0626
52
0.3505
62
40
257
P3De
23
6.1392
40
0.2669
51
10.5355
34
0.4581
41
41
428
Seder2020hard
23
6.1307
41
0.2666
52
9.8274
41
0.4273
48
42
140
Yang-Server
23
5.7330
42
0.2493
53
8.4599
48
0.3678
56
43
339
ProQ3D
23
5.4581
43
0.2373
54
8.3473
49
0.3629
57
44
375
Ornate-select
23
5.4177
44
0.2356
55
8.5792
46
0.3730
54
45
377
Yang_FM
23
4.9489
45
0.2152
56
8.0362
53
0.3494
63
46
187
MULTICOM-HYBRID
23
4.6836
46
0.2036
57
8.8296
45
0.3839
53
47
319
MULTICOM-DIST
23
4.2810
47
0.1861
59
8.1260
51
0.3533
61
48
252
MULTICOM-DEEP
23
4.1085
48
0.1786
60
8.5289
47
0.3708
55
49
209
BAKER-ROSETTASERVER
23
4.0881
49
0.1777
61
9.5547
42
0.4154
50
50
304
Jones-UCL
22
4.0081
50
0.2731
49
9.3125
44
0.4233
49
51
222
TOWER
23
3.7481
51
0.1630
62
7.8873
55
0.3429
65
52
367
FoldX
23
3.6500
52
0.1587
63
6.9916
60
0.3040
72
53
334
FEIG-R3
23
3.5081
53
0.1525
64
9.4779
43
0.4121
51
54
326
FALCON-DeepFolder
23
3.4822
54
0.1514
65
7.0297
57
0.3056
70
55
314
FEIG-R1
23
3.1519
55
0.1370
66
6.9934
59
0.3041
71
56
061
191227
23
3.0057
56
0.1307
67
8.2744
50
0.3598
59
57
198
MULTICOM-CONSTRUCT
23
2.9213
57
0.1270
68
7.9385
54
0.3452
64
58
328
FoldXpro
23
2.8731
58
0.1249
69
6.8206
62
0.2965
75
59
293
MUFOLD_H
23
2.6658
59
0.1159
71
10.0726
39
0.4379
46
60
460
Yang_TBM
23
2.5371
60
0.1103
73
6.9186
61
0.3008
73
61
487
RaptorX
23
1.8550
61
0.0807
74
5.4021
67
0.2349
83
62
075
MULTICOM-CLUSTER
23
1.6349
62
0.0711
75
7.4681
56
0.3247
68
63
337
CATHER
23
-0.3489
63
-0.0152
77
5.6027
64
0.2436
80
64
101
Destini
23
-0.4637
64
-0.0202
78
6.4624
63
0.2810
76
65
392
trfold
23
-0.5689
65
-0.0247
79
4.3378
73
0.1886
89
66
335
FEIG
23
-0.7647
66
-0.0332
80
5.5821
65
0.2427
81
67
468
FALCON-geom
21
-1.5979
67
0.1144
72
7.0109
58
0.3339
66
68
071
Kiharalab
23
-2.2281
68
-0.0969
81
4.6095
71
0.2004
88
69
013
FEIG-S
23
-3.0349
69
-0.1320
83
4.0602
74
0.1765
91
70
096
UNRES-contact
23
-4.9485
70
-0.2152
86
2.3639
82
0.1028
99
71
193
Seok
23
-5.1814
71
-0.2253
88
5.4399
66
0.2365
82
72
192
AILON
23
-5.2572
72
-0.2286
89
3.4483
77
0.1499
94
73
364
Kiharalab_Z_Server
23
-5.6855
73
-0.2472
91
2.2671
83
0.0986
101
74
323
DellaCorteLab
23
-6.0477
74
-0.2629
93
2.1995
84
0.0956
102
75
070
Seok-server
23
-6.8112
75
-0.2961
94
5.1340
69
0.2232
85
76
448
BaiduUSA
21
-8.5227
76
-0.2154
87
2.7548
80
0.1312
96
77
217
CAO-QA1
23
-10.0172
77
-0.4355
101
4.9284
70
0.2143
86
78
453
DMP2
21
-10.3690
78
-0.3033
95
2.9404
79
0.1400
95
79
341
Risoluto
23
-11.0200
79
-0.4791
102
1.7558
88
0.0763
104
80
277
FALCON-TBM
20
-11.1657
80
-0.2583
92
4.5605
72
0.2280
84
81
360
UNRES
23
-11.4905
81
-0.4996
104
1.7410
89
0.0757
105
82
003
SHORTLE
15
-12.9688
82
0.2021
58
5.3899
68
0.3593
60
83
097
AWSEM-Suite
23
-13.2462
83
-0.5759
106
0.8412
101
0.0366
112
84
342
CUTSP
19
-14.2018
84
-0.3264
96
1.9729
87
0.1038
98
85
278
BAKER-ROBETTA
23
-18.4947
85
-0.8041
108
2.1725
85
0.0945
103
86
301
Gonglab-THU
23
-18.5514
86
-0.8066
109
0.4183
110
0.0182
121
87
138
LAW
23
-19.1564
87
-0.8329
110
0.0159
133
0.0007
133
88
050
IntFOLD6
23
-19.4344
88
-0.8450
112
1.2001
96
0.0522
109
89
317
MASS
23
-19.6154
89
-0.8528
113
0.1546
123
0.0067
129
90
014
xianmingpan
23
-22.2709
90
-0.9683
116
3.8555
75
0.1676
92
91
352
laufer_ros
11
-22.7174
91
0.1166
70
3.5629
76
0.3239
69
92
259
AWSEM-CHEN
23
-23.2146
92
-1.0093
117
0.0780
126
0.0034
130
93
250
ferrari
12
-23.4609
93
-0.1217
82
1.9848
86
0.1654
93
94
349
Spider
21
-23.7197
94
-0.9390
115
0.9862
98
0.0470
111
95
472
Elofsson
13
-25.2685
95
-0.4053
100
2.7063
81
0.2082
87
96
373
HMSCasper-Seq
23
-25.3092
96
-1.1004
118
0.3978
113
0.0173
123
97
131
PerezLab_Gators
14
-26.8148
97
-0.6296
107
3.4406
78
0.2458
79
98
336
Bates_BMM
17
-27.4358
98
-0.9080
114
1.2764
94
0.0751
106
99
483
HMSCasper-MSA
12
-28.2019
99
-0.5168
105
1.2907
93
0.1076
97
100
151
RBO-PSP-CP
23
-28.6746
100
-1.2467
122
0.1667
122
0.0072
128
101
052
GAPF_LNCC_SERVER
20
-29.0624
101
-1.1531
119
0.0000
134
0.0000
134
102
340
Pharmulator
23
-29.2173
102
-1.2703
123
0.8141
102
0.0354
113
103
169
3D-JIGSAW-SwarmLoop
23
-29.2641
103
-1.2724
124
0.6340
106
0.0276
117
104
170
BhageerathH-Plus
23
-29.4672
104
-1.2812
126
0.3217
117
0.0140
125
105
458
HMSCasper-PSSM
23
-30.3497
105
-1.3196
127
0.0389
130
0.0017
131
106
305
CAO-SERVER
23
-31.1053
106
-1.3524
130
0.2491
120
0.0108
126
107
437
MUFOLD2
23
-31.6307
107
-1.3752
133
0.6422
105
0.0279
116
108
081
MUFOLD
22
-31.6650
108
-1.3484
129
0.0000
134
0.0000
134
109
369
DELCLAB
23
-31.8924
109
-1.3866
134
0.0349
131
0.0015
132
110
476
ict-ams
17
-32.3622
110
-1.1978
120
0.3799
115
0.0223
119
111
242
trioFold
16
-33.8755
111
-1.2422
121
0.2298
121
0.0144
124
112
063
ACOMPMOD
23
-34.4440
112
-1.4976
136
0.4130
111
0.0180
122
113
387
edmc_pf
6
-36.3654
113
-0.3942
99
0.3804
114
0.0634
107
114
107
FoldEM
16
-36.6027
114
-1.4127
135
0.3225
116
0.0202
120
115
298
Huang
4
-37.9869
115
0.0033
76
1.3217
92
0.3304
67
116
055
Takeda-Shitaka-Lab
4
-38.6480
116
-0.1620
84
1.0270
97
0.2567
78
117
451
Seok-assembly
4
-38.7375
117
-0.1844
85
1.5490
90
0.3873
52
118
132
PBuild
10
-38.7532
118
-1.2753
125
0.0000
134
0.0000
134
119
029
Venclovas
4
-39.5720
119
-0.3930
98
0.7460
103
0.1865
90
120
173
Vakser
4
-39.9509
120
-0.4877
103
0.4086
112
0.1021
100
121
060
m3g
3
-40.7190
121
-0.2397
90
0.0989
125
0.0330
115
122
354
FALCON
2
-40.8326
122
0.5837
18
1.2185
95
0.6092
20
123
027
SSThread
3
-41.1139
123
-0.3713
97
0.1021
124
0.0340
114
124
066
LamoureuxLab
2
-41.2798
124
0.3601
40
0.7202
104
0.3601
58
125
033
ishidalab
7
-41.5452
125
-1.3636
132
0.0000
134
0.0000
134
126
221
Kozakov-Vajda
1
-42.6856
126
1.3144
2
1.3788
91
1.3788
2
127
279
PierceLab
1
-43.0863
127
0.9137
8
0.9137
100
0.9137
9
128
467
ricardo
1
-43.1139
128
0.8861
9
0.9685
99
0.9685
7
129
196
bioinsilico_sbi
6
-43.2141
129
-1.5357
137
0.0477
128
0.0079
127
130
177
Zou
1
-43.3763
130
0.6237
16
0.6237
108
0.6237
18
131
275
MULTICOM-AI
1
-43.4080
131
0.5920
17
0.6244
107
0.6244
17
132
285
Kiharalab_Assembly
1
-43.4300
132
0.5700
19
0.5726
109
0.5726
25
133
004
GAPF_LNCC
2
-43.6760
133
-0.8380
111
0.0000
134
0.0000
134
134
182
Zhang-Assembly
1
-43.7024
134
0.2976
47
0.2976
118
0.2976
74
135
099
Fernandez-Recio
1
-43.7233
135
0.2767
48
0.2767
119
0.2767
77
136
211
MESHI_server
3
-43.9978
136
-1.3326
128
0.0000
134
0.0000
134
137
491
Seok-naive_assembly
3
-45.1900
137
-1.7300
140
0.0000
134
0.0000
134
138
195
ShanghaiTech
1
-45.3570
138
-1.3570
131
0.0590
127
0.0590
108
139
477
CoDock
1
-45.6024
139
-1.6024
138
0.0250
132
0.0250
118
140
103
CAPRI-Shen
1
-45.6073
140
-1.6073
139
0.0476
129
0.0476
110
Protein Structure Prediction Center
Sponsored by the
US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2020, University of California, Davis