13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
`
TS Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores
  • Groups:
    • All groups on 'all groups' targets
    • Server groups on 'all groups' + 'server only' targets
  • Targets:
      The ranking of the groups is based on the analysis of zscores for GDT_TS.
    • TBM-easy
    • TBM-hard
    • TBM/FM
    • FM
    • FM_sp (Combination of EUs: T0953s2-D23, T0984, T1000, T1002)
    #     GR
    code
    GR
    name
    Domains Count     SUM Zscore
    (>-2.0)
    Rank SUM Zscore
    (>-2.0)
    AVG Zscore
    (>-2.0)
    Rank AVG Zscore
    (>-2.0)
    SUM Zscore
    (>0.0)
    Rank SUM Zscore
    (>0.0)
    AVG Zscore
    (>0.0)
    Rank AVG Zscore
    (>0.0)
1 043 A7D 104 120.4307 1 1.1580 1 128.0693 1 1.2314 1
2 322 Zhang 104 107.5948 2 1.0346 2 108.1948 2 1.0403 2
3 089 MULTICOM 104 99.4661 3 0.9564 3 99.9886 3 0.9614 3
4 145 QUARK 104 90.9915 4 0.8749 4 91.5625 4 0.8804 4
5 261 Zhang-Server 104 88.9540 5 0.8553 5 89.7597 5 0.8631 5
6 460 McGuffin 104 81.6353 6 0.7850 6 84.4019 6 0.8116 6
7 354 wfAll-Cheng 104 77.7039 7 0.7472 7 80.9951 7 0.7788 8
8 135 SBROD 102 71.5656 9 0.7408 8 78.9792 8 0.7743 9
9 324 RaptorX-DeepModeller 104 75.4891 8 0.7259 9 78.5878 9 0.7557 10
10 197 MESHI 104 70.9761 10 0.6825 11 76.6354 10 0.7369 11
11 274 MUFold 104 67.6859 13 0.6508 14 74.8175 11 0.7194 12
12 055 VoroMQA-select 104 68.1251 12 0.6550 13 74.1152 12 0.7126 13
13 222 Seok-refine 104 63.5532 15 0.6111 18 73.8150 13 0.7098 14
14 196 Grudinin 104 68.6515 11 0.6601 12 73.0821 14 0.7027 15
15 192 Elofsson 103 63.2400 16 0.6334 15 70.5126 15 0.6846 17
16 086 BAKER 102 58.4564 18 0.6123 17 70.1197 16 0.6874 16
17 418 Seder3nc 104 41.3330 28 0.3974 30 68.1145 17 0.6549 18
18 224 Destini 104 64.6331 14 0.6215 16 68.0121 18 0.6540 19
19 344 Kiharalab 104 61.5877 17 0.5922 19 66.1616 19 0.6362 21
20 208 KIAS-Gdansk 100 49.5927 22 0.5759 20 64.2864 20 0.6429 20
21 406 Seder3mm 104 49.6520 21 0.4774 23 63.7275 21 0.6128 22
22 071 Seder3full 104 33.5201 32 0.3223 37 62.7909 22 0.6038 23
23 117 Jones-UCL 104 53.8029 20 0.5173 22 62.3192 23 0.5992 25
24 221 RaptorX-TBM 104 55.1223 19 0.5300 21 62.2473 24 0.5985 26
25 044 ProQ2 103 45.1157 23 0.4574 24 61.8821 25 0.6008 24
26 366 Venclovas 74 -7.1946 47 0.7136 10 59.0580 26 0.7981 7
27 241 Bhageerath-Star 104 41.7269 27 0.4012 28 58.9014 27 0.5664 28
28 068 Seok 104 37.4878 30 0.3605 34 58.0870 28 0.5585 30
29 457 Wallner 103 44.1458 25 0.4480 25 57.5828 29 0.5591 29
30 390 Bhattacharya 104 45.0749 24 0.4334 26 56.7238 30 0.5454 31
31 309 Seder1 104 34.0518 31 0.3274 36 56.0000 31 0.5385 34
32 368 BAKER-ROSETTASERVER 103 39.1776 29 0.3998 29 55.7125 32 0.5409 33
33 426 AP_1 104 41.7657 26 0.4016 27 55.4932 33 0.5336 35
34 498 RaptorX-Contact 104 30.1406 34 0.2898 38 54.7082 34 0.5260 36
35 214 wfRosetta-ModF7 100 30.1534 33 0.3815 32 54.5354 35 0.5454 32
36 244 Seder3hard 104 -32.1971 55 -0.3096 63 43.0708 36 0.4141 39
37 281 SHORTLE 81 -14.8039 50 0.3851 31 42.4221 37 0.5237 37
38 156 Seok-server 104 9.1623 43 0.0881 48 42.0803 38 0.4046 40
39 163 Bates_BMM 82 -15.7656 51 0.3443 35 41.9079 39 0.5111 38
40 243 MULTICOM-CONSTRUCT 104 29.1028 35 0.2798 39 40.9359 40 0.3936 42
41 446 slbio 72 -37.8750 57 0.3628 33 40.8002 41 0.5667 27
42 279 ZHOU-SPOT 101 14.6736 40 0.2047 42 40.2107 42 0.3981 41
43 329 D-Haven 103 15.6189 39 0.1711 45 39.8413 43 0.3868 43
44 441 FALCON 104 11.8340 42 0.1138 47 39.5169 44 0.3800 45
45 377 wfRstta-Maghrabi-TQA 102 -3.3075 46 0.0068 52 39.2878 45 0.3852 44
46 058 MULTICOM_CLUSTER 104 25.8366 36 0.2484 40 38.1878 46 0.3672 46
47 023 MULTICOM-NOVEL 104 24.7793 37 0.2383 41 37.2177 47 0.3579 49
48 164 Yang-Server 101 12.9065 41 0.1872 43 36.9795 48 0.3661 47
49 149 Zhou-SPOT-3D 104 18.3074 38 0.1760 44 36.9652 49 0.3554 50
50 246 IntFOLD5 104 7.4185 45 0.0713 50 35.5401 50 0.3417 51
51 116 Zhang-CEthreader 104 8.8938 44 0.0855 49 33.9457 51 0.3264 52
52 335 wfRosetta-PQ2-AngQA 104 -17.6284 52 -0.1695 57 31.2134 52 0.3001 55
53 471 CPClab 103 -9.7849 49 -0.0756 54 28.5686 53 0.2774 57
54 266 slbio_server 91 -38.7075 58 -0.1396 56 27.7775 54 0.3052 54
55 160 CMA-align 100 -7.9443 48 0.0006 53 24.3400 55 0.2434 59
56 470 Seok-assembly 80 -71.2911 67 -0.2911 62 23.9412 56 0.2993 56
57 337 FALCON-TBM 104 -36.0458 56 -0.3466 64 20.4454 57 0.1966 62
58 112 AWSEM 101 -24.7237 54 -0.1854 58 19.8718 58 0.1968 61
59 124 AWSEM-Suite 103 -23.8014 53 -0.2117 60 17.2203 59 0.1672 67
60 402 RBO-Aleph 96 -50.1994 60 -0.3562 65 16.8927 60 0.1760 65
61 004 YASARA 93 -57.3989 61 -0.3806 66 16.4714 61 0.1771 64
62 347 MESHI-server 50 -100.3421 71 0.1532 46 15.3248 62 0.3065 53
63 488 Delta-Gelly-Server 102 -66.5664 65 -0.6134 74 14.7707 63 0.1448 68
64 431 Laufer 40 -131.5158 81 -0.0879 55 14.5665 64 0.3642 48
65 432 Seok-naive_assembly 52 -127.1572 79 -0.4453 69 12.5700 65 0.2417 60
66 110 Distill 104 -40.9965 59 -0.3942 67 11.8993 66 0.1144 74
67 397 PepBuilderJ 81 -91.6118 70 -0.5631 71 11.2458 67 0.1388 69
68 492 wf-BAKER-UNRES 97 -61.8975 64 -0.4938 70 11.2347 68 0.1158 73
69 047 chuo-u 93 -60.8332 62 -0.4176 68 11.1581 69 0.1200 72
70 085 BhageerathH-Plus 104 -61.2193 63 -0.5886 73 10.6151 70 0.1021 75
71 312 MUFold_server 104 -75.3131 68 -0.7242 76 10.4107 71 0.1001 76
72 358 Spider 98 -69.6586 66 -0.5884 72 7.5807 72 0.0774 77
73 288 UNRES 101 -104.6051 73 -0.9763 83 7.2156 73 0.0714 78
74 351 DL-Haven 100 -87.4296 69 -0.7943 77 6.6137 74 0.0661 79
75 472 DELClab 98 -111.9239 76 -1.0196 87 6.0828 75 0.0621 81
76 097 Laufer_abinitio 37 -163.4873 90 -0.7970 78 4.8624 76 0.1314 71
77 077 qmo 27 -161.6144 89 -0.2820 61 4.6793 77 0.1733 66
78 152 PconsC4 104 -105.8939 74 -1.0182 86 4.1623 78 0.0400 84
79 407 rawMSA 92 -114.5704 77 -0.9845 84 4.0089 79 0.0436 82
80 380 Laufer_100 18 -187.1914 94 -0.8440 80 3.3486 80 0.1860 63
81 092 Ricardo 11 -188.2031 95 -0.2003 59 3.0036 81 0.2731 58
82 041 FALCON-Contact 104 -130.8969 80 -1.2586 92 2.7246 82 0.0262 86
83 122 Forbidden 86 -107.6411 75 -0.8330 79 2.5975 83 0.0302 85
84 389 UpsideUChicago 18 -188.5491 96 -0.9194 81 2.3838 84 0.1324 70
85 157 GAPF_LNCC 51 -155.5700 87 -0.9720 82 2.0997 85 0.0412 83
86 365 3D-JIGSAW_SL1 104 -120.4425 78 -1.1581 89 1.4378 86 0.0138 89
87 497 GaussDCA 104 -133.2599 82 -1.2813 93 1.3904 87 0.0134 91
88 381 GONGLAB-THU 103 -104.5146 72 -0.9953 85 1.1955 88 0.0116 92
89 414 BCLMeilerLab 59 -155.9339 88 -1.1175 88 0.8319 89 0.0141 88
90 473 Maurice 12 -191.5611 98 -0.6301 75 0.7577 90 0.0631 80
91 378 Cao-server 104 -153.3308 86 -1.4743 97 0.4141 91 0.0040 93
92 401 InnoUNRES 29 -186.3184 93 -1.2524 91 0.3923 92 0.0135 90
93 282 PRAYOG 92 -133.5929 83 -1.1912 90 0.2997 93 0.0033 94
94 007 ACOMPMOD 104 -140.6796 84 -1.3527 94 0.2768 94 0.0027 96
95 257 NOCONTACT 100 -166.0129 91 -1.5801 98 0.2703 95 0.0027 95
96 250 Meilerlab 1 -205.9843 99 0.0157 51 0.0157 96 0.0157 87
97 348 HMSCasper-Refiner 104 -142.2495 85 -1.3678 95 0.0000 97 0.0000 97
98 458 FOLDNET 66 -169.7272 92 -1.4201 96 0.0000 97 0.0000 97
99 476 Sun_Tsinghua 51 -190.5818 97 -1.6585 99 0.0000 97 0.0000 97
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis