16th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
Menu
Multimer Predictions Analysis : Group performance based on combined z-scores
Results Home Table Browser
  • Analysis on the models designated as "1"
  • Analysis on the models with the best scores
Targets :
  • easy
  • medium
  • hard
  • X-ray
  • NMR
  • CryoEM
Groups:
  • CASP groups on all targets
  • CASP+CAPRI groups on CAPRI targets only

Assessors' formula: Z-score(ICS) + Z-score(IPS) + Z-score(QSbest) + Z-score(DockQ_wave) + Z-score(LDDT) + Z-score(TM)

* y-axis is trimmed from the bottom at the value of z=-20

    #     GR
    name		     GR
    code		      Targets
     Count		     SUM Zscore
    (>-2.0)		     Rank SUM 
    Zscore  (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG 
    Zscore  (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM
    Zscore (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG 
    Zscore  (>0.0)
2 KiharaLab 294 37 15.3597 1 0.4151 4 20.1463 2 0.5445 3
3 Yang-Multimer 456 37 14.5255 2 0.3926 6 19.5305 3 0.5279 4
5 Yang-Server 052 37 13.5255 3 0.3656 7 18.7449 5 0.5066 6
7 MULTICOM_human 345 37 13.0386 4 0.3524 8 17.7795 7 0.4805 10
4 Yang 022 36 12.9135 5 0.4143 5 18.8322 4 0.5231 5
6 MIEnsembles-Server 110 37 12.0918 6 0.3268 9 18.2879 6 0.4943 8
8 Zheng 462 37 10.9631 7 0.2963 10 17.5575 8 0.4745 11
14 MULTICOM_GATE 425 37 10.3399 8 0.2795 11 16.0353 14 0.4334 18
10 MULTICOM_LLM 319 37 10.2300 9 0.2765 12 16.6277 10 0.4494 15
9 AF3-server 304 37 9.9460 10 0.2688 13 17.1167 9 0.4626 14
1 kozakovvajda 274 34 9.4231 11 0.4536 2 20.6398 1 0.6071 2
11 Zheng-Multimer 147 37 9.4126 12 0.2544 14 16.2961 11 0.4404 16
22 MULTICOM_AI 331 37 9.1939 13 0.2485 15 15.0391 22 0.4065 27
18 MULTICOM 051 37 9.1741 14 0.2479 16 15.4140 18 0.4166 22
17 Huang-HUST 091 37 8.1268 15 0.2196 20 15.5626 17 0.4206 20
31 elofsson 241 37 8.0457 16 0.2175 21 13.7732 31 0.3722 39
29 NKRNA-s 028 37 7.6095 17 0.2057 23 13.8654 29 0.3747 35
23 GHZ-ISM 075 37 5.3304 18 0.1441 27 14.8175 23 0.4005 29
20 CSSB-Human 419 37 5.0413 19 0.1363 29 15.1590 20 0.4097 25
21 plmfold 287 36 4.2086 20 0.1725 25 15.1025 21 0.4195 21
32 Unicorn 284 37 4.1212 21 0.1114 32 13.7624 32 0.3720 40
15 XGroup 322 37 3.6442 22 0.0985 34 15.6493 15 0.4230 19
25 kiharalab_server 267 36 3.1179 23 0.1422 28 14.5599 25 0.4044 28
39 Guijunlab-Complex 148 37 2.8725 24 0.0776 38 12.7362 39 0.3442 45
24 ptq 475 36 2.5178 25 0.1255 30 14.6919 24 0.4081 26
36 GuijunLab-Assembly 312 37 2.1648 26 0.0585 41 13.1212 36 0.3546 44
13 ClusPro 494 34 1.9601 27 0.2341 18 16.0480 13 0.4720 13
30 Cool-PSP 014 37 1.2259 28 0.0331 44 13.8548 30 0.3745 36
28 CSSB_FAKER 221 37 1.2096 29 0.0327 45 13.9934 28 0.3782 34
38 MassiveFold 031 36 1.0850 30 0.0857 35 12.9183 38 0.3588 43
27 MRAFold 079 36 1.0351 31 0.0843 36 14.0410 27 0.3900 31
26 MRAH 293 36 0.9535 32 0.0820 37 14.0492 26 0.3903 30
19 PEZYFoldings 015 37 0.6483 33 0.0175 46 15.2189 19 0.4113 24
41 GuijunLab-QA 393 35 -0.3080 34 0.1055 33 12.0408 41 0.3440 46
48 GHZ-MAN 301 37 -0.6265 35 -0.0169 50 10.2108 48 0.2760 58
47 McGuffin 164 37 -1.2867 36 -0.0348 52 10.7644 47 0.2909 55
45 CSSB_experimental 286 37 -1.5769 37 -0.0426 53 11.3455 45 0.3066 52
42 GuijunLab-Human 264 35 -2.0622 38 0.0554 42 11.7635 42 0.3361 48
12 Wallner 465 37 -2.2979 39 -0.0621 56 16.2189 12 0.4383 17
40 MQA_server 122 36 -2.9254 40 -0.0257 51 12.1946 40 0.3387 47
16 falcon2 208 32 -3.3631 41 0.2074 22 15.6233 16 0.4882 9
37 XGroup-server 219 35 -3.8271 42 0.0049 48 13.0611 37 0.3732 37
43 milliseconds 375 32 -5.0365 43 0.1551 26 11.5601 43 0.3613 42
50 MultiFOLD2 163 37 -5.7252 44 -0.1547 64 9.4652 50 0.2558 61
34 DeepFold 059 37 -6.2379 45 -0.1686 65 13.6388 34 0.3686 41
46 Bhattacharya 369 35 -7.0133 46 -0.0861 58 10.9093 46 0.3117 50
52 colabfold_baseline 145 36 -7.4625 47 -0.1517 63 9.0613 52 0.2517 62
33 Pierce 290 29 -10.8439 48 0.1778 24 13.7239 33 0.4732 12
35 DeepFold-server 388 35 -11.4553 49 -0.2130 67 13.3783 35 0.3822 33
56 Yan 323 30 -12.1024 50 0.0633 40 8.6787 56 0.2893 56
49 ShanghaiTech-human 298 33 -12.2654 51 -0.1293 60 10.0960 49 0.3059 53
64 colabfold 198 36 -12.4842 52 -0.2912 70 6.3579 64 0.1766 75
44 Zou 204 30 -12.9028 53 0.0366 43 11.4914 44 0.3830 32
53 CoDock 262 37 -13.0031 54 -0.3514 71 9.0350 53 0.2442 66
58 Fernandez-Recio 489 31 -16.3214 55 -0.1394 62 8.0920 58 0.2610 59
66 RAGfold_Prot1 311 30 -16.4075 56 -0.0803 57 6.1701 66 0.2057 74
61 HYU_MLLAB 196 35 -16.5355 57 -0.3582 73 7.5590 61 0.2160 73
63 ShanghaiTech-server 423 30 -16.8134 58 -0.0938 59 6.9277 63 0.2309 70
55 GromihaLab 272 37 -20.8681 59 -0.5640 74 8.8006 55 0.2379 68
62 Bates 085 30 -21.7071 60 -0.2569 69 7.1335 62 0.2378 69
51 ChaePred 171 25 -22.1117 61 0.0755 39 9.3192 51 0.3728 38
57 DeepFold-refine 139 37 -22.7101 62 -0.6138 75 8.2378 57 0.2226 71
54 FTBiot0119 023 29 -23.2841 63 -0.2512 68 8.9464 54 0.3085 51
59 Schneidman 191 28 -27.9273 64 -0.3545 72 7.7466 59 0.2767 57
65 HIT-LinYang 218 20 -33.8688 65 0.0066 47 6.2429 65 0.3121 49
68 OpenComplex_Server 450 36 -36.2506 66 -0.9514 79 4.9239 68 0.1368 78
73 UNRES 261 35 -36.9636 67 -0.9418 78 2.1963 73 0.0628 81
60 smg_ulaval 397 15 -37.6877 68 0.4208 3 7.5693 60 0.5046 7
67 Vakser 117 30 -42.0294 69 -0.9343 77 4.9592 67 0.1653 76
75 DELCLAB 040 33 -42.6447 70 -1.0498 80 2.0661 75 0.0626 82
70 OpenComplex 167 37 -43.0254 71 -1.1628 82 3.1566 70 0.0853 80
72 Ayush 187 27 -44.8627 72 -0.9208 76 2.6722 72 0.0990 79
69 mialab_prediction 380 15 -45.9990 73 -0.1333 61 3.9040 69 0.2603 60
74 HADDOCK 008 9 -56.5401 74 -0.0600 55 2.1568 74 0.2396 67
76 MIALAB_gong 468 8 -59.4066 75 -0.1758 66 1.9713 76 0.2464 65
78 APOLLO 337 23 -63.0522 76 -1.5240 84 0.9246 78 0.0402 83
81 ARC 300 23 -63.9854 77 -1.5646 85 0.7124 81 0.0310 86
79 COAST 114 23 -64.6810 78 -1.5948 86 0.7772 79 0.0338 85
77 UTMB 049 3 -67.3246 79 0.2251 19 1.2425 77 0.4142 23
80 colabfold_foldseek 174 3 -67.6297 80 0.1234 31 0.7404 80 0.2468 64
71 GuijunLab-PAthreader 314 2 -68.1007 81 0.9496 1 2.9790 71 1.4895 1
86 profold2 132 3 -71.2941 82 -1.0980 81 0.1056 86 0.0352 84
83 mialab_prediction2 271 1 -71.7545 83 0.2455 17 0.2485 83 0.2485 63
84 FrederickFolding 276 1 -72.0067 84 -0.0067 49 0.2179 84 0.2179 72
85 PerezLab_Gators 358 1 -72.0586 85 -0.0586 54 0.1642 85 0.1642 77
82 OmniFold 400 2 -72.3997 86 -1.1998 83 0.6069 82 0.3035 54
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate zscores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate zscores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2024, University of California, Davis
Terms of Use