14th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
Menu
RR Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate zscores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate zscores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
The final ranking was calculated according to the formula: 1.0*Z-score(F1) + 0.5*Z-score(ES(ext))
for FM domains, "L/5" long-range contacts with probability filter ">0".
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 368 tFold-CaT_human 22 21.3534 1 0.9706 1 23.2050 1 1.0548 1
2 010 TripletRes 22 18.5883 2 0.8449 2 20.9522 2 0.9524 2
3 488 tFold-IDT_human 22 17.9841 3 0.8175 3 20.2413 3 0.9201 3
4 024 DeepPotential 22 17.8706 4 0.8123 4 19.9311 4 0.9060 4
5 009 tFold_human 22 17.3844 5 0.7902 5 19.6251 5 0.8920 5
6 125 PreferredFold 22 16.3167 6 0.7417 6 18.8886 6 0.8586 6
7 183 tFold-CaT 22 14.0580 7 0.6390 7 15.8298 7 0.7195 7
8 351 tFold-IDT 22 13.6250 8 0.6193 8 15.4700 8 0.7032 8
9 238 tFold 22 10.8749 10 0.4943 10 15.0263 9 0.6830 9
10 216 EMAP_CHAE 22 13.3003 9 0.6046 9 14.8251 10 0.6739 10
11 380 PrayogRealDistance 22 10.1973 11 0.4635 11 14.0682 11 0.6395 11
12 377 Yang_FM 22 9.1162 12 0.4144 12 12.5498 12 0.5704 12
13 420 MULTICOM 22 8.3755 15 0.3807 15 12.2783 13 0.5581 13
14 304 Jones-UCL 22 8.5107 14 0.3868 14 11.8231 14 0.5374 14
15 198 MULTICOM-CONSTRUCT 22 6.7438 19 0.3065 19 10.8913 15 0.4951 15
16 367 FoldX 22 9.0724 13 0.4124 13 10.7339 16 0.4879 16
17 075 MULTICOM-CLUSTER 22 6.6908 20 0.3041 20 10.7078 17 0.4867 17
18 409 UOSHAN 22 7.7206 16 0.3509 16 10.6780 18 0.4854 18
19 344 PrayogBinnedMSA 22 3.9450 26 0.1793 26 10.6733 19 0.4852 19
20 319 MULTICOM-DIST 22 6.2493 21 0.2841 21 10.6152 20 0.4825 20
21 275 MULTICOM-AI 22 7.1240 18 0.3238 18 10.5688 21 0.4804 21
22 187 MULTICOM-HYBRID 22 6.1342 22 0.2788 22 10.4071 22 0.4731 22
23 192 AILON 22 2.5266 28 0.1148 28 10.0197 23 0.4554 23
24 252 MULTICOM-DEEP 22 5.9135 23 0.2688 23 9.8622 24 0.4483 24
25 222 TOWER 22 7.2948 17 0.3316 17 9.7106 25 0.4414 25
26 140 Yang-Server 22 5.0648 24 0.2302 24 9.5260 26 0.4330 26
27 061 191227 22 3.8434 27 0.1747 27 9.3992 27 0.4272 27
28 453 DMP2 22 2.0286 29 0.0922 29 9.2946 28 0.4225 28
29 207 Kiharalab_Contact 22 1.0972 31 0.0499 31 8.3782 29 0.3808 29
30 326 FALCON-DeepFolder 22 4.9743 25 0.2261 25 8.3449 30 0.3793 30
31 487 RaptorX 22 1.1730 30 0.0533 30 6.6355 31 0.3016 32
32 364 Kiharalab_Z_Server 22 -1.0543 34 -0.0479 34 6.2283 32 0.2831 33
33 071 Kiharalab 22 -0.8401 33 -0.0382 33 6.1631 33 0.2801 34
34 157 Shen-CDeep 21 -4.3639 37 -0.1126 36 5.7782 34 0.2752 35
35 392 trfold 22 -1.7011 35 -0.0773 35 5.6838 35 0.2584 36
36 268 PrayogBinnedSeq 22 -18.1423 47 -0.8247 49 5.0558 36 0.2298 37
37 195 ShanghaiTech 22 -0.6082 32 -0.0276 32 4.6212 37 0.2101 38
38 323 DellaCorteLab 22 -8.0714 41 -0.3669 42 4.0330 38 0.1833 39
39 317 MASS 22 -8.0227 40 -0.3647 41 3.8702 39 0.1759 40
40 307 Zhou-SPOT-Contact 22 -4.3346 36 -0.1970 38 3.7142 40 0.1688 41
41 151 RBO-PSP-CP 22 -7.0832 39 -0.3220 40 3.7091 41 0.1686 42
42 431 A2I2Prot 22 -12.7796 45 -0.5809 46 3.2163 42 0.1462 43
43 254 ropius0 22 -12.1490 44 -0.5522 45 2.8784 43 0.1308 44
44 286 AmoebaContact 22 -4.9360 38 -0.2244 39 2.8774 44 0.1308 45
45 387 edmc_pf 8 -29.3621 52 -0.1703 37 2.8754 45 0.3594 31
46 138 LAW 22 -8.6392 42 -0.3927 43 2.7015 46 0.1228 46
47 006 BrainFold 21 -29.8640 53 -1.3269 56 2.4259 47 0.1155 47
48 101 Destini 22 -11.0821 43 -0.5037 44 2.3798 48 0.1082 48
49 388 Rostlab 22 -15.5431 46 -0.7065 47 2.1216 49 0.0964 49
50 425 ProdGAN_Gonglab 22 -20.6992 50 -0.9409 52 1.5783 50 0.0717 50
51 081 MUFOLD 22 -20.6920 49 -0.9405 51 1.2219 51 0.0555 51
52 154 ICOS 21 -20.5786 48 -0.8847 50 1.0482 52 0.0499 53
53 144 SASHAN 18 -25.4917 51 -0.9718 53 0.9782 53 0.0543 52
54 196 bioinsilico_sbi 10 -38.3392 59 -1.4339 59 0.3229 54 0.0323 54
55 088 netris 22 -30.8769 55 -1.4035 58 0.1821 55 0.0083 56
56 448 BaiduUSA 22 -29.9532 54 -1.3615 57 0.1759 56 0.0080 57
57 104 KUHHAN 10 -36.2773 57 -1.2277 55 0.1613 57 0.0161 55
58 060 m3g 3 -40.4279 60 -0.8093 48 0.0000 58 0.0000 58
59 105 IOBIO 6 -38.2872 58 -1.0479 54 0.0000 58 0.0000 58
60 361 Jaaaca 22 -34.0656 56 -1.5484 60 0.0000 58 0.0000 58
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2020, University of California, Davis