13th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
Menu
RR Analysis : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate zscores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate zscores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
The final ranking was calculated according to the formula: 1.0*Z-score(F1) + 0.5*Z-score(ES(ext))
for FM domains, "L/5" long-range contacts with probability filter ">0".
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 032 TripletRes 31 33.0683 1 1.0667 1 33.9361 1 1.0947 1
2 498 RaptorX-Contact 31 32.9798 2 1.0639 2 33.4022 2 1.0775 2
3 323 TripletRes_AT 30 24.0527 4 0.8684 3 27.8615 3 0.9287 3
4 180 ResTriplet 31 25.5417 3 0.8239 4 27.3317 4 0.8817 4
5 491 DMP 31 21.1262 5 0.6815 5 24.5195 5 0.7910 5
6 036 Zhang_Contact 31 17.4296 6 0.5622 6 22.8342 6 0.7366 6
7 189 ZHOU-Contact 31 17.1937 7 0.5546 9 22.7124 7 0.7327 7
8 125 ResTriplet_AT 30 14.8173 9 0.5606 7 20.6285 8 0.6876 8
9 164 Yang-Server 31 12.3500 11 0.3984 13 20.3696 9 0.6571 10
10 352 RRMD-plus 30 14.6430 10 0.5548 8 20.1623 10 0.6721 9
11 106 RRMD 31 17.1718 8 0.5539 10 19.8280 11 0.6396 11
12 224 Destini 30 11.6694 12 0.4556 11 16.5333 12 0.5511 13
13 351 DL-Haven 29 7.6823 14 0.4028 12 15.6680 13 0.5403 14
14 392 Shen-CDeep 30 8.7104 13 0.3570 14 15.6126 14 0.5204 16
15 122 Forbidden 30 7.3007 15 0.3100 15 14.4660 15 0.4822 17
16 269 BR_null 25 -10.4810 31 0.0608 16 13.0808 16 0.5232 15
17 386 DeepContact 31 -1.9728 18 -0.0636 22 12.0568 17 0.3889 18
18 041 FALCON-Contact 31 -9.1418 30 -0.2949 32 11.3795 18 0.3671 19
19 430 RBO-Epsilon 31 -1.6044 17 -0.0518 18 10.4925 19 0.3385 20
20 475 DeltaContact 30 -6.0837 26 -0.1361 27 9.7902 20 0.3263 21
21 344 Kiharalab 30 -4.1852 25 -0.0728 23 9.4234 21 0.3141 22
22 154 GammaContact 30 -7.5429 28 -0.1848 28 9.4217 22 0.3141 23
23 312 MUFold_server 31 -3.5805 21 -0.1155 26 8.1554 23 0.2631 26
24 263 AlphaContact 30 -7.8773 29 -0.1959 29 8.0594 24 0.2686 24
25 435 DNCON3 30 -3.7441 22 -0.0581 19 8.0291 25 0.2676 25
26 058 MULTICOM_CLUSTER 31 -3.1167 20 -0.1005 25 7.9144 26 0.2553 30
27 023 MULTICOM-NOVEL 31 -2.7282 19 -0.0880 24 7.8705 27 0.2539 31
28 292 GoFold 30 -3.8452 24 -0.0615 21 7.8207 28 0.2607 27
29 091 BetaContact 30 -0.1893 16 0.0604 17 7.7769 29 0.2592 28
30 089 MULTICOM 30 -3.7624 23 -0.0587 20 7.7157 30 0.2572 29
31 381 GONGLAB-THU 30 -10.9880 32 -0.2996 33 6.6810 31 0.2227 33
32 001 Shen-Group 29 -12.2072 34 -0.2830 31 6.6616 32 0.2297 32
33 497 GaussDCA 31 -18.0732 36 -0.5830 36 5.6130 33 0.1811 34
34 243 MULTICOM-CONSTRUCT 31 -6.2176 27 -0.2006 30 5.4833 34 0.1769 35
35 152 PconsC4 31 -11.9944 33 -0.3869 34 4.7146 35 0.1521 36
36 407 rawMSA 31 -14.1883 35 -0.4577 35 4.0769 36 0.1315 38
37 471 CPClab 28 -24.9755 40 -0.6777 37 3.9225 37 0.1401 37
38 110 Distill 31 -23.4319 38 -0.7559 40 3.5391 38 0.1142 39
39 229 METAPSICOV_baseline 30 -23.9345 39 -0.7312 39 1.4309 39 0.0477 41
40 127 sbi_bioinsilico 23 -47.0572 44 -1.3503 45 1.3183 40 0.0573 40
41 064 IGBteam 31 -21.7665 37 -0.7021 38 0.9313 41 0.0300 42
42 020 HMSCasper 31 -38.6658 42 -1.2473 43 0.7496 42 0.0242 44
43 473 Maurice 27 -37.1755 41 -1.0806 42 0.6855 43 0.0254 43
44 191 GREMLIN_baseline 1 -60.7634 46 -0.7634 41 0.5706 44 0.5706 12
45 348 HMSCasper-Refiner 31 -41.3406 43 -1.3336 44 0.4204 45 0.0136 45
46 458 FOLDNET 23 -47.0936 45 -1.3519 46 0.0615 46 0.0027 46
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2018, University of California, Davis