14th Community Wide Experiment on the
Critical Assessment of Techniques for Protein Structure Prediction
Menu
TS Analysis (refienement targets) : Group performance based on combined z-scores
Results Home Table Browser Estimate of Model Accuracy Results RR Assessment Results
The cummulative z-scores in this table are calculated according to the following procedure (example for the "first" models):
1. Calculate z-scores from the raw scores for all "first" models (corresponding values from the main result table);
2. Remove outliers - models with zscores below the tolerance threshold (set to -2.0);
3. Recalculate z-scores on the reduced dataset;
4. Assign z-scores below the penalty threshold (either -2.0 or 0.0) to the value of this threshold.
  GDT_TS based   Assessors' formula
    Models:
    • Analysis on the models designated as "1"
    • Analysis on the models with the best scores

    • Targets:
    • All targets
    • Regular targets
    • Extended time-frame targets

    • TBM easy
    • TBM hard
    • TBM/FM
    • FM
The ranking of the groups is performed on the basis of analysis of combined zscores according to the following formula used by the assessors: (0.46*RMS_CA + 0.2*SG + 0.17*GDT_HA + 0.15*QCS + 0.02*Molprb-Score)
    #     GR
    code		     GR
    name		     Domains Count     SUM Zscore
    (>-2.0)		     Rank SUM Zscore
    (>-2.0)		     AVG Zscore
    (>-2.0)		     Rank AVG Zscore
    (>-2.0)		     SUM Zscore
    (>0.0)		     Rank SUM Zscore
    (>0.0)		     AVG Zscore
    (>0.0)		     Rank AVG Zscore
    (>0.0)
1 473 BAKER 44 19.5192 6 0.4436 6 30.7912 1 0.6998 1
2 013 FEIG-S 44 24.6426 1 0.5601 1 26.2174 2 0.5959 2
3 335 FEIG 44 21.5981 3 0.4909 3 26.0149 3 0.5912 3
4 323 DellaCorteLab 44 20.7229 4 0.4710 4 22.9779 4 0.5222 4
5 999 ---STARTING-MODEL--- 44 21.6129 2 0.4912 2 22.4336 5 0.5099 5
6 149 Bhattacharya-Server 44 19.8084 5 0.4502 5 20.7698 6 0.4720 6
7 253 Bhattacharya 44 19.4929 7 0.4430 7 20.5126 7 0.4662 7
8 403 BAKER-experimental 44 -1.8306 15 -0.0416 21 20.2943 8 0.4612 8
9 071 Kiharalab 44 10.5739 11 0.2403 16 18.6402 9 0.4236 12
10 100 AIR 44 14.6708 8 0.3334 11 18.2060 10 0.4138 13
11 236 DeepMUSICS 44 13.3083 9 0.3025 14 16.8300 11 0.3825 15
12 220 McGuffin 37 1.5957 14 0.4215 9 16.7944 12 0.4539 10
13 349 Spider 36 -3.9162 17 0.3357 10 15.8146 13 0.4393 11
14 360 UNRES 42 9.0493 12 0.3107 12 15.6860 14 0.3735 16
15 470 PerillaGroup 44 12.5242 10 0.2846 15 15.3481 15 0.3488 19
16 070 Seok-server 37 -2.5573 16 0.3093 13 14.8744 16 0.4020 14
17 394 Kiharalab_Refine 44 2.5004 13 0.0568 19 14.3088 17 0.3252 20
18 003 SHORTLE 44 -33.9922 30 -0.7726 32 13.9378 18 0.3168 21
19 075 MULTICOM-CLUSTER 30 -15.0175 21 0.4327 8 13.7030 19 0.4568 9
20 341 Risoluto 44 -12.3750 20 -0.2813 24 13.5444 20 0.3078 22
21 193 Seok 37 -7.3883 18 0.1787 17 13.5141 21 0.3652 18
22 294 JLU_Comp_Struct_Bio 31 -28.6457 26 -0.0853 22 11.4218 22 0.3684 17
23 233 Frustration_Refine 40 -7.5542 19 0.0111 20 9.5522 23 0.2388 25
24 423 Seminoles 41 -26.0648 25 -0.4894 29 9.4795 24 0.2312 26
25 434 GLoSA 32 -20.3234 24 0.1149 18 8.8933 25 0.2779 23
26 270 Beta 34 -31.5420 28 -0.3395 25 8.1471 26 0.2396 24
27 340 Pharmulator 44 -19.8461 23 -0.4510 28 7.5194 27 0.1709 27
28 018 UNRES-template 44 -16.4429 22 -0.3737 26 7.1226 28 0.1619 28
29 081 MUFOLD 44 -31.5992 29 -0.7182 31 6.6746 29 0.1517 30
30 192 AILON 44 -29.2350 27 -0.6644 30 5.3193 30 0.1209 32
31 389 AWSEM_PCA 43 -36.6159 31 -0.8050 33 4.5858 31 0.1066 33
32 291 Protein-blacksmith 44 -47.6081 32 -1.0820 34 4.4934 32 0.1021 34
33 131 PerezLab_Gators 33 -71.7896 34 -1.5088 35 4.3996 33 0.1333 31
34 304 Jones-UCL 19 -57.2812 33 -0.3832 27 2.9385 34 0.1547 29
35 352 laufer_ros 26 -76.3550 35 -1.5521 36 1.8328 35 0.0705 37
36 080 FOLDYNE 6 -77.6344 36 -0.2724 23 0.5956 36 0.0993 35
37 342 CUTSP 7 -85.4982 37 -1.6426 37 0.5146 37 0.0735 36
Protein Structure Prediction Center
Sponsored by the US National Institute of General Medical Sciences (NIH/NIGMS)
Please address any questions or queries to:
© 2007-2020, University of California, Davis