Evaluation of CASP9 Quality Assessment

Re: Evaluation of CASP9 Quality Assessment

Postby arneelof on Sun Dec 05, 2010 8:39 pm

Björn just calculated the GDT_TS plot for top-ranked models and as expected the correlation is really bad for the top 10% on Per Target.

Hopefully I can show the plot tomorrow.

Arne
arneelof
 
Posts: 10
Joined: Mon Mar 29, 2010 10:40 pm

Re: Evaluation of CASP9 Quality Assessment

Postby terashig on Tue Dec 07, 2010 12:16 am

There are the same "multi-model" problems in CASP official results.
especially T0543 !!! (in http://predictioncenter.org/casp9/qa_analysis.cgi)
terashig
 
Posts: 4
Joined: Fri Dec 03, 2010 12:25 am

Re: Evaluation of CASP9 Quality Assessment

Postby M.Pawlowski on Tue Dec 14, 2010 8:00 am

Hi,
I’ve  just made a simple comparison between benchmark based on all models and only not multiple segments models. Here are two lists of  10 best  MQAPs according  to average  Pearson’s correlarion. The test was done for single-domain CASP9 targets.
http://iimcb.genesilico.pl/mp/qa/casp9/ ... i_mod.html

As it can be seen, there are some slightly differences in the predictors ranking. However, next benchmarks that  I going to present will be based on ONLY not multiple segments dataset.
M.Pawlowski
 
Posts: 6
Joined: Thu Dec 02, 2010 9:55 am

Re: Evaluation of CASP9 Quality Assessment

Postby terashig on Wed Jan 19, 2011 1:16 am

We made graphical and sortable CASP9 QA results.

http://www.pharm.kitasato-u.ac.jp/bmd/C ... a_top.html

For 5 categories:
All targets (116)
Single-domain targets only (91)
Multi-domain targets only (25)
TBM targets only (94)
FM targets only (22)

And for 5 terms:
Pearson avg
Pearson overall
Kendall avg
Kendall overall
Avg loss

Genki Terashi
terashig
 
Posts: 4
Joined: Fri Dec 03, 2010 12:25 am

Previous

Return to CASP Discussion

Who is online

Users browsing this forum: No registered users and 4 guests

cron