Skip Navigation



Bioinformatics Advance Access published online on August 16, 2005

Bioinformatics, doi:10.1093/bioinformatics/bti627
This Article
Right arrow Advance Access manuscript (PDF) Freely available
Right arrow Supplementary Data
Right arrowOA All Versions of this Article:
21/20/3824    most recent
bti627v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Google Scholar
Right arrow Articles by Price, G. A.
Right arrow Articles by Brenner, S. E.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Price, G. A.
Right arrow Articles by Brenner, S. E.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© The Author (2005). Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oupjournals.org
Received April 14, 2005
Revised July 16, 2005
Accepted August 11, 2005

Article

Statistical evaluation of pairwise protein sequence comparison with the Bayesian bootstrap

Gavin A. Price 1, Gavin E. Crooks 2, Richard E. Green 2, and Steven E. Brenner 3*

1 Department of Bioengineering, University of California, Berkeley, CA, USA 94720
2 Department of Plant and Microbial Biology, University of California, Berkeley, CA, USA 94720
3 Department of Bioengineering, University of California, Berkeley, CA, USA 94720; Department of Plant and Microbial Biology, University of California, Berkeley, CA, USA 94720

* To whom correspondence should be addressed.
Steven E. Brenner, E-mail: brenner{at}compio.berkeley.edu


   Abstract

Motivation: Protein sequence comparison methods are routinely used to infer the intricate network of evolutionary relationships found within the rapidly growing library of protein sequences, and thereby to predict the structure and function of uncharacterized proteins. Here, we detail an improved statistical benchmark of pairwise protein sequence comparison algorithms. We use bootstrap resampling techniques to determine standard statistical errors, and to estimate the confidence of our conclusions. We show that the underlying structure within benchmark databases causes Efron's standard, nonparametric bootstrap to be biased. Consequently, the standard bootstrap under-predicts average performance when used in the context of evaluating sequence comparison methods. As an alternative, we have developed an unbiased statistical evaluation based upon the Bayesian bootstrap, a resampling method operationally similar to the standard bootstrap.

Results: We apply our analysis to the comparative study of amino acid substitution matrix families and find that using modern matrices results in a small, but statistically significant improvement in remote homology detection compared to the classic PAM and BLOSUM matrices.

Availability: The sequence sets and code for performing these analyses are available from http://compbio.berkeley.edu/.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?




Disclaimer:
Please note that abstracts for content published before 1996 were created through digital scanning and may therefore not exactly replicate the text of the original print issues. All efforts have been made to ensure accuracy, but the Publisher will not be held responsible for any remaining inaccuracies. If you require any further clarification, please contact our Customer Services Department.