Bioinformatics Advance Access originally published online on May 7, 2007
Bioinformatics 2007 23(14):1768-1774; doi:10.1093/bioinformatics/btm232
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Assessment of survival prediction models based on microarray data
1Department of Medical Biometry and Statistics, Institute of Medical Biometry and Medical Informatics, University Medical Center Freiburg and 2Freiburg Center of Data Analysis and Model Building, University Freiburg, Germany
*To whom correspondence should be addressed.
| Abstract |
|---|
Motivation: In the process of developing risk prediction models, various steps of model building and model selection are involved. If this process is not adequately controlled, overfitting may result in serious overoptimism leading to potentially erroneous conclusions.
Methods: For right censored time-to-event data, we estimate the prediction error for assessing the performance of a risk prediction model (Gerds and Schumacher, 2006; Graf et al., 1999). Furthermore, resampling methods are used to detect overfitting and resulting overoptimism and to adjust the estimates of prediction error (Gerds and Schumacher, 2007).
Results: We show how and to what extent the methodology can be used in situations characterized by a large number of potential predictor variables where overfitting may be expected to be overwhelming. This is illustrated by estimating the prediction error of some recently proposed techniques for fitting a multivariate Cox regression model applied to the data of a prognostic study in patients with diffuse large-B-cell lymphoma (DLBCL).
Availability: Resampling-based estimation of prediction error curves is implemented in an R package called pec available from the authors.
Contact: sec{at}imbi.uni-freiburg.de
Associate Editor: Chris Stoeckert
Received on December 21, 2006; revised on April 24, 2007; accepted on April 26, 2007