Bioinformatics Advance Access originally published online on January 29, 2004
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Bioinformatics 20(5) © Oxford University Press 2004; all rights reserved.
Reproducibility of SELDI-TOF protein patterns in serum: comparing datasets from different experiments
Department of Biostatistics, U.T. M.D. Anderson Cancer Center, 1515 Holcombe Blvd, Box 447, Houston, TX 77030-4009, USA
Received on July 14, 2003
; revised on October 14, 2003
; accepted on October 16, 2003
Advance Access Publication January 29, 2004
Motivation: There has been much interest in using patterns derived from surface-enhanced laser desorption and ionization (SELDI) protein mass spectra from serum to differentiate samples from patients both with and without disease. Such patterns have been used without identification of the underlying proteins responsible. However, there are questions as to the stability of this procedure over multiple experiments.
Results: We compared SELDI proteomic spectra from serum from three experiments by the same group on separating ovarian cancer from normal tissue. These spectra are available on the web at http://clinicalproteomics.steem.com. In general, the results were not reproducible across experiments. Baseline correction prevents reproduction of the results for two of the experiments. In one experiment, there is evidence of a major shift in protocol mid-experiment which could bias the results. In another, structure in the noise regions of the spectra allows us to distinguish normal from cancer, suggesting that the normals and cancers were processed differently. Sets of features found to discriminate well in one experiment do not generalize to other experiments. Finally, the mass calibration in all three experiments appears suspect. Taken together, these and other concerns suggest that much of the structure uncovered in these experiments could be due to artifacts of sample processing, not to the underlying biology of cancer. We provide some guidelines for design and analysis in experiments like these to ensure better reproducible, biologically meaningfully results.
Availability: The MATLAB and Perl code used in our analyses is available at http://bioinformatics.mdanderson.org
Contact: kabagg{at}mdanderson.org
* To whom correspondence should be addressed.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  R. D. Gray, G. MacGregor, D. Noble, M. Imrie, M. Dewar, A. C. Boyd, J. A. Innes, D. J. Porteous, and A. P. Greening Sputum Proteomics in Inflammatory and Suppurative Respiratory Diseases Am. J. Respir. Crit. Care Med., September 1, 2008; 178(5): 444 - 452. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 Y. Wang, X. Zhou, H. Wang, K. Li, L. Yao, and S. T.C. Wong Reversible jump MCMC approach for peak identification for stroke SELDI mass spectrometry using mixture model Bioinformatics, July 1, 2008; 24(13): i407 - i413. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Barla, G. Jurman, S. Riccadonna, S. Merler, M. Chierici, and C. Furlanello Machine learning methods for predictive proteomics Brief Bioinform, March 1, 2008; 9(2): 119 - 128. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. N. McGuire, J. Overgaard, and F. Pociot Mass spectrometry is only one piece of the puzzle in clinical proteomics Brief Funct Genomic Proteomic, February 28, 2008; (2008) eln005v1. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Roy, S. A. Josephson, J. Fridlyand, J. Karch, C. Kadoch, J. Karrim, L. Damon, P. Treseler, S. Kunwar, M. A. Shuman, et al. Protein Biomarker Identification in the CSF of Patients With CNS Lymphoma J. Clin. Oncol., January 1, 2008; 26(1): 96 - 105. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. McLerran, W. E. Grizzle, Z. Feng, W. L. Bigbee, L. L. Banez, L. H. Cazares, D. W. Chan, J. Diaz, E. Izbicka, J. Kagan, et al. Analytical Validation of Serum Proteomic Profiling for Diagnosis of Prostate Cancer: Sources of Sample Bias Clin. Chem., January 1, 2008; 54(1): 44 - 52. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. Pelikan, W. L. Bigbee, D. Malehorn, J. Lyons-Weiler, and M. Hauskrecht Intersession reproducibility of mass spectrometry profiles and its effect on accuracy of multivariate classification models Bioinformatics, November 15, 2007; 23(22): 3065 - 3072. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. E. Brenner and D. P. Normolle Biomarkers for Cancer Risk, Early Detection, and Prognosis: The Validation Conundrum Cancer Epidemiol. Biomarkers Prev., October 1, 2007; 16(10): 1918 - 1920. [Full Text] [PDF]
|
|
|
|
 |
|
 A. Prakash, B. Piening, J. Whiteaker, H. Zhang, S. A. Shaffer, D. Martin, L. Hohmann, K. Cooke, J. M. Olson, S. Hansen, et al. Assessing Bias in Experiment Design for Large Scale Mass Spectrometry-based Quantitative Proteomics Mol. Cell. Proteomics, October 1, 2007; 6(10): 1741 - 1748. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. Noy and D. Fasulo Improved model-based, platform-independent feature extraction for mass spectrometry Bioinformatics, October 1, 2007; 23(19): 2528 - 2535. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. McIlwain, D. Page, E. L. Huttlin, and M. R. Sussman Using dynamic programming to create isotopic distribution maps from mass spectra Bioinformatics, July 1, 2007; 23(13): i328 - i336. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. Matsumoto, T. Kojima, K. Ogawa, S. Kamegai, T. Oyama, Y. Shibagaki, T. Kawasaki, H. Fujinaga, K. Takahashi, H. Hikiami, et al. A Proteomic Approach for the Diagnosis of 'Oketsu' (blood stasis), a Pathophysiologic Concept of Japanese Traditional (Kampo) Medicine Evid. Based Complement. Altern. Med., June 15, 2007; (2007) nem049v1. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Y. Park, S. R. Downing, D. Kim, W. C. Hahn, C. Li, P. W. Kantoff, and L.J. Wei Simultaneous and exact interval estimates for the contrast of two groups based on an extremely high dimensional variable: application to mass spec data Bioinformatics, June 15, 2007; 23(12): 1451 - 1458. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Y. Lai, B.-l. Adam, R. Podolsky, and J.-X. She A mixture model approach to the tests of concordance and discordance between two large-scale experiments with two-sample groups Bioinformatics, May 15, 2007; 23(10): 1243 - 1250. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Albrethsen Reproducibility in Protein Profiling by MALDI-TOF Mass Spectrometry Clin. Chem., May 1, 2007; 53(5): 852 - 858. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Y. V. Karpievitch, E. G. Hill, A. J. Smolka, J. S. Morris, K. R. Coombes, K. A. Baggerly, and J. S. Almeida PrepMS: TOF MS data graphical preprocessing tool Bioinformatics, January 15, 2007; 23(2): 264 - 265. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. R. Drake, E. E. Schwegler, G. Malik, J. Diaz, T. Block, A. Mehta, and O. J. Semmes Lectin Capture Strategies Combined with Mass Spectrometry for the Discovery of Serum Glycoprotein Biomarkers Mol. Cell. Proteomics, October 1, 2006; 5(10): 1957 - 1967. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. P. Bowler, M. C. Ellison, and N. Reisdorph Proteomics in pulmonary medicine. Chest, August 1, 2006; 130(2): 567 - 574. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 C. Baumgartner and D. Baumgartner Biomarker Discovery, Disease Classification, and Similarity Query Processing on High-Throughput MS/MS Data of Inborn Errors of Metabolism J Biomol Screen, February 1, 2006; 11(1): 90 - 99. [Abstract] [PDF]
|
|
|
|
|
|
P. Findeisen, D. Sismanidis, M. Riedl, V. Costina, and M. Neumaier Preanalytical Impact of Sample Handling on Proteome Profiling Experiments with Matrix-Assisted Laser Desorption/Ionization Time-of-Flight Mass Spectrometry Clin. Chem., December 1, 2005; 51(12): 2409 - 2411. [Full Text] [PDF]
|
|
|
|
 |
|
 K. Honda, Y. Hayashida, T. Umaki, T. Okusaka, T. Kosuge, S. Kikuchi, M. Endo, A. Tsuchida, T. Aoki, T. Itoi, et al. Possible Detection of Pancreatic Cancer by Plasma Protein Profiling Cancer Res., November 15, 2005; 65(22): 10613 - 10622. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 Y. Hayashida, K. Honda, Y. Osaka, T. Hara, T. Umaki, A. Tsuchida, T. Aoki, S. Hirohashi, and T. Yamada Possible Prediction of Chemoradiosensitivity of Esophageal Cancer by Serum Protein Profiling Clin. Cancer Res., November 15, 2005; 11(22): 8042 - 8047. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. W. Ressom, R. S. Varghese, M. Abdel-Hamid, S. A.-L. Eissa, D. Saha, L. Goldman, E. F. Petricoin, T. P. Conrads, T. D. Veenstra, C. A. Loffredo, et al. Analysis of mass spectral serum profiles for biomarker selection Bioinformatics, November 1, 2005; 21(21): 4039 - 4045. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
O. J. Semmes The "omics" Haystack: Defining Sources of Sample Bias in Expression Profiling Clin. Chem., September 1, 2005; 51(9): 1571 - 1572. [Full Text] [PDF]
|
|
|
|
|
|
L. J. Dekker, W. Boogerd, G. Stockhammer, J. C. Dalebout, I. Siccama, P. Zheng, J. M. Bonfrer, J. J. Verschuuren, G. Jenster, M. M. Verbeek, et al. MALDI-TOF Mass Spectrometry Analysis of Cerebrospinal Fluid Tryptic Peptide Profiles to Diagnose Leptomeningeal Metastases in Patients with Breast Cancer Mol. Cell. Proteomics, September 1, 2005; 4(9): 1341 - 1349. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. E. Banks, A. J. Stanley, D. A. Cairns, J. H. Barrett, P. Clarke, D. Thompson, and P. J. Selby Influences of Blood Sample Processing on Low-Molecular-Weight Proteome Identified by Surface-Enhanced Laser Desorption/Ionization Mass Spectrometry Clin. Chem., September 1, 2005; 51(9): 1637 - 1649. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. J. Robbins, J. Villanueva, and P. Tempst Distilling Cancer Biomarkers From the Serum Peptidome: High Technology Reading of Tea Leaves or an Insight to Clinical Systems Biology? J. Clin. Oncol., August 1, 2005; 23(22): 4835 - 4837. [Full Text] [PDF]
|
|
|
|
|
|
S. R. Master Diagnostic Proteomics: Back to Basics? Clin. Chem., August 1, 2005; 51(8): 1333 - 1334. [Full Text] [PDF]
|
|
|
|
|
|
A. Karsan, B. J. Eigl, S. Flibotte, K. Gelmon, P. Switzer, P. Hassell, D. Harrison, J. Law, M. Hayes, M. Stillwell, et al. Analytical and Preanalytical Biases in Serum Proteomic Pattern Analysis for Breast Cancer Diagnosis Clin. Chem., August 1, 2005; 51(8): 1525 - 1528. [Full Text] [PDF]
|
|
|
|
|
|
N. Jeffries Algorithms for alignment of mass spectrometry proteomic data Bioinformatics, July 15, 2005; 21(14): 3066 - 3073. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Goggins Molecular Markers of Early Pancreatic Cancer J. Clin. Oncol., July 10, 2005; 23(20): 4524 - 4531. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 V. E. Murphy, R. F. Johnson, Y.-C. Wang, K. Akinsanya, P. G. Gibson, R. Smith, and V. L. Clifton The Effect of Maternal Asthma on Placental and Cord Blood Protein Profiles Reproductive Sciences, July 1, 2005; 12(5): 349 - 355. [Abstract] [PDF]
|
|
|
|
|
|
A. T. Shaw, D. G. Kirsch, and T. Jacks Future of Early Detection of Lung Cancer: The Role of Mouse Models Clin. Cancer Res., July 1, 2005; 11(13): 4999s - 5003s. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. S. Yu, S. Ongarello, R. Fiedler, X. W. Chen, G. Toffolo, C. Cobelli, and Z. Trajanoski Ovarian cancer identification based on dimensionality reduction for high-throughput mass spectrometry data Bioinformatics, May 15, 2005; 21(10): 2200 - 2209. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. S. Morris, K. R. Coombes, J. Koomen, K. A. Baggerly, and R. Kobayashi Feature extraction and quantification for mass spectrometry in biomedical applications using the mean spectrum Bioinformatics, May 1, 2005; 21(9): 1764 - 1775. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. E. Wright, D. K. Han, and R. Aebersold Mass Spectrometry-based Expression Profiling of Clinical Prostate Cancer Mol. Cell. Proteomics, April 1, 2005; 4(4): 545 - 554. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. A. Baggerly, J. S. Morris, S. R. Edmonson, and K. R. Coombes Signal in Noise: Evaluating Reported Reproducibility of Serum Proteomic Tests for Ovarian Cancer J Natl Cancer Inst, February 16, 2005; 97(4): 307 - 309. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. R. Coombes Analysis of Mass Spectrometry Profiles of the Serum Proteome Clin. Chem., January 1, 2005; 51(1): 1 - 2. [Full Text] [PDF]
|
|
|
|
|
|
G. L. Hortin Can Mass Spectrometric Protein Profiling Meet Desired Standards of Clinical Laboratory Practice? Clin. Chem., January 1, 2005; 51(1): 3 - 5. [Full Text] [PDF]
|
|
|
|
|
|
O. J. Semmes, Z. Feng, B.-L. Adam, L. L. Banez, W. L. Bigbee, D. Campos, L. H. Cazares, D. W. Chan, W. E. Grizzle, E. Izbicka, et al. Evaluation of Serum Protein Profiling by Surface-Enhanced Laser Desorption/Ionization Time-of-Flight Mass Spectrometry for the Detection of Prostate Cancer: I. Assessment of Platform Reproducibility Clin. Chem., January 1, 2005; 51(1): 102 - 112. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. I. Malyarenko, W. E. Cooke, B.-L. Adam, G. Malik, H. Chen, E. R. Tracy, M. W. Trosset, M. Sasinowski, O. J. Semmes, and D. M. Manos Enhancement of Sensitivity and Resolution of Surface-Enhanced Laser Desorption/Ionization Time-of-Flight Mass Spectrometric Records for Serum Peptides Using Time-Series Analysis Techniques Clin. Chem., January 1, 2005; 51(1): 65 - 74. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K A Baggerly, S R Edmonson, J S Morris, and K R Coombes High-resolution serum proteomic patterns for ovarian cancer detection Endocr. Relat. Cancer, December 1, 2004; 11(4): 583 - 584. [Full Text] [PDF]
|
|
|
|
|
|
Z. Zhang, R. C. Bast Jr., Y. Yu, J. Li, L. J. Sokoll, A. J. Rai, J. M. Rosenzweig, B. Cameron, Y. Y. Wang, X.-Y. Meng, et al. Three Biomarkers Identified from Serum Proteomic Analysis for the Detection of Early Stage Ovarian Cancer Cancer Res., August 15, 2004; 64(16): 5882 - 5890. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. M. Hewitt, J. Dear, and R. A. Star Discovery of Protein Biomarkers for Renal Diseases J. Am. Soc. Nephrol., July 1, 2004; 15(7): 1677 - 1689. [Abstract] [Full Text] [PDF]
|
|