Bioinformatics Advance Access published online on August 11, 2005
Bioinformatics, doi:10.1093/bioinformatics/bti623
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
1 Department of Computational Biology and Applied Algorithmics, Max-Planck-Institute for Informatics, Stuhlsatzenhausweg 85, 66123 Saarbrücken, Germany
* To whom correspondence should be addressed.
Summary: ROCR is a package for evaluating and visualizing the performance of scoring classifiers in the statistical language R. It features over 25 performance measures which can be freely combined to create two-dimensional performance curves. Standard methods for investigating trade-offs between specific performance measures are available within a uniform framework, including ROC graphs, precision/recall plots, lift charts, and cost curves. ROCR integrates tightly with R's powerful graphics capabilities, thus allowing for highly adjustable plots. Being equipped with only three commands and reasonable default values for optional parameters, ROCR combines flexibility with ease of usage. Availability: http://rocr.bioinf.mpi-sb.mpg.de. ROCR can be used under the terms of the GNU General Public License. Running within R, it is platform-independent.
Received March 10, 2005
Revised June 1, 2005
Accepted August 9, 2005
Applications note
ROCR: visualizing classifier performance in R
,
,
2 Department of Mathematics, University of California, Berkeley, CA 94720-3840, USA
Tobias Sing, E-mail: tobias.sing{at}mpi-sb.mpg.de
![]()
Abstract
work at MPI supported by EU NoE BioSapiens (LSHG-CT-2003-503265)
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
C. Blouin, S. Perry, A. Lavell, E. Susko, and A. J. Roger Reproducing the manual annotation of multiple sequence alignments using a SVM classifier Bioinformatics, December 1, 2009; 25(23): 3093 - 3098. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. W. Anderson, J. A. Soto, B. C. Lucey, A. Ozonoff, J. D. Jordan, J. Ratevosian, A. S. Ulrich, N. K. Rathlev, P. M. Mitchell, C. Rebholz, et al. Abdominal 64-MDCT for Suspected Appendicitis: The Use of Oral and IV Contrast Material Versus IV Contrast Material Only Am. J. Roentgenol., November 1, 2009; 193(5): 1282 - 1288. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. Valdar, C. C. Holmes, R. Mott, and J. Flint Mapping in Structured Populations by Resample Model Averaging Genetics, August 1, 2009; 182(4): 1263 - 1277. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Gonzalez-Torrecilla, J. Almendral, A. Arenal, F. Atienza, L. F. Atea, S. del Castillo, and F. Fernandez-Aviles Combined Evaluation of Bedside Clinical Variables and the Electrocardiogram for the Differential Diagnosis of Paroxysmal Atrioventricular Reciprocating Tachycardias in Patients Without Pre-Excitation J. Am. Coll. Cardiol., June 23, 2009; 53(25): 2353 - 2358. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. C. Geary, D. H. Bailey, and M. K. Hoard Predicting Mathematical Achievement and Mathematical Learning Disability with a Simple Screening Tool: The Number Sets Test Journal of Psychoeducational Assessment, June 1, 2009; 27(3): 265 - 279. [Abstract] [PDF] |
||||
![]() |
Q.-L. Ma, D. R. Galasko, J. M. Ringman, H. V. Vinters, S. D. Edland, J. Pomakian, O. J. Ubeda, E. R. Rosario, B. Teter, S. A. Frautschy, et al. Reduction of SorLA/LR11, a Sorting Protein Limiting {beta}-Amyloid Production, in Alzheimer Disease Cerebrospinal Fluid Arch Neurol, April 1, 2009; 66(4): 448 - 457. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Megraw, F. Pereira, S. T. Jensen, U. Ohler, and A. G. Hatzigeorgiou A transcription factor affinity-based code for mammalian transcription initiation Genome Res., April 1, 2009; 19(4): 644 - 656. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. R. Sanford, X. Wang, M. Mort, N. VanDuyn, D. N. Cooper, S. D. Mooney, H. J. Edenberg, and Y. Liu Splicing factor SFRS1 recognizes a functionally diverse landscape of RNA transcripts Genome Res., March 1, 2009; 19(3): 381 - 394. [Abstract] [Full Text] [PDF] |
||||
![]() |
T.-t. Soong, K. O. Wrzeszczynski, and B. Rost Physical protein-protein interactions predicted from microarrays Bioinformatics, November 15, 2008; 24(22): 2608 - 2614. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. A Leighton, J. A Horrocks, B. H Krueger, J. A Beggs, and D. L Kramer Predicting species interactions from edge responses: mongoose predation on hawksbill sea turtle nests in fragmented beach habitat Proc R Soc B, November 7, 2008; 275(1650): 2465 - 2472. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Beleslin, M. Ostojic, A. Djordjevic-Dikic, V. Vukcevic, S. Stojkovic, M. Nedeljkovic, G. Stankovic, D. Orlic, N. Milic, J. Stepanovic, et al. The value of fractional and coronary flow reserve in predicting myocardial recovery in patients with previous myocardial infarction Eur. Heart J., November 1, 2008; 29(21): 2617 - 2624. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. S. F. Lee, L. Sun, R. Kustra, and S. B. Bull EM-random forest and new measures of variable importance for multi-locus quantitative trait linkage analysis Bioinformatics, July 15, 2008; 24(14): 1603 - 1610. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. D. Ward and H. J. Bussemaker Predicting functional transcription factor binding through alignment-free and affinity-based analysis of orthologous promoter sequences Bioinformatics, July 1, 2008; 24(13): i165 - i171. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. T. Dittrich, G. W. Klau, A. Rosenwald, T. Dandekar, and T. Muller Identifying functional modules in protein-protein interaction networks: an integrated exact approach Bioinformatics, July 1, 2008; 24(13): i223 - i231. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. F. W. Saunders and B. Kobe The Predikin webserver: improved prediction of protein kinase peptide specificity using structural information Nucleic Acids Res., July 1, 2008; 36(suppl_2): W286 - W290. [Abstract] [Full Text] [PDF] |
||||
![]() |
X.-J. Ma, R. Salunga, S. Dahiya, W. Wang, E. Carney, V. Durbecq, A. Harris, P. Goss, C. Sotiriou, M. Erlander, et al. A Five-Gene Molecular Grade Index and HOXB13:IL17BR Are Complementary Prognostic Factors in Early Stage Breast Cancer Clin. Cancer Res., May 1, 2008; 14(9): 2601 - 2608. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Kathiresan, O. Melander, D. Anevski, C. Guiducci, N. P. Burtt, C. Roos, J. N. Hirschhorn, G. Berglund, B. Hedblad, L. Groop, et al. Polymorphisms Associated with Cholesterol and Risk of Cardiovascular Events N. Engl. J. Med., March 20, 2008; 358(12): 1240 - 1249. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Bernauer, R. P. Bahadur, F. Rodier, J. Janin, and A. Poupon DiMoVo: a Voronoi tessellation-based method for discriminating crystallographic and biological protein-protein interactions Bioinformatics, March 1, 2008; 24(5): 652 - 658. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Holyoake, P. O'Sullivan, R. Pollock, T. Best, J. Watanabe, Y. Kajita, Y. Matsui, M. Ito, H. Nishiyama, N. Kerr, et al. Development of a Multiplex RNA Urine Test for the Detection and Stratification of Transitional Cell Carcinoma of the Bladder Clin. Cancer Res., February 1, 2008; 14(3): 742 - 749. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. Sommer, O. Muller, F. S. Domingues, O. Sander, J. Weickert, and T. Lengauer Moment invariants as shape recognition technique for comparing protein binding sites Bioinformatics, December 1, 2007; 23(23): 3139 - 3146. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Robbins, A. K. Aragaki, C. Kooperberg, N. Watts, J. Wactawski-Wende, R. D. Jackson, M. S. LeBoff, C. E. Lewis, Z. Chen, M. L. Stefanick, et al. Factors Associated With 5-Year Risk of Hip Fracture in Postmenopausal Women JAMA, November 28, 2007; 298(20): 2389 - 2398. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. J. Vogel, D. P. Atchley, J. Erlichman, K. R. Broglio, K. J. Ready, V. Valero, C. I. Amos, G. N. Hortobagyi, K. H. Lu, and B. Arun BRCA1 and BRCA2 Genetic Testing in Hispanic Patients: Mutation Prevalence and Evaluation of the BRCAPRO Risk Assessment Model J. Clin. Oncol., October 10, 2007; 25(29): 4635 - 4641. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Pandini, G. Mauri, A. Bordogna, and L. Bonati Detecting similarities among distant homologous proteins by comparison of domain flexibilities Protein Eng. Des. Sel., June 30, 2007; (2007) gzm021v2. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. D. Fjell, R. E.W. Hancock, and A. Cherkasov AMPer: a database and an automated discovery tool for antimicrobial peptides Bioinformatics, May 1, 2007; 23(9): 1148 - 1155. [Abstract] [Full Text] [PDF] |
||||
![]() |
X. Guo, R. Liu, C. D. Shriver, H. Hu, and M. N. Liebman Assessing semantic similarity measures for the characterization of human regulatory pathways Bioinformatics, April 15, 2006; 22(8): 967 - 973. [Abstract] [Full Text] [PDF] |
||||














