Bioinformatics Vol. 19 no. 2 2003
Pages 212-218
© 2003 Oxford University Press
Rank order metrics for quantifying the association of sequence features with gene regulation
Department of Biophysics and Biophysical Chemistry, Johns Hopkins School of Medicine, Baltimore, MD 21205, USA
Received on May 13, 2002
; revised on July 16, 2002
; accepted on August 13, 2002
Motivation: Genome sequences and transcriptome analyses allow the correlation between gene regulation and DNA sequence features to be studied at the whole-genome level. To quantify these correlations, metrics are needed that can be applied to any sequence feature, regardless of its statistical distribution. It is also desirable for the metric values to be determined objectively, that is, without the use of subjective threshold values.
Results: We compare two metrics for quantifying the correlation of DNA sequence features with gene regulation. Each of the metrics is calculated from a rank-ordering of genes based on the value of the sequence feature of interest. The first metric is the area under the curve for a receiver operator characteristic plot (ROC AUC), a common way of summarizing the tradeoff between sensitivity and specificity for different values of a prediction criterion. We call the second metric the mean normalized conditional probability (MNCP). The MNCP can be thought of as the predictive value of the sequence feature averaged over all regulated genes. The statistical significance (P-value) of each metric can be estimated from simulations. Importantly, the P-value of the MNCP metric is less dramatically affected by the presence of false positives among the set of co-regulated genes than is the ROC AUC. This is especially useful in analyzing gene sets identified by DNA microarray analysis because such data cannot distinguish direct regulation by transcription factor binding from indirect regulation. We demonstrate that these two metrics, taken together, are useful tools for defining the binding site representation and regulatory control regions that best explain the difference between genes that are regulated by a given transcription factor and those that are not. Applications to other gene features are also described.
Availability: A Python program for calculating the ROC AUC and MNCP metric values given input rank orders is available from ftp://ftp.bs.jhmi.edu/users/nclarke/MNCP/
Contact: nclarke{at}jhmi.edu
* To whom correspondence should be addressed.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  L. Smeenk, S. J. van Heeringen, M. Koeppel, M. A. van Driel, S. J. J. Bartels, R. C. Akkers, S. Denissov, H. G. Stunnenberg, and M. Lohrum Characterization of genome-wide p53-binding sites upon stress response Nucleic Acids Res., June 1, 2008; 36(11): 3639 - 3654. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. B. Gordon, L. Nekludova, S. McCallum, and E. Fraenkel TAMO: a flexible, object-oriented framework for analyzing transcriptional regulation using DNA-sequence motifs Bioinformatics, July 15, 2005; 21(14): 3164 - 3165. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 X. Liu, D. M. Noll, J. D. Lieb, and N. D. Clarke DIP-chip: Rapid and accurate determination of DNA-binding specificity Genome Res., March 1, 2005; 15(3): 421 - 427. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. L. Carroll, D. A. Pradhan, J. A. Granek, N. D. Clarke, and J. L. Corden Identification of cis Elements Directing Termination of Yeast Nonpolyadenylated snoRNA Transcripts Mol. Cell. Biol., July 15, 2004; 24(14): 6241 - 6252. [Abstract] [Full Text] [PDF]
|
|