Bioinformatics Advance Access originally published online on July 14, 2006
Bioinformatics 2006 22(20):2523-2531; doi:10.1093/bioinformatics/btl391
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Comparative evaluation of reverse engineering gene regulatory networks with relevance networks, graphical gaussian models and bayesian networks
1 Biomathematics and Statistics Scotland, Edinburgh UK
2 School of Informatics, University of Edinburgh UK
3 Department of Statistics, University of Dortmund Germany
*To whom correspondence should be addressed.
Motivation: An important problem in systems biology is the inference of biochemical pathways and regulatory networks from postgenomic data. Various reverse engineering methods have been proposed in the literature, and it is important to understand their relative merits and shortcomings. In the present paper, we compare the accuracy of reconstructing gene regulatory networks with three different modelling and inference paradigms: (1) Relevance networks (RNs): pairwise association scores independent of the remaining network; (2) graphical Gaussian models (GGMs): undirected graphical models with constraint-based inference, and (3) Bayesian networks (BNs): directed graphical models with score-based inference. The evaluation is carried out on the Raf pathway, a cellular signalling network describing the interaction of 11 phosphorylated proteins and phospholipids in human immune system cells. We use both laboratory data from cytometry experiments as well as data simulated from the gold-standard network. We also compare passive observations with active interventions.
Results: On Gaussian observational data, BNs and GGMs were found to outperform RNs. The difference in performance was not significant for the non-linear simulated data and the cytoflow data, though. Also, we did not observe a significant difference between BNs and GGMs on observational data in general. However, for interventional data, BNs outperform GGMs and RNs, especially when taking the edge directions rather than just the skeletons of the graphs into account. This suggests that the higher computational costs of inference with BNs over GGMs and RNs are not justified when using only passive observations, but that active interventions in the form of gene knockouts and over-expressions are required to exploit the full potential of BNs.
Availability: Data, software and supplementary material are available from http://www.bioss.sari.ac.uk/staff/adriano/research.html.
Contact: adriano{at}bioss.ac.uk, dirk{at}bioss.ac.uk, Grzegorc{at}statistik.uni-dortmund.de
Received on May 19, 2006; revised on July 7, 2006; accepted on July 10, 2006
This article has been cited by other articles:
![]() |
Ning Sun and Hongyu Zhao Reconstructing transcriptional regulatory networks through genomics data Statistical Methods in Medical Research, December 1, 2009; 18(6): 595 - 617. [Abstract] [PDF] |
||||
![]() |
S. Anjum, A. Doucet, and C. C. Holmes A boosting approach to structure learning of graphs with and without prior knowledge Bioinformatics, November 15, 2009; 25(22): 2929 - 2936. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Andrei and C. Kendziorski An efficient method for identifying statistical interactors in gene association networks Biostat., October 1, 2009; 10(4): 706 - 718. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Anchang, M. J. Sadeh, J. Jacob, A. Tresch, M. O. Vlad, P. J. Oefner, and R. Spang Special Feature: Complex Systems: From Chemistry to Systems Biology Special Feature: Modeling the temporal interplay of molecular signaling and gene expression by using dynamic nested effects models PNAS, April 21, 2009; 106(16): 6447 - 6452. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Grzegorczyk, D. Husmeier, K. D. Edwards, P. Ghazal, and A. J. Millar Modelling non-stationary gene regulatory processes with a non-homogeneous Bayesian network and the allocation sampler Bioinformatics, September 15, 2008; 24(18): 2071 - 2078. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. Ortega, K. Sameith, N. Turan, R. Compton, V. Trevino, M. Vannucci, and F. Falciani Models and computational strategies linking physiological response to molecular networks from large-scale data Phil Trans R Soc A, September 13, 2008; 366(1878): 3067 - 3089. [Abstract] [Full Text] [PDF] |
||||
![]() |
V. Vyshemirsky and M. A. Girolami Bayesian ranking of biochemical system models Bioinformatics, March 15, 2008; 24(6): 833 - 839. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. L. Elo, H. Jarvenpaa, M. Oresic, R. Lahesmaa, and T. Aittokallio Systematic construction of gene coexpression networks with applications to human T helper cell differentiation process Bioinformatics, August 15, 2007; 23(16): 2096 - 2103. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. Markowetz, D. Kostka, O. G. Troyanskaya, and R. Spang Nested effects models for high-dimensional phenotyping screens Bioinformatics, July 1, 2007; 23(13): i305 - i312. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. Soranzo, G. Bianconi, and C. Altafini Comparing association network algorithms for reverse engineering of large-scale gene regulatory networks: synthetic versus real data Bioinformatics, July 1, 2007; 23(13): 1640 - 1647. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. J. Wilkinson Bayesian methods in bioinformatics and computational systems biology Brief Bioinform, April 12, 2007; (2007) bbm007v1. [Abstract] [Full Text] [PDF] |
||||





