# ARACNE: An Algorithm for the Reconstruction of Gene Regulatory Networks in a Mammalian Cellular Context

^{1,}

^{2}Ilya Nemenman,

^{2}Katia Basso,

^{3}Chris Wiggins,

^{2,}

^{4}Gustavo Stolovitzky,

^{5}Riccardo Dalla Favera,

^{3}and Andrea Califano

^{}

^{1,}

^{2}

^{1}Department of Biomedical Informatics, Columbia University, New York, NY 10032

^{2}Joint Centers for Systems Biology, Columbia University, New York, NY 10032

^{3}Institute for Cancer Genetics, Columbia University, New York, NY 10032

^{4}Department of Applied Physics and Applied Mathematics, Columbia University, New York, NY 10032

^{5}IBM T.J. Watson Research Center, Yorktown Heights, NY 10598

^{}Corresponding author.

#### Supplement

#### Conference

## Abstract

### Background

Elucidating gene regulatory networks is crucial for understanding normal cell physiology and complex pathologic phenotypes. Existing computational methods for the genome-wide "reverse engineering" of such networks have been successful only for lower eukaryotes with simple genomes. Here we present *ARACNE*, a novel algorithm, using microarray expression profiles, specifically designed to scale up to the complexity of regulatory networks in mammalian cells, yet general enough to address a wider range of network deconvolution problems. This method uses an information theoretic approach to eliminate the majority of indirect interactions inferred by co-expression methods.

### Results

We prove that ARACNE reconstructs the network exactly (asymptotically) if the effect of loops in the network topology is negligible, and we show that the algorithm works well in practice, even in the presence of numerous loops and complex topologies. We assess ARACNE's ability to reconstruct transcriptional regulatory networks using both a realistic synthetic dataset and a microarray dataset from human B cells. On synthetic datasets ARACNE achieves very low error rates and outperforms established methods, such as Relevance Networks and Bayesian Networks. Application to the deconvolution of genetic networks in human B cells demonstrates ARACNE's ability to infer validated transcriptional targets of the cMYC proto-oncogene. We also study the effects of misestimation of mutual information on network reconstruction, and show that algorithms based on mutual information ranking are more resilient to estimation errors.

### Conclusion

ARACNE shows promise in identifying direct transcriptional interactions in mammalian cellular networks, a problem that has challenged existing reverse engineering algorithms. This approach should enhance our ability to use microarray data to elucidate functional mechanisms that underlie cellular processes and to identify molecular targets of pharmacological compounds in mammalian cellular networks.

## Background

Cellular phenotypes are determined by the dynamical activity of large networks of co-regulated genes. Thus dissecting the mechanisms of phenotypic selection requires elucidating the functions of the individual genes in the context of the networks in which they operate. Because gene expression is regulated by proteins, which are themselves gene products, statistical associations between gene mRNA abundance levels, while not directly proportional to activated protein concentrations, should provide clues towards uncovering gene regulatory mechanisms. Consequently, the advent of high throughput microarray technologies to simultaneously measure mRNA abundance levels across an entire genome has spawned much research aimed at using these data to construct conceptual "gene network" models to concisely describe the regulatory influences that genes exert on each other.

Genome-wide clustering of gene expression profiles [1] provides an important first step towards this goal by grouping together genes that exhibit similar transcriptional responses to various cellular conditions, and are therefore likely to be involved in similar cellular processes. However, the organization of genes into co-regulated clusters provides a very coarse representation of the cellular network. In particular, it cannot separate statistical interactions that are irreducible (i.e., direct) from those arising from cascades of transcriptional interactions that correlate the expression of many noninteracting genes. More generally, as appreciated in statistical physics, long range order (i.e., high correlation among non-directly interacting variables) can easily result from short range interactions [2]. Thus correlations, or *any other *local dependency measure, cannot be used as the only tool for the reconstruction of interaction networks without additional assumptions.

Within the last few years a number of sophisticated approaches for the reverse engineering of cellular networks (also called deconvolution) from gene expression data have emerged (reviewed in [3]). Their goal is to produce a high-fidelity representation of the cellular network topology as a graph, where genes are represented as vertices and are connected by edges representing direct regulatory interactions. The criteria for defining an edge, as well as its biological interpretation, remain imprecise and vary between applications. For example, graphical modeling [4] defines edges as parent-child relationships between mRNA abundance levels that are most likely to explain the data, integrative methods [5] use independent experimental clues to define edges as those showing evidence of physical interactions, and other statistical/information theoretical methods [6] identify edges with the strongest statistical associations between mRNA abundance levels. All available approaches suffer to various degrees from problems such as overfitting, high computational complexity, reliance on non-realistic network models, or a critical dependency on supplementary data that is only available for simple organisms. These limitations have relegated the successful large-scale application of most methods to relatively simple organisms, such as the yeast *Saccharomyces cerevisiae*, and the genome-wide deconvolution of a mammalian network is yet to be reported.

Here we introduce *ARACNE *(Algorithm for the Reconstruction of Accurate Cellular Networks), a novel information-theoretic algorithm for the reverse engineering of transcriptional networks from microarray data that overcomes some of these limitations. ARACNE defines an edge as an irreducible statistical dependency between gene expression profiles that cannot be explained as an artifact of other statistical dependencies in the network. We suggest that the presence of such irreducible statistical dependencies is likely to identify direct regulatory interactions mediated by a transcription factor binding to a target gene's promoter region, although other types of interactions may also be identified (see Discussion). In this study we focus on the former type of interaction for validation purposes. We demonstrate that ARACNE compares favorably with existing methods and achieves extremely low error rates in identifying transcriptional interactions in a synthetic dataset modeled using realistic Hill kinetics. In a biological context, we show that the algorithm infers bona-fide transcriptional targets in a mammalian gene network. We also study the effects of misestimation of mutual information (MI) on network reconstruction, and show that algorithms based on MI ranking are resilient to estimation errors. The algorithm is general enough to deal with a variety of other network reconstruction problems in biological, social, and engineering fields.

### Theoretical Background

Several factors have impeded the reliable reconstruction of genome-wide mammalian networks. First, temporal gene expression data is difficult to obtain for higher eukaryotes, and cellular populations harvested from different individuals generally capture random steady states of the underlying biochemical dynamics. This precludes the use of methods that infer temporal associations and thus plausible causal relationships (reviewed in [7]). Only steady state statistical dependences can be studied, which are not obviously linked to the underlying physical dependency model. Compounding this constraint, there is no universally accepted definition of statistical dependencies in the multivariate setting [8,9]. In this work we adopt the definition of [9], which builds on ideas from the Markov networks literature [10]. Briefly, we write the joint probability distribution (JPD) of the stationary expressions of all genes, *P*({*g*_{i}}), *i *= 1,..., *N*, as:

$P\left(\left\{{g}_{i}\right\}\right)=\frac{1}{Z}\mathrm{exp}\left[-{\displaystyle \sum _{i}^{N}{\phi}_{i}\left({g}_{i}\right)-{\displaystyle \sum _{i,j}^{N}{\phi}_{ij}\left({g}_{i},{g}_{j}\right)-{\displaystyle \sum _{i,j,k}^{N}{\phi}_{ijk}}\left({g}_{i},{g}_{j},{g}_{k}\right)-\mathrm{...}}}\right]\equiv {e}^{-H\left(\left\{{g}_{i}\right\}\right)}\text{}\left(1\right)$

where *N *is the number of genes, *Z *is the normalization factor, also called the *partition function*, ... are *potentials*, and *H*({*g*_{i}}) is the *Hamiltonian *that defines the system's statistics. Within such a model, we assert that a set of variables interacts if and only if (*iff*) the single potential that depends exclusively on these variables is nonzero. ARACNE aims precisely at identifying which of these potentials are nonzero, and eliminating the others even though their corresponding marginal JPDs may not factorize. While this representation is not directly used by the algorithm, it helps precisely formalize our definition of interaction and the class of irreducible dependencies that it will help elucidate.

Note that Eq. (1) does not define the potentials uniquely, and additional constraints are needed to avoid the ambiguity (see Appendix B). A reasonable approach is to specify ... using maximum entropy approximations [9,11] to *P*(*g*_{1},..., *g*_{N}) consistent with known marginals, so that constraining an *n*-way marginal defines its corresponding potential. We refer the reader to [9] for details.

### Approximations of the interaction structure

Since typical microarray sample sizes are relatively small, inferring the exponential number of potential *n*-way interactions of Eq. (1) is infeasible and a set of simplifying assumptions must be made about the dependency structure. Eq. (1) provides a principled and controlled way to introduce such approximations. The simplest model is one where genes are assumed independent, i.e., *H*({*g*_{i}}) = ∑(*g*_{i}), such that first-order potentials can be evaluated from the marginal probabilities, *P*(*g*_{i}), which are estimated from experimental observations. As more data become available we should be able to reliably estimate higher order marginals and incorporate the corresponding potentials progressively, such that for *M *→ ∞ (where *M *is sample set size) the complete form of the JPD is restored. In fact, *M *> 100 is generally sufficient to estimate 2-way marginals in genomics problems, while *P*(*g*_{i}, *g*_{j}, *g*_{k}) requires about an order of magnitude more samples. Thus the current version of ARACNE truncates Eq. (1) at the pairwise interactions level, $H\left(\left\{{g}_{i}\right\}\right)={\displaystyle \sum _{i}{\phi}_{i}}\left({g}_{i}\right)+{\displaystyle \sum _{i,j}{\phi}_{ij}\left({g}_{i},{g}_{j}\right)}$. Within this approximation, all genes for which _{ij }= 0 are declared mutually non-interacting. This includes genes that are statistically independent (i.e., *P*(*g*_{i}, *g*_{j}) ≈ *P*(*g*_{i})*P*(*g*_{j})), as well as genes that do not interact directly but are statistically dependent due to their interaction via other genes (i.e. *P*(*g*_{i}, *g*_{j}) ≠ *P*(*g*_{i})*P*(*g*_{j}), but _{ij }= 0). We note that *P*(*g*_{i}, *g*_{j}) = *P*(*g*_{i})*P*(*g*_{j}) is not a sufficient condition for _{ij }= 0. We discuss this below.

Since the number of potential pairwise interactions is quadratic in *N*, identification of indirect statistical interactions is a formidable challenge for all network reconstruction algorithms that rely on statistical associations. However, under certain biologically realistic assumptions about the network topology, the ARACNE algorithm provides a framework to reconstruct two-way interaction networks reliably from a finite number of samples in a computationally feasible time.

## Algorithm

Within the assumption of a two-way network, all statistical dependencies can be inferred from pairwise marginals, and no higher order analysis is needed. While not implying that this is always the case for biological networks, it is important to understand whether this assumption may allow the inference of a subset of the true interactions with fewer false positives. Thus we identify candidate interactions by estimating pairwise gene expression profile mutual information, *I*(*g*_{i}, *g*_{j}) *I*_{ij}, an information-theoretic measure of relatedness that is zero *iff **P*(*g*_{i}, *g*_{j}) = *P*(*g*_{i})*P*(*g*_{j}). We then filter MIs using an appropriate threshold, *I*_{0}, computed for a specific p-value, *p*_{0}, in the null-hypothesis of two independent genes. This step is basically equivalent to the Relevance Networks method [6] and suffers from the same significant limitations; namely, genes separated by one or more intermediaries (indirect relationships) may be highly co-regulated without implying an irreducible interaction, resulting in numerous false positives.

Thus in its second step, ARACNE removes the vast majority of indirect candidate interactions (_{ij }= 0) using a well-known information theoretic property, the data processing inequality (DPI, discussed in detail later), that has not been previously applied to the reverse engineering of genetic networks.

### Mutual Information

*Mutual information *for a pair of random variables, *x *and *y*, is defined as *I*(*x*, *y*) = *S*(*x*) + *S*(*y*) - *S*(*x*, *y*), where *S*(*t*) is the entropy of an arbitrary variable *t*. For a discrete variable, the *entropy *is $S\left(t\right)=-\langle \mathrm{log}p\left({t}_{i}\right)\rangle =-{\displaystyle \sum _{i}p\left({t}_{i}\right)}\mathrm{log}p\left({t}_{i}\right)$ where *p*(*t*_{i}) = *Prob*(*t *= *t*_{i}) is the probability of each discrete state (value) of the variable (in this work, logarithms are natural). For continuous variables the entropy is infinite but the MI remains well defined and can be computed by replacing *S*(*x*) with the *differential entropy*, which averages the log-probability density rather than the log-mass. Like the more familiar Pearson correlation, MI measures the degree of statistical dependency between two variables. However, while correlation coefficients are not invariant under reparameterizations and may be zero even for manifestly dependent variables, MI is reparameterization invariant and is nonzero *iff *any kind of statistical dependence exists.

#### MI Estimation

We estimate MI using a computationally efficient Gaussian Kernel estimator [12]. Given a set of two-dimensional measurements, ${\overrightarrow{z}}_{i}$ {*x*_{i}, *y*_{i}}, *i *= 1 ... *M*, the JPD is approximated as $f\left(\overrightarrow{z}\right)=1/M{\displaystyle {\sum}_{i}{h}^{-2}}G\left({h}^{-1}\left|\overrightarrow{z}-{\overrightarrow{z}}_{i}\right|\right)$, where *G*(...) is the bivariate standard normal density. With *f*(*x*) and *f*(*y*) being the marginals of *f *($\overrightarrow{z}$), the MI is:

$I\left(\left\{{x}_{i}\right\},\left\{{y}_{i}\right\}\right)=\frac{1}{M}{\displaystyle \sum _{i}\mathrm{log}\frac{f\left({x}_{i},{y}_{i}\right)}{f\left({x}_{i}\right)f\left({y}_{i}\right)}}\text{}\left(2\right)$

Since MI is reparameterization invariant, we copula-transform (i.e., rank-order) [8]* x *and *y *for MI estimation; the range of these transformed variables is thus between 0 and 1, and their marginal probability distributions are manifestly uniform. This decreases the influence of arbitrary transformations involved in microarray data preprocessing and removes the need to consider position-dependent kernel widths, *h*, which might be preferable for non-uniformly distributed data.

For a spatially uniform *h*, the Gaussian kernel MI estimator is asymptotically unbiased for *M *→ ∞, as long as *h*(*M*) → 0 and [*h*(*M*)]^{2}*M *→ ∞. However, for finite *M*, the bias strongly depends on *h*(*M*) and the correct choice is not universal. Fortunately, ARACNE's performance does not depend directly on the accuracy of the MI estimate, *I*, but rather on the accuracy of the estimation of MI ranks. For instance, determining if MI is statistically significant requires testing whether *I*_{ij }≥ *I*_{0}, where *I*_{0 }is the statistical significance threshold. Similarly, the DPI (see below) only requires ranking the MIs.

Producing reliable estimates of the MI ranks is an easier task. From the work on estimation of MI for discrete variables [13], we expect that, for well-sampled marginals and an undersampled joint, the bias is *b *≈ *b*(*Ī*, *h*) (where the bar denotes the true MI). Such biases almost cancel out for similar MI values; the ordering of MI estimates only weakly depends on the choice of *h *and is stable even when MI itself is uncertain (Figure (Figure1).1). Thus a single "ensemble best" value of *h *can be used rather than optimizing the kernel width for each estimate (a computationally intensive operation). This result is general and should apply to any MI rank-based method. However, we emphasize that, since this result is largely empirical, the dependence of MI rank on the strength of smoothing should be reassessed for data sets with substantially different statistical properties before relying on this conclusion.

### Statistical Threshold for Mutual Information

Since MI is always non-negative, its evaluation from random samples gives a positive value even for variables that are, in fact, mutually independent. Therefore, we eliminate all edges for which the null hypothesis of mutually independent genes cannot be ruled out. To this extent, we randomly shuffle the expression of genes across the various microarray profiles, similar to [6], and evaluate the MI for such manifestly independent genes and assign a p-value, *p*, to an MI threshold, *I*_{0}, by empirically estimating the fraction of the estimates below *I*_{0}. This is done for different sample sizes *M *and for 10^{5 }gene pairs so that reliable estimates of *I*_{0}(*p*) are produced up to *p *= 10^{-4}. Extrapolation to smaller p-values is done using $p(I\ge {I}_{0}|\overline{I}=0)\propto {e}^{-\alpha M{I}_{0}}$, where the parameter *α *is fitted from the data. This formula is based on the intuition of the large deviation theory [14], which for discrete data and unbiased estimators suggests $p(I\ge {I}_{0}|\overline{I}=0)\propto {e}^{-M{I}_{0}}$. As MI in the continuous case can be estimated by finely discretizing the variables, a similar result should hold, and *α *accounts for possible biases of the estimator at fixed *h*. This produces an excellent agreement with numerical experiments (see additional file 1: Determination of mutual information statistical significance).

### Data Processing Inequality

The DPI (Figure (Figure2)2) [14] states that if genes *g*_{1 }and *g*_{3 }interact only through a third gene, *g*_{2}, (i.e., if the interaction network is *g*_{1 }↔ ... ↔ *g*_{2 }↔ ... ↔ *g*_{3 }and no alternative path exists between *g*_{1 }and *g*_{3}), then

**Examples of the data processing inequality**.

**(a)**

*g*

_{1},

*g*

_{2},

*g*

_{3}, and

*g*

_{4 }are connected in a linear chain relationship. Although all six gene pairs will likely have enriched mutual information, the DPI will infer the most likely path of information flow. For

**...**

*I*(*g*_{1}, *g*_{3}) ≤ min [*I*(*g*_{1}, *g*_{2}); *I*(*g*_{2}, *g*_{3})]. (3)

Thus the least of the three MIs can come from indirect interactions only, and checking against the DPI may identify those gene pairs for which _{ij }= 0 even though *P*(*g*_{i}, *g*_{j}) ≠ *P*(*g*_{i})*P*(*g*_{j}). Correspondingly, ARACNE starts with a network graph where each *I*_{ij }>*I*_{0 }is represented by an edge (*ij*). The algorithm then examines each gene triplet for which all three MIs are greater than *I*_{0 }and removes the edge with the smallest value. Each triplet is analyzed irrespectively of whether its edges have been marked for removal by prior DPI applications to different triplets. Thus the network reconstructed by the algorithm is independent of the order in which the triplets are examined.

Since this approach focuses only on the reconstruction of pairwise interaction networks, a pair of mutually independent genes, *I*_{ij }<*I*_{0}, will never be connected by an edge. Therefore, interactions represented by higher-order potentials for which the corresponding pairwise potentials are zero will not be recovered (see discussion). Additionally, even for a second order interaction network, one may imagine a situation where the effect of a direct interaction is exactly cancelled out by indirect interactions through other node(s), resulting in _{ij }≠ 0 and *P*(*g*_{i}, *g*_{j}) ≈ *P*(*g*_{i})*P*(*g*_{j}). This situation will not be identified by ARACNE. However, we believe that such precise cancellation is biologically unrealistic and the following theorems specify conditions under which ARACNE will reconstruct the network exactly. Proofs of all theorems can be found in the Appendix A.

#### Theorem 1

If MIs can be estimated with no errors, then ARACNE reconstructs the underlying interaction network exactly, provided this network is a tree and has only pairwise interactions.

However, unlike standard tree reconstruction methods (e.g. Chow and Liu [15]), ARACNE is not limited to trees and can produce complicated structures containing many loops. In fact, because of the following two theorems, ARACNE can be viewed as a natural generalization of the Chow-Liu algorithm which overcomes the biologically-unrealistic tree assumption of the latter.

#### Theorem 2

The Chow-Liu (CL) maximum mutual information tree is a subnetwork of the network reconstructed by ARACNE.

#### Theorem 3

Let *π*_{ik }be the set of nodes forming the shortest path in the network between nodes *i *and *k*. Then, if MIs can be estimated without errors, ARACNE reconstructs an interaction network without false positives edges, provided: (a) the network consists only of pairwise interactions, (b) for each *j * *π*_{ik}, *I*_{ij }≥ *I*_{ik}. Further, ARACNE does not produce any false negatives, and the network reconstruction is exact *iff *(c) for each directly connected pair (*ij*) and for any other node *k*, we have *I*_{ij }≥ min(*I*_{jk}, *I*_{ik}).

Tree networks satisfy all conditions of Theorem 3, while topologies containing loops may or may not. In particular, networks with three-gene loops definitely violate (c) [but may still satisfy (a) and (b)], and *every *such loop will be opened along the weakest edge. For a tree, there is a unique path that connects two nodes. Similarly, for networks that satisfy (a) and (b), the shortest path dominates inter-node information transfer. We call these networks *locally tree-like*. In other words, an interaction is retained by ARACNE if and only if there exist no alternate paths, via one or more intermediaries or branches on the network graph, which are a better explanation for the information exchange between two genes. Since biochemical dynamics is inherently stochastic, statistical interactions over more than a few separating edges are generically weak. Thus we believe that the local tree assumption is biologically realistic, and we expect ARACNE to produce low false positive rates in practice.

Finally, to minimize the impact of the variance of the MI estimator, a tolerance, *τ*, may be introduced such that the DPI inequalities become of the form *I*_{ij }≤ *I*_{ik}(1 - *τ*), and close values of MI are not pruned. For low values of *τ *(<15%) a reasonable tradeoff between true positives and false positives is achieved (see additional file 2: Prediction errors as a function of DPI tolerance). This threshold qualitatively matches the variance of the MI estimator and decreases with increasing sample size. Using such non-zero tolerance leads to persistence of some 3-gene loops.

### Algorithmic Complexity

Because for a network of *N *genes there are at most *N *choose 3 gene triplets, ARACNE's complexity is *O*(*N*^{3 }+ *N*^{2}*M*^{2}), where *M *is the number of samples and *N *is the number of genes. The first term relates to the DPI analysis and the second to the mutual information estimation. This compares favorably with optimization methods that must explore an exponential search space (see Comparative Algorithms). In practice, the DPI is applied to a small subset of triplets for which all three edges survive the mutual information thresholding. Therefore, for large *M*, the computationally intensive part is generally associated with the second term (computing mutual information), which scales as *O*(*N*^{2}*M*^{2}). As a result, ARACNE can efficiently analyze networks with tens of thousands of genes.

## Results

We study ARACNE's performance in reconstructing a class of synthetic networks proposed by [16] and a human B lymphocyte genetic network from gene expressions profile data. The latter has been reported in [17] and will only be recapitulated here. ARACNE's performance is compared against Relevance Networks (RNs) and Bayesian Networks (BNs). RNs are important to characterize the improvement associated with the introduction of the DPI, while BNs have emerged as some of the most widely used reverse engineering methods and provide an ideal comparative benchmark.

### Comparative Algorithms

A *Bayesian Network *is a representation of a JPD as a directed acyclic graph (DAG) whose vertices correspond to random variables {*X*_{1},..., *X*_{n}}, and whose edges correspond to parent-child dependencies among variables; see [10] for an introduction and [18] for a more recent tutorial. We implemented the BN algorithm in this work in accordance with [19,20]. In particular, we score graphs using the Bayesian scoring metric [21], for which we adopt a uniform prior over graphs and employ a Dirichlet prior over parameters to aid in the inference of undersampled conditional distributions of children given their parents. Such an approach inherently penalizes more complex graphs. Learning the most likely network requires exploring the entire graph space for the highest scoring model, which is an NP-complete problem [22]. Thus heuristic procedures are used to search for locally optimal graph structures. The comparative tests presented here use the greedy hill climbing algorithm with random restarts (simulated annealing and other structure search methods were tested and observed to produce similar results). These results were produced using the LibB software package [23], which is among the best implementations of the method.

*Relevance Networks *[6] compute mutual information for all gene pairs in a microarray dataset and infer that two genes are biologically related if their MI is above a certain threshold. This approach is equivalent to the first step in the ARACNE algorithm (i.e., without the DPI); however, we use a more accurate MI estimation procedure than the original implementation and have further developed the method of assigning statistical significance.

### Synthetic Networks

#### Networks Specification

We benchmark the three algorithms using synthetic transcriptional networks proposed by Mendes et al. [16] as a platform for comparison of reverse engineering algorithms. These networks consist of 100 genes and 200 interactions organized either in an Erdös-Rényi (random network) [24] or a scale-free [25] topology (Figure (Figure3).3). In the former, each vertex of a graph is equally likely to be connected to any other vertex; in the latter, the distribution of the number of connections, *k*, associated with each vertex follows a power law, *p*(*k*) ~ *k*^{-γ }with *γ *> 0, and large interactions hubs are present. Many real biological networks appear to exhibit such structure [26].

**Topology of the 100 gene regulatory networks proposed by Mendes**. Blue/red edges correspond to activation/inhibition. For the Erdös-Rényi topology

**(a)**each gene is equally likely to be connected to every other gene, while the scale-free

**...**

The Mendes models use a multiplicative Hill kinetics to approximate transcriptional interactions:

$\frac{d{x}_{i}}{dt}={a}_{i}{\displaystyle \prod _{j=1}^{{N}_{I}}\frac{I{K}_{j}^{{n}_{j}}}{I{K}_{j}^{{n}_{j}}+{I}_{j}^{{n}_{j}}}}{\displaystyle \prod _{l=1}^{{N}_{A}}\left(1+\frac{{A}_{l}^{{m}_{l}}}{A{K}_{l}^{{m}_{l}}+{A}_{l}^{{m}_{l}}}\right)-{b}_{i}{x}_{i},}\text{}\left(4\right)$

where *x*_{i }is the concentration (expression) of the *i*-th gene, *N*_{I }and *N*_{A }are the number of upstream inhibitors and activators respectively, and their concentrations are *I*_{j }and *A*_{l}. All other parameters are specified in [16].

We obtain synthetic expression values of each gene *x*_{i }in each microarray *M*_{k }by simulating its dynamics until the system relaxes to a steady state ${\dot{x}}_{i}\approx 0$. Prior to each simulation, the efficiency of synthesis and degradation reactions are varied by setting *a*_{i }= *λ*_{k,i }${\overline{a}}_{i}$ and *b*_{i }= *γ*_{k,i }${\overline{b}}_{i}$, where ${\overline{a}}_{i}$ and ${\overline{b}}_{i}$ are the original constant values of the parameters, and *λ*_{k,i}, *γ*_{k,i }are random variables uniformly distributed in [0.0, 2.0]. Note that *λ*_{k,i }~ 0.0 corresponds to a gene knock-out, while *λ*_{k,i }~ 2.0 is a 2 fold increase in the synthesis rate. This parameter randomization models the sampling of a population of distinct cellular phenotypes at random time points (at or close to equilibrium), as is the case for the B cell experiments described later, where the efficiency of individual biochemical reactions may be different from assay to assay due to differences in temperature, nutrients, genetic mutations, etc. Although this model is a clear simplification of real biological networks, it forms a reasonably complex interaction network that captures some elements of transcriptional regulation, and an algorithm that does not perform well on this model is unlikely to perform well in a more complex case. Within this model, an interaction is unambiguously defined as a direct regulatory effect of one gene on another. Thus the performance of reverse engineering algorithms can be studied by comparing the inferred statistical interactions to the direct interactions in the model. We specifically note that, to our knowledge, this is the first attempt to benchmark network reverse engineering algorithms based on published objective criteria.

#### Performance metrics

Since genetic networks are sparse, potential false positives (*N*_{FP}), that is, identification of an irreducible statistical interaction between two genes not connected by a direct regulatory link, far exceed potential true positives (*N*_{TP}) [27]. Thus specificity, *N*_{TN}/(*N*_{FP }+ *N*_{TN}), which is typically used in ROC analysis, is inappropriate as even small deviation from a value of 1 will result in large false positive numbers. Therefore, we choose two closely related metrics, precision and recall. Recall, *N*_{TP}/(*N*_{TP }+ *N*_{FN}), indicates the fraction of true interactions correctly inferred by the algorithm, while precision, *N*_{TP}/(*N*_{TP }+ *N*_{FP}), measures the fraction of true interactions among all inferred ones. Note that precision corresponds to the expected success rate in the experimental validation of predicted interactions. Performance will thus be assessed using Precision-Recall Curves (PRCs). PRCs for ARACNE and RNs are generated by adjusting the p-value or, equivalently, the MI threshold. ARACNE's PRC does not extend to 100% recall since the DPI eliminates some interactions even at *p*_{0 }= 1. To reach the 100% recall, the DPI tolerance, *τ*, can be adjusted until ARACNE's PRC degenerates into that of RNs. For BNs, the adjustable parameter is the Dirichlet pseudocount, and, again, we observe that the maximum recall never reaches 100%.

#### Performance Evaluation

As shown in Figure Figure4,4, values of precision and recall for ARACNE are consistently better than those for the other tested methods. That is, for any reasonable precision (i.e. >40%), ARACNE has a significantly higher recall than the other methods, and its precision reaches ~100% at significant recall levels. For large p-values, ARACNE begins to rapidly increase the number of false positives without a corresponding increase in true positives (the right tail of ARACNE's PRC). This is likely because as non-statistically significant MI values are accepted, random fluctuations may arbitrarily change the MI rank so that the DPI removes interactions at random. We note that the inflection of the PRC for ARACNE starts at *p*_{0 }~ 10^{-4}, exactly where we would expect the algorithm to begin inferring large numbers of non-statistically significant interactions for a network of this size. This suggests that a sensible value for the MI threshold, producing a near optimal result, can be selected *a priori *using a Bonferroni-corrected p-value based on the number of potential network interactions.

**Precision vs. Recall for 1,000 samples generated from the Mendes network**.

**(a)**Erdös-Rényi network topology.

**(b)**Scale-free topology. ARACNE's PRCs are consistently better than those of the other algorithms, and the precision reaches ~100%

**...**

ARACNE's high performance can be better understood by analyzing the distribution of MIs as a function of the length of the shortest path connecting each gene pair (degree of connectivity). ARACNE depends on MI being enriched for directly interacting genes and decreasing rapidly with this distance. Figure Figure55 demonstrates these properties for our simulated datasets. There is no unique choice for the MI threshold that separates directly and indirectly interacting genes, and methods such as RNs that attempt to use a single threshold will either recover many indirect connections or miss a substantial number of direct ones. However, since mutual information decreases rapidly as signals travel over the network, the DPI effectively eliminates indirect interactions whose corresponding JPDs do not factorize. For all tested synthetic microarray sizes and both network topologies, ARACNE recovers far more true connections and far fewer false connections than the other methods (Table (Table1).1). Remarkably, in all cases, application of the DPI eliminates almost all indirect candidate interactions inferred by Relevance Networks at the expense of very few true interactions. We note that since ARACNE's performance degrades as the local topology deviates significantly from a tree, it performs slightly better on Erdös-Rényi than on scale-free topologies, for which small loops are more common. Another challenge in reconstructing the scale-free topology derives from the presence of large hubs with high in-degrees, which have small (and thus difficult to estimate) MI with their individual neighbors. However, ARACNE still performs extremely well even on scale-free topologies because signals in this network decorrelate rather quickly, so the statistical properties of a tree-like structure are locally preserved even in the presence of relatively tight loops (see Theorem 3). We note that ARACNE differs significantly from tree reconstruction methods, as the reconstructed topology for the scale-free network (using 1,000 samples) contains ~30 loops with sizes as small as four (see Appendix C for a description of our loop counting algorithm).

**Distribution of mutual information for different lengths of the shortest path between genes for the scale-free topology**. Here we plot the log of the empirical probability that MI for a given separation between genes is above some value (in nats) marked

**...**

In summary, ARACNE appears to (a) achieve very high precision and substantial recall, even for few data points (125), (b) allow an optimal choice of the parameters h (Gaussian Kernel width) (Figure (Figure6)6) and *I*_{0 }(statistical threshold), (c) to be quite stable with respect to the choice of parameters, and (d) to produce robust reconstruction of complex topologies containing many loops.

### Human B Cells

Although large gene expression datasets such as those derived from systematic perturbations to simple organisms (e.g., [5]) are not easily obtained for mammalian cells, we suggest that an equivalent dynamic richness can be efficiently achieved by using a significant set of naturally occurring and experimentally generated phenotypic variations of a given cell type. To this end, we have assembled an expression profile dataset consisting of about 340 B lymphocytes derived from normal, tumor-related, and experimentally manipulated populations (for an extensive description see [28]).

This dataset was deconvoluted using ARACNE to generate a B cell specific regulatory network consisting of approximately 129,000 interactions. Since the c-MYC proto-oncogene emerges as one of the top 5% largest cellular hubs in the complete network and is extensively characterized in the literature as a transcription factor, we performed a first validation of the overall network quality by comparing its interactions inferred by our method with those previously identified by biochemical methods. The *in silico *generated network is highly enriched in known c-MYC targets; 29 out of 56 (51.8%) genes predicted to be first neighbors were either previously reported in the literature or biochemically validated in our labs, using chromatin immunoprecipitation, as c-MYC targets. This is statistically significant (*P *= 2.9 × 10^{-23 }by *χ*^{2 }test) with respect to the expected 11% of background c-MYC targets among randomly selected genes [29]. In addition, known c-MYC target genes were significantly more enriched among first neighbors than among second neighbors (51.8% vs. 19.4%), indicating that ARACNE is effective at separating direct regulatory interactions from indirect ones. Biological results related to the complete network structure are described in detail in [17].

## Discussion

ARACNE, which is motivated by statistical mechanics and based on an information theoretic approach, provides a provably exact network reconstruction under a controlled set of approximations. While we have shown that these approximations are reasonable even for complex mammalian gene networks, they may cause the algorithm to fail for some control structures. First, ARACNE will open all three-gene loops along the weakest interaction, and therefore introduce false negatives for triplets of interacting genes (although some may be preserved when a nonzero DPI threshold is used). Improvements to the algorithm are being investigated to address this condition. Second, by truncating Eq. (1) at the pairwise interactions, ARACNE will not infer statistical dependencies that are not expressed as pairwise interaction potentials (such as an XOR Boolean table for which MI between any gene pair is zero). By expanding Eq. (1) to include third and higher order potentials our formulation, in principle, can be extended to distinguish higher order interactions as well [30]. However, we note that in practice (i.e., biochemically) it is difficult to produce *only *higher order interactions without introducing some lower order dependencies [9], and truncation of the Hamiltonian is not likely to produce serious systematic errors in identifying interactions between gene pairs. In fact, the Mendes networks contain higher order interactions, but corresponding pairwise ones are effectively recovered instead. Another limitation of ARACNE is the inability to infer edge directionality, although we believe this to be a general limitation of all methods that do not use temporal data. We intend to investigate a two-tier approach in which first adirectional gene interactions are inferred, and then edge directionality is assessed via regression algorithms or specific biochemical perturbations.

Because mRNA abundance measurements only serve as a proxy for the interacting molecular species (i.e., activated protein concentrations), the type of physical interactions corresponding to the irreducible statistical dependencies identified by ARACNE are not always clear. For example, if the activity of a transcription factor is primarily mediated by an activating enzyme, rather than by changes in its mRNA abundance level, we expect ARACNE to identify dependencies between this enzyme and the target genes of the transcription factor. Moreover, a violation of the algorithm's hypotheses may occur for proteins involved in stable complex formation. Since it is energetically efficient for the cell to produce a stochiometrically balanced concentration of proteins involved in stable complexes (e.g., the ribosomal units), evolution has finetuned the transcriptional control of these proteins so that their concentrations are balanced. Thus, regardless of the concentration of the several transcription factors (TF) that may control their expression, the correlation between the final protein concentrations is generally higher than that between each protein and each individual TF. This violates the assumptions of Theorem 3 and produces irreducible statistical interactions between protein pairs involved in stable complex formation. Therefore, we expect some edges to correspond to protein-protein interactions, although we note that this situation would be correctly handled if higher order dependencies were analyzed.

Finally, we end with the following observation. Since ARACNE may fail for topologies with many tight loops, it is important to understand whether an analyzed topology is, in fact, locally tree like, and, therefore, the reconstruction can be trusted. We suggest two heuristics. First, loopy topologies continue to have more loops after reconstruction (results not shown). Thus an excessive number of loops in a deconvolved network should serve as a warning sign (Appendix C); more analysis is required to determine an acceptable range for this statistic. Second, as in the current analysis, predictions made by ARACNE (or, for that matter, any other computational algorithm) should be directly experimentally verified.

## Conclusion

The goal of ARACNE is not to recover *all *transcriptional interactions in a genetic network but rather to recover *some *transcriptional interactions with high confidence. Within this scope, ARACNE overcomes several limitations that have impeded the application of previous methods to the genome-wide analysis of mammalian networks. It has a low computational complexity, does not require discretization of the expression levels, and does not rely on unrealistic network models or *a priori *assumptions. The algorithm can be applied to arbitrarily complex networks of transcriptional, or any other, interactions without reliance on heuristic search procedures. Thus we expect ARACNE to be well suited for mammalian gene regulatory networks, which are characterized by a complex topology, do not benefit from well-defined supplemental data (such as comprehensive protein interaction databases available for yeast), and are more difficult to manipulate experimentally, substantially hindering the acquisition of data to which time-series based methods can be applied. There are currently no other examples of a genome-wide mammalian network inferred from microarray expression profiles.

ARACNE's high precision in reconstructing a synthetic network designed to simulate transcriptional interactions, as well as the inference of bona-fide targets of c-MYC, a known transcription factor, in human B cells, suggest ARACNE's promise in identifying direct transcriptional interactions with low false-positive rates in mammalian networks, an obvious challenge for all reverse engineering algorithms. More research is needed to precisely characterize other types of interactions corresponding to irreducible statistical dependencies identified by ARACNE. We suggest that predictions made by ARACNE can be used in conjunction with other data modalities such as genome-wide location data, DNA sequence information, or targeted biochemical experiments to progress towards this level of detail. We plan to investigate this possibility using a model organism platform as well as extensions to the simulation model. However, studies based on targeted perturbations to model organisms have demonstrated the promise of using conceptual "gene-gene" networks to elucidate functional mechanisms underlying cellular processes [31] as well as to identify molecular targets of pharmacological compounds [32]. ARACNE may provide a framework to enable such applications in a mammalian context.

## Appendices

### Appendix A – Proofs of Theorems

#### Theorem 1

If MIs can be estimated with no errors, then ARACNE reconstructs the underlying interaction network exactly, provided this network is a tree and has only pairwise interactions.

##### Proof of Theorem 1

First, notice that for every pair of nodes *i *and *k *not connected by a true direct interaction there is at least one other node *j *that separates them on the network tree. Applying the DPI to the (*ijk*) triplet leads to removal of the (*ik*) edge. Thus only true edges survive. Similarly, every removed edge is not present in the true network. Consider some (*ijk*) triplet. One of these nodes, say *j*, may separate the other two. In this case the removed edge (*ik*) is clearly not in the true tree. Alternatively, there may be no separating node, and one may be able to move between any pair in the triplet without going through the third one. In this case none of the three edges is in the true graph, and any edge the DPI removes is fictitious. Thus all removed edges are indirect, while all remaining edges are factual. The network is reconstructed exactly.

#### Theorem 2

The Chow-Liu (CL) maximum mutual information tree is a subnetwork of the network reconstructed by ARACNE.

##### Proof of Theorem 2

We notice that, without a loss of generality, we can assume that the Chow-Liu tree and the ARACNE construction span all the nodes of the network. If this is not the case, that is, a few connected clusters exist (separated by edges with zero MI), then for the purpose of this theorem we can complete CL and ARACNE structures by the same edges with zero MI without formation of additional loops, till they become spanning. Now suppose that the theorem is false and there exists an edge (*ij*) that belongs to the (completed) CL tree, but does not belong to the ARACNE reconstruction. Since the CL construct is a tree, this edge separates it into two separate trees *T*_{i }and *T*_{j }that contain the *i*'th and the *j*'th nodes respectively. Since ARACNE has removed the (*ij*) link, there exists a node *k*, for which min(*I*_{ik}, *I*_{jk}) >*I*_{ij}. Without a loss of generality, let *k *be in *T*_{i}. Then replacing the (*ij*) edge in the Chow-Liu tree by the (*jk*) edge will form no loops and will preserve the tree structure. This will increase the total MI of the CL reconstruction by *I*_{jk }- *I*_{ij }> 0. Thus the original tree is not the maximum MI tree. We arrive at a contradiction, which proves the theorem.

#### Theorem 3

Let *π*_{ik }be the set of nodes forming the shortest path in the network between nodes *i *and *k*. Then, if MIs can be estimated without errors, ARACNE reconstructs an interaction network without false positives edges, provided: (a) the network consists only of pairwise interactions, (b) for each *j * *π*_{ik}, *I*_{ij }≥ *I*_{ik}. Further, ARACNE does not produce any false negatives, and the network reconstruction is exact *iff *(c) for each directly connected pair (*ij*) and for any other node *k*, we have *I*_{ij }≥ min(*I*_{jk}, *I*_{ik}).

##### Proof of Theorem 3

To prove the absence of false positives, we notice that, for every candidate edge (*ik*) that is not actually in the network, there is at least one node *j*, such that *j * *π*_{ik}. Applying DPI to the (*ijk*) triplet will remove the (*ik*) edge. Further, we notice that if (c) is satisfied, then any application of DPI will not remove a true edge. However, if (c) does not hold, a true edge will be removed. This completes the proof.

### Appendix B – Relations to Graphical Models and Statistical Physics

The definition of dependencies employed in the paper, which is based on the presence of a potential that couples interacting genes in the JPD,

$P\left(\left\{{g}_{i}\right\}\right)=\frac{1}{Z}\mathrm{exp}\left[-{\displaystyle \sum _{i}{\phi}_{i}\left({g}_{i}\right)-{\displaystyle \sum _{i,j}{\phi}_{ij}\left({g}_{i},{g}_{j}\right)-}{\displaystyle \sum _{i,j,k}{\phi}_{ijk}\left({g}_{i},{g}_{j},{g}_{k}\right)}}-\cdots \right]\equiv {e}^{-H\left(\left\{{g}_{i}\right\}\right)}\text{}\left(5\right)$

is similar to that used in the theory of graphical models, specifically Markov Networks (MNs) [10]. However, even though there are some dissenting formulations (e.g., [33]), the usual implementation of MNs [10] is built using the notion of conditional (in)dependence. In this context it is impossible to distinguish, for example, a clique of three genes that are fully coupled by three pairwise interactions from the same genes coupled by a third order dependence, and also from a combination of both cases. Because of this, many authors use a convention that if a higher order potential ... is present in Equation 1, then all lower order potentials that depend only on a subset of the genes coupled by ... are incorporated into it. In contrast, the definition of [9], followed in this paper, aims at discriminating interaction orders. Thus, in our case, a three gene pairwise loop is distinct from a three-way interaction. In fact, extensions of ARACNE to deal with the latter have been developed [30], while the former still requires work.

As is understood in the graphical models literature, the formulation of Equation 1 resembles some statistical mechanics problems, specifically spin glasses on random networks [33,34], particularly if the *g*_{i }are binary (such discretization of expression levels is a common technique to deal with undersampling). In this case, the genes are the Ising spins, and truncations to the first, second, or the third order potentials are steps towards the mean field, Bethe, and Kikuchi variational approximations [33,35-37]. An important distinction is that in statistical physics one searches for $\tilde{P}$({*g*_{i}}), a variational approximation to the true JPD, *P*({*g*_{i}}), that minimizes ${D}_{KL}\left(\tilde{P}\Vert P\right)\equiv {\langle \mathrm{log}\tilde{P}/P\rangle}_{\tilde{P}}$ within a given class of $\tilde{P}$, while the definition of [9] is equivalent to minimizing *D*_{KL }(*P*||$\tilde{P}$). This is because statistical physics solves a direct problem – calculating various spin statistics given an interaction network. In particular, low order marginals *P*_{L }are unknown and cannot be used in averaging. On the other hand, we are here solving the inverse problem – reconstructing the network given the known true marginal distributions.

ARACNE, which truncates Equation 1 at the second order potentials, is an analog of the Bethe approximation for the direct problem. Just like this approximation and the associated belief propagation algorithm [10,38], ARACNE may fail for loopy topologies. It is, therefore, appealing that, for locally tree-like networks, the algorithm still works well, paralleling the corresponding discussion in statistical physics [38].

### Appendix C – Counting Loops in an Undirected Adjacency Matrix

A pairwise interaction network can be represented by an adjacency matrix *A*_{ij}, where *A*_{ij }= 1,0 denotes either presence or absence of the corresponding interaction. To test the effect of violation of the "locally tree-like" assumption on the performance of the algorithm, we need to be able to count the number of cycles (loops) in a given network. This is complicated by the fact that the total number of cycles in a graph is not equal to the number of independent cycles; that is the number of edges that need to be removed to transform the graph into a tree. We need to count the number of independent cycles only. Additionally, of all possible complete sets of independent cycles we are interested in identifying the one with the smallest loops (since small loops have the highest potential to violate the locally tree-like assumption). We suggest the following algorithms to solve this task approximately.

1) We prune the nodes that have 0 or 1 neighbors in the adjacency matrix *A *(since such nodes cannot be part of any loops).

2) We transform the undirected network *A *into a directed one *B*. For this we identify every *A*_{ij }≠ 0 in the original network with a node in the new network (edges *ij *and *ji *are represented by separate nodes). If the original network had *A*_{ij }= *A*_{jk }= 1, *i *≠ *k*, then *B*_{(ij),(jk) }= 1 otherwise *B*_{(ij),(kl) }= 0.

3) We evaluate integer powers of the matrix *B*. If *Tr*(*B*^{n}) > 0, a loop (or loops) of size *n *are present. For the smallest *n *with loops, we identify one of them (at random), record nodes that form it, and remove one of these nodes in *B *(i.e., edges in *A*).

4) We repeat 1–3 till no more loops are found.

## Authors' contributions

AAM: Conducted research, designed study, participated in design of algorithm, wrote manuscript. IN: Designed theoretical framework, participated in design of algorithm, wrote manuscript. KB: Performed biochemical validation. CW: Participated in design of study. GS: Participated in design of algorithm and validation. RDF: Supervised and designed biochemical validation. AC: Designed algorithm, supervised research, wrote manuscript. All authors read and approved the final manuscript.

## Supplementary Material

**Additional File 1:**

Determination of mutual information statistical significance. P-values are assigned to MI thresholds using a Monte Carlo simulation for different kernel widths, sample sizes (*M*) and for 10^{5 }gene pairs so that reliable estimates are produced up to *p *= 10^{-4 }(solid lines). Extrapolation to smaller p-values is done using $p(I\ge {I}_{0}|\overline{I}=0)\propto {e}^{-\alpha M{I}_{0}}$ (dotted lines).

^{(10K, eps)}

**Additional File 2:**

Prediction errors as a function of DPI tolerance. The number of inferred errors, *N*_{FP }+ *N*_{FN}, are plotted as a function of the DPI tolerance, *τ*, for **(a) **the Erdös-Rényi and **(b) **the scale-free topologies. Raising *τ *to a value of 0.2 results in a modest increase in false positives, while larger values of *τ *produce a much sharper increase. Therefore, a moderate choice for the tolerance can help elucidate additional interactions without introducing an excessive number of false positives. Results are calculated for a statistical significance threshold of 10^{-4 }and a synthetic microarray size of 1,000.

^{(14K, pdf)}

**Additional File 3:**

MI distribution for different shortest path lengths for the Erdös-Rényi topology. Red and black arrows are explained in the legend of Figure Figure5.5. Since there are no large in-degree hubs, decorrelation is slower than for the scale-free network, and MI statistics even for fifth neighbors is still distinguishable from the background.

^{(61K, eps)}

## Acknowledgements

This work was supported by the NCI (1R01CA109755-01A1) and the NIAID (1R01AI066116-01). AAM is supported by the NLM Medical Informatics Research Training Program (5 T15 LM007079-13).

## References

- Eisen MB, Spellman PT, Brown PO, Botstein D. Cluster analysis and display of genome-wide expression patterns. Proc Natl Acad Sci U S A. 1998;95:14863–14868. doi: 10.1073/pnas.95.25.14863. [PMC free article] [PubMed] [Cross Ref]
- Ma S-K. Statistical mechanics. Singapore: World Scientific; 1985.
- van Someren EP, Wessels LF, Backer E, Reinders MJ. Genetic network modeling. Pharmacogenomics. 2002;3:507–525. doi: 10.1517/14622416.3.4.507. [PubMed] [Cross Ref]
- Friedman N. Inferring cellular networks using probabilistic graphical models. Science. 2004;303:799–805. doi: 10.1126/science.1094068. [PubMed] [Cross Ref]
- Ideker T, Thorsson V, Ranish JA, Christmas R, Buhler J, Eng JK, Bumgarner R, Goodlett DR, Aebersold R, Hood L. Integrated genomic and proteomic analyses of a systematically perturbed metabolic network. Science. 2001;292:929–934. doi: 10.1126/science.292.5518.929. [PubMed] [Cross Ref]
- Butte AJ, Kohane IS. Mutual information relevance networks: functional genomic clustering using pairwise entropy measurements. Pac Symp Biocomput. 2000:418–429. [PubMed]
- Wiggins C, Nemenman I. Process pathway inference via time series analysis. Experimental Mechanics. 2003;43:361–370. doi: 10.1177/00144851030433016. [Cross Ref]
- Joe H. Multivariate models and dependence concepts. Boca Raton, FL: Chapman & Hall; 1997.
- Nemenman I. Information theory, multivariate dependence, and genetic network inference. Tech Rep NSF-KITP-04-54, KITP, UCSB. 2004. arXiv: q-bio/0406015.
- Pearl J. Probabilistic reasoning in intelligent systems: networks of plausible inference. San Francisco, CA: Morgan Kaufmann Publishers, Inc; 1988.
- Janes ET. Information theory and statistical mechanics. Phys Rev. 1957;106:620–630. doi: 10.1103/PhysRev.106.620. [Cross Ref]
- Beirlant J, Dudewicz E, Gyorfi L, van der Meulen E. Nonparametric entropy estimation: An overview. Int J Math Stat Sci. 1997;6:17–39.
- Strong SP, Koberle R, de Ruyter van Steveninck R, Bialek W. Entropy and information in neural spike trains. Phys Rev Lett. 1998;80:197–200. doi: 10.1103/PhysRevLett.80.197. [Cross Ref]
- Cover TM, Thomas JA. Elements of Information Theory. New York: John Wiley & Sons; 1991.
- Chow CK, Liu CN. Approximating discrete probability distributions with dependence trees. IEEE Trans Inf Thy. 1968;IT-14:462–467. doi: 10.1109/TIT.1968.1054142. [Cross Ref]
- Mendes P, Sha W, Ye K. Artificial gene networks for objective comparison of analysis algorithms. Bioinformatics. 2003;19:II122–II129. [PubMed]
- Basso K, Margolin AA, Stolovitzky G, Klein U, Dalla-Favera R, Califano A. Reverse engineering of regulatory networks in human B cells. Nat Genet. 2005;37:382–390. doi: 10.1038/ng1532. [PubMed] [Cross Ref]
- Heckerman D. A Tutorial on Learning with Bayesian Networks. Microsoft Research. 1996.
- Hartemink AJ, Gifford DK, Jaakkola TS, Young RA. Using graphical models and genomic expression data to statistically validate models of genetic regulatory networks. Pac Symp Biocomput. 2001:422–433. [PubMed]
- Yu J, Smith AV, Wang PP, Hartemink AJ, Jarvis ED. Using Bayesian Network Inference Algorithms to Recover Molecular Genetic Regulatory Networks. 3rd International Conference on Systems Biology. 2002.
- Cooper GF, Herskovits E. A Bayesian method for the induction of probabilistic networks from data. Machine Learning. 1992;9:309–347.
- Chickering DM. Learning Bayesian networks is NP-complete. In: Fisher DaL H, editor. Learning from Data: Artificial Intelligence and Statistics. New York: Springer-Verlag; 1996. pp. 121–130.
- Friedman N, Elidan G. LibB 2.1 http://www.cs.huji.ac.il/labs/compbio/LibB/
- Erdos P, Renyi A. On Random Graphs. Publ Math Debrecen. 1959;6:290–297.
- Barabasi AL, Albert R. Emergence of scaling in random networks. Science. 1999;286:509–512. doi: 10.1126/science.286.5439.509. [PubMed] [Cross Ref]
- Newman MEJ. The Structure and Function of Complex Networks. SIAM Review. 2003;45:167–256. doi: 10.1137/S003614450342480. [Cross Ref]
- Yeung MK, Tegner J, Collins JJ. Reverse engineering gene networks using singular value decomposition and robust regression. Proc Natl Acad Sci USA. 2002;99:6163–6168. doi: 10.1073/pnas.092576199. [PMC free article] [PubMed] [Cross Ref]
- Klein U, Tu Y, Stolovitzky GA, Mattioli M, Cattoretti G, Husson H, Freedman A, Inghirami G, Cro L, Baldini L, et al. Gene expression profiling of B cell chronic lymphocytic leukemia reveals a homogeneous phenotype related to memory B cells. J Exp Med. 2001;194:1625–1638. doi: 10.1084/jem.194.11.1625. [PMC free article] [PubMed] [Cross Ref]
- Fernandez PC, Frank SR, Wang L, Schroeder M, Liu S, Greene J, Cocito A, Amati B. Genomic targets of the human c-Myc protein. Genes Dev. 2003;17:1115–1129. doi: 10.1101/gad.1067003. [PMC free article] [PubMed] [Cross Ref]
- Wang K, Nemenman I, Banerjee N, Margolin AA, Califano A. Genome-wide Discovery of Modulators of Transcriptional Interactions in Human B Lymphocytes. Proceedings of the 10th Intl Conf on Res In Comp Mol Biol (RECOMB), Venice Apr 2006.
- Tegner J, Yeung MK, Hasty J, Collins JJ. Reverse engineering gene networks: integrating genetic perturbations with dynamical modeling. Proc Natl Acad Sci USA. 2003;100:5944–5949. doi: 10.1073/pnas.0933416100. [PMC free article] [PubMed] [Cross Ref]
- Gardner TS, di Bernardo D, Lorenz D, Collins JJ. Inferring genetic networks and identifying compound mode of action via expression profiling. Science. 2003;301:102–105. doi: 10.1126/science.1081900. [PubMed] [Cross Ref]
- Yedidia J. An idiosyncratic journey beyond mean field theory. In: Opper M, Saad D, editor. Advanced Mean Field Methods: Theory and Practice. Cambridge, MA: MIT Press; 2001.
- Mezard M, Parizi G. The Bethe lattice spin glass revisited. Eur Phys J B. 2001;20:217.
- Bethe H. Statistical Theory of Superlattices. Proc Roy Soc London A. 1935;150:552.
- Kikuchi R. A Theory of Cooperative Phenomena. Phys Rev. 1951;81:988. doi: 10.1103/PhysRev.81.988. [Cross Ref]
- Opper M, Winther O. From naive mean field theory to the TAP equations. In: Opper M, Saad D, editor. Advanced mean field methods: theory and practice. Cambridge, MA: MIT Press; 2001.
- Yedidia JS, Freeman WT, Weiss Y. Generalized Belief Propagation. Advances in Neural Information Processing Systems (NIPS) 2001;13:689–695.

**BioMed Central**

## Formats:

- Article |
- PubReader |
- ePub (beta) |
- PDF (797K) |
- Citation

- TimeDelay-ARACNE: Reverse engineering of gene networks from time-course data by an information theoretic approach.[BMC Bioinformatics. 2010]
*Zoppoli P, Morganella S, Ceccarelli M.**BMC Bioinformatics. 2010 Mar 25; 11:154. Epub 2010 Mar 25.* - Reverse engineering cellular networks.[Nat Protoc. 2006]
*Margolin AA, Wang K, Lim WK, Kustagi M, Nemenman I, Califano A.**Nat Protoc. 2006; 1(2):662-71.* - Fast calculation of pairwise mutual information for gene regulatory network reconstruction.[Comput Methods Programs Biomed. 2009]
*Qiu P, Gentles AJ, Plevritis SK.**Comput Methods Programs Biomed. 2009 May; 94(2):177-80. Epub 2009 Jan 22.* - Computational and experimental approaches for modeling gene regulatory networks.[Curr Pharm Des. 2007]
*Goutsias J, Lee NH.**Curr Pharm Des. 2007; 13(14):1415-36.* - Inferring regulatory networks.[Front Biosci. 2008]
*Li H, Xuan J, Wang Y, Zhan M.**Front Biosci. 2008 Jan 1; 13:263-75. Epub 2008 Jan 1.*

- Reconstruction of large-scale regulatory networks based on perturbation graphs and transitive reduction: improved methods and their evaluation[BMC Systems Biology. ]
*Pinna A, Heise S, Flassig RJ, Fuente AD, Klamt S.**BMC Systems Biology. 773* - Nucleotide excision repair/transcription gene defects in the fetus and impaired TFIIH-mediated function in transcription in placenta leading to preeclampsia[BMC Genomics. ]
*Moslehi R, Ambroggio X, Nagarajan V, Kumar A, Dzutsev A.**BMC Genomics. 15373* - Identification of direction in gene networks from expression and methylation[BMC Systems Biology. ]
*Simcha DM, Younes L, Aryee MJ, Geman D.**BMC Systems Biology. 7118* - Decision tree-based method for integrating gene expression, demographic, and clinical data to determine disease endotypes[BMC Systems Biology. ]
*Williams-DeVane CR, Reif DM, Cohen Hubal E, Bushel PR, Hudgens EE, Gallagher JE, Edwards SW.**BMC Systems Biology. 7119* - How Difficult Is Inference of Mammalian Causal Gene Regulatory Networks?[PLoS ONE. ]
*Djordjevic D, Yang A, Zadoorian A, Rungrugeecharoen K, Ho JW.**PLoS ONE. 9(11)e111661*

- MedGenMedGenRelated information in MedGen
- PubMedPubMedPubMed citations for these articles
- TaxonomyTaxonomyRelated taxonomy entry
- Taxonomy TreeTaxonomy Tree

- ARACNE: An Algorithm for the Reconstruction of Gene Regulatory Networks in a Mam...ARACNE: An Algorithm for the Reconstruction of Gene Regulatory Networks in a Mammalian Cellular ContextBMC Bioinformatics. 2006; 7(Suppl 1)S7

Your browsing activity is empty.

Activity recording is turned off.

See more...