- We are sorry, but NCBI web applications do not support your browser and may not function properly. More information

- Journal List
- BMC Bioinformatics
- v.8; 2007
- PMC1802094

# Boolean networks using the chi-square test for inferring large-scale gene regulatory networks

^{1}Interdisciplinary Program in Bioinformatics, Seoul National University, South Korea

^{2}Division of Biostatistics and Epidemiology, University of Virginia, USA

^{3}Department of Statistics, Seoul National University, Seoul, South Korea

^{}Corresponding author.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

## Abstract

### Background

Boolean network (BN) modeling is a commonly used method for constructing gene regulatory networks from time series microarray data. However, its major drawback is that its computation time is very high or often impractical to construct large-scale gene networks. We propose a variable selection method that are not only reduces BN computation times significantly but also obtains optimal network constructions by using chi-square statistics for testing the independence in contingency tables.

### Results

Both the computation time and accuracy of the network structures estimated by the proposed method are compared with those of the original BN methods on simulated and real yeast cell cycle microarray gene expression data sets. Our results reveal that the proposed chi-square testing (CST)-based BN method significantly improves the computation time, while its ability to identify all the true network mechanisms was effectively the same as that of full-search BN methods. The proposed BN algorithm is approximately 70.8 and 7.6 times faster than the original BN algorithm when the error sizes of the Best-Fit Extension problem are 0 and 1, respectively. Further, the false positive error rate of the proposed CST-based BN algorithm tends to be less than that of the original BN.

### Conclusion

The CST-based BN method dramatically improves the computation time of the original BN algorithm. Therefore, it can efficiently infer large-scale gene regulatory network mechanisms.

## Background

The advancement of high-throughput technologies, such as DNA chips, has enabled the study of interactions and regulations among genes on a genome-wide scale. Recently, many algorithms have been introduced to determine gene regulatory networks based on such high-throughput microarray data, including linear models [1,2], Boolean networks [3-6], Bayesian networks [7,8], neural networks [9], and differential equations [1,10].

In the linear modeling of a genetic network, the expression data is fitted using a regression model, where the change in expression levels is a response for all other genes [1]. Although such standard linear modeling approaches enable the analysis of many different features of the modeled system, they are not effective in genome-wide network discovery. This is because the number of candidate parameters and models is very high and therefore it is difficult to search efficiently and reliably with tight control on many false positives.

Bayesian network algorithms have limitations with regard to the determination of an important network structure because of their complex modeling strategies (with a large number of parameters to be estimated) and a long computation time for searching all potential network structures on genome-wide expression data. These limitations of the Bayesian network may be overcome by the dynamic Bayesian network (DBN), which models the stochastic evolution of a set of random variables over time [11,12]. Although some improvements have been proposed, the accuracy of prediction of the DBN is relatively low, and its excessive computational time is still very high [13].

Recently, studies on the hierarchical scale-free network in lower organisms [14,15] have indicated the necessity of a network method for the simultaneous analysis of thousands of genes. The human B-cell network analysis using mutual information [16] is a type of hierarchical scale-free analysis. Although this analysis successfully constructs gene networks with thousands of genes, the method is based on mutual information between two genes; therefore, it cannot obtain the response of a target gene when more than two genes simultaneously affect the target gene.

Among these methods, the Boolean network (BN) is useful to construct gene regulatory networks observed by high-throughput microarray data because it can monitor the dynamic behavior in complex systems based on its binarization of such massive expression profiling data [17,18]. The Boolean function of a gene in a BN can describe the behavior of the target gene according to simultaneous changes in the expression levels of the other genes.

### Boolean networks

BN models were first introduced by Kauffman [3]. In these models, a gene expression is simplified with two levels: ON and OFF. A BN *G*(*V*, *F*) is defined by a set of node *V *= {*x*_{1}, ..., *x*_{n}} and a set of Boolean functions *F *= {*f*_{1}, ..., *f*_{n}}. A Boolean function *f*_{i}(*x*_{1}, ..., *x*_{k}), where *i *= {1, ..., *n*}, with *k *specified input nodes (indegree) is assigned to node *x*_{i}. The regulation of nodes is defined by *F*. More specifically, given the values of the node (*V*) at time *t *- 1, the Boolean function are used to update these values at time *t*.

The model system has been developed into a so-called Random BN model [19]. BNs have attracted attention since the introduction of probabilistic Boolean network (PBN) models by Shmulevich *et al*. [6]. Many algorithms have been proposed for the inference of BNs. For example, the REVEAL algorithm has been introduced by Liang *et al*. [5] for causal inference by using mutual information, which is the most fundamental and general measure of correlation. Akutsu *et al*. [4] have constructed a BN structure based on the consistency problem, which can be used to determine the existence of a network that is consistent with the observed data. In one of the most recent studies on the BN algorithm, the Best-Fit Extension problem [20] is used for the inference of PBNs [6]. In PBNs, every node (gene) can have a chance of acquiring different Boolean functions. The probabilistic selection of Boolean functions adds flexibility in the determination of the steady state of BNs and monitoring of the dynamical network behavior for gene perturbation or intervention [18,21].

Recently, several software packages have been developed for constructing BNs. The random BN toolbox [22] and the PBN toolbox [6] are available in Matlab. NetBuilder (version 0.94) [23] is a genetic regulatory network tool used to simulate genetic network using a BN. The BN has been widely used to describe biological processes. For example, Huang [17] has used these networks to represent cell growth, cell differentiation, and apoptosis. A transcriptional network model in yeast has been studied using a random BN [24]. Further, Johnson [25] has studied the signal transduction pathways in a B-cell ligand screen.

### Advantages and disadvantages of Boolean networks

The estimation of gene regulatory networks using the BN offers several advantages. First, the BN model effectively explains the dynamic behavior of living systems [17,18,26]. Simplistic Boolean formalism can represent realistic complex biological phenomena such as cellular state dynamics that exhibit switch-like behavior, stability, and hysteresis [17]. It also enables the modeling of non-linear relations in complex living systems [27]. Second, Boolean algebra is an established science that provides a large set of algorithms that are already available for supervised learning in the binary domain, such as the logical analysis of data [28], and Boolean-based classification algorithms [29]. Finally, dichotomization to binary values improves the accuracy of classification and simplifies the obtained models by reducing the noise level in experimental data [30,31].

However, the BN has some drawbacks. One of the major drawbacks is that it requires extremely high computing times to construct reliable network structures. Therefore, most BN algorithms such as REVEAL can thus be used only with a small number of genes and a low indegree value. For higher indegree values, these algorithms should be accelerated through parallelization in order to increase the search efficiency in the solution space [5]. The consistency problem [4] works in time complexity *O*(${2}^{{2}^{k}}$·$\left(\begin{array}{c}n\\ k\end{array}\right)$·*m*·*n*·*poly*(*k*)) (*m *is the number of observed time points; *n*, the total number of genes; and *poly*(*k*), the time required to compare a pair of examples respectively) for a fixed indegree *k*; this is because ${2}^{{2}^{k}}$ Boolean functions must be checked for each of the possible _{n}*C*_{k }combinations of variables and for *m *observations. The Best-Fit Extension problem [21] also works in time complexity *O*(${2}^{{2}^{k}}$·$\left(\begin{array}{c}n\\ k\end{array}\right)$·*m*·*n*·*poly*(*k*)). Although the improved consistency algorithm and Best-Fit Extension problem work in time complexity *O*($\left(\begin{array}{c}n\\ k\end{array}\right)$·*m*·*n*·*poly*(*k*)) [32], they still exhibit an exponential increase in the computing time for the parameters *n *and *k*. Such high computing times are a major problem in the study of large-scale gene regulatory and gene interaction systems using BNs.

### Chi-square-test-based Boolean network

In order to overcome the time complexity problem of the BN method, we propose a variable selection method based on the chi-square test (CST). The proposed CST-based BN adopts the Best-Fit Extension problem, which is commonly used in the PBN to effectively determine all possible relevant Boolean functions. In our method, the maximum indegree of networks is assumed to be three. We also focus on the Boolean functions that comprise three different literals (input genes in the Boolean function). Each literal is connected by the three Boolean operators NOT(¬), AND(∧), OR(); for example, *f *= *X*1 ∧ ¬*X*2 *X*3. Then, the time complexity of the CST-based BN reduces to *O*(${2}^{{2}^{k}}\cdot {\displaystyle {\sum}_{j=1}^{n}{\displaystyle {\sum}_{i=1}^{{n}_{1,j}}\cdot \left(\begin{array}{c}{n}_{2,ij}\\ k\end{array}\right)}}$·*m*·*poly*(*k*)), where *n *is the total number of genes, *k *is the indegree, *m *is the total number of time points, *n*_{1, j }is the number of first selected genes for the *j*th gene, and *n*_{2, ij }is the number of second selected genes when the *i*th gene is selected in the first step. We have found that the dichotomization of the continuous gene expression values allows us to efficiently perform the independence test for a two-way contingency table on each pairwise network mechanisms. We use the CST to identify genes that are associated with a target gene. A target gene would be expressed in accordance with a Boolean function related to the selected genes. Since the genes have only two levels, (0 and 1), we use 2 × 2 and 2 × 2 × 2 contingency tables to identify the relationship between two and three genes respectively. The proposed method is used along with the Best-Fit Extension problem. This method is described in detail in the Methods section.

## Results

### Simulation study

For our simulation study, an artificially generated network structure is illustrated in Figure Figure1.1. It comprises 40 nodes and the maximum value of the indegree (*k*) is three. The network structure is composed of 27 Boolean functions that are randomly generated from 40 nodes. Forty sets of binary data are obtained sequentially from the network structure. Each data set has different initial states and seven time points. Since the data sets are generated from definite Boolean functions, the genes in the Boolean functions tend to have strong associations. The CST-based BN uses two thresholds *α*_{1 }and *α*_{2 }where *α*_{1 }is used for selecting variables for the main effect and *α*_{2 }is used for the conditional effect. A detailed description is provided in the Methods section. The smaller the values of *α*_{1 }and *α*_{2}, the stronger is the association of the variables. In order to select the nodes that have strong associations with the target nodes, we used very small cutoff values – *α*_{1 }= 1 - *e*15 and *α*_{2 }= 1 - *e*15 – for the CST-based BN. Table Table11 shows the result of the original BN and the CST-based BN for various noise levels. The random noise is added to the binary data generated sequentially by the Boolean functions. For example, if the noise level is 0.1%, a Boolean function, which generates 1 when the noise level is zero generates 1 with a probability of 99.999 and generates 0 with a probability of 0.1%. Since we have 301 time points (43 × 7) and 1 time lag, the total noise level of a gene is 2.96% (≈1 - (1 - 0.0001)^{301}) when the noise level is 0.01% in a Boolean function. For the correction of the multiple comparison problem, we compare the results of the original BN and CST-based BN when the noise level of a Boolean function varies from 0.01% to 0.24%.

**Network structure with 40 nodes in simulation data set**. Network structure with 27 Boolean functions that are randomly generated with 40 nodes.

Table Table11 summarizes the simulation result. The first column shows the noise level and the second column shows the number of Boolean functions identified by the original BN as well as the number of true Boolean functions in parentheses. The third column shows the result of the CST-based BN. The number of the Boolean functions provided by CST-based BN is the same as that provided by the original BN. The false positive rate (FPR) is defined as the ratio of the number of false Boolean functions to the total number of Boolean functions. For example, when the noise level is 0, the FPR of the original BN is given by FPR = (348 - 27)/348 = 0.922. Figure Figure22 shows the FPRs for various noise levels. It appears that the CST-based BN reduces the FPR of the original BN.

**False positive rates**. The result obtained by the CST-based BN is more accurate than that obtained by the original BN. It appears that the Boolean networks determine Boolean functions with significantly higher false positive genes than those in the case

**...**

The CST-based BN method yielded the same estimated Boolean functions as those obtained by the original BN method for various noise levels. However, there are large differences between the computing times. Table Table22 shows the selected number of nodes in the first and second steps of the variable selection method. The first column shows the node number. The second and third columns show the number of nodes in the first and second steps, respectively. Each number in the third column, separated by a comma, is the number of selected nodes for each node selected in the first step. For example, in the second line of Table Table2,2, there are two selected nodes in the first step. For these two nodes, there are 39 and 38 selected nodes in the second step, respectively. From the result of the variable selection (Table (Table2),2), the ratio of the time complexities of the two methods can be obtained as follows:

$\begin{array}{l}\frac{\text{TimecomplexityoforiginalBN}}{\text{TimecomplexityofCST-basedBN}}\hfill \\ =\frac{O({2}^{{2}^{k}}\cdot \left(\begin{array}{c}n\\ k\end{array}\right)\cdot n\cdot m\cdot poly(k))}{O({2}^{{2}^{k}}\cdot {\displaystyle {\sum}_{j=1}^{n}{\displaystyle {\sum}_{i=1}^{{n}_{1,j}}\cdot \left(\begin{array}{c}{n}_{2,ij}\\ k\end{array}\right)}}\cdot m\cdot poly(k))}\hfill \\ =\frac{\left(\begin{array}{c}n\\ k\end{array}\right)\cdot n}{{\displaystyle {\sum}_{j=1}^{n}{\displaystyle {\sum}_{i=1}^{{n}_{1,j}}\cdot \left(\begin{array}{c}{n}_{2,ij}\\ k\end{array}\right)}}}=6.8865\hfill \end{array}$

In summary, the CST-based BN method was approximately 6.9 times faster than the original BN method. If the network had a larger number of nodes (*n*), then the difference between the computing times of the two algorithms would be significantly high.

### Yeast cell cycle data

In order to demonstrate the improvement in the computing times, we apply the proposed variable selection method to yeast cell cycle data [33]. The data comprises 18 time points (alpha-factor-based synchronization experiment). In this example, the computing time and accuracy of network estimation of the original BN method are compared with those of our CST-based BN method.

### Comparison between the network structure estimation accuracies of the CST-based BN and the original BN

Our variable selection method significantly improves the computing time of the BNs. However, the accuracy of our method should be assessed before comparing the computing times of the two methods. The improvement in the computing times primarily depends on the cutoff statistical significance levels, *α*_{1 }and *α*_{2}, for the selection of genes at time *t *- 1 via the CST (Methods section). Depending on the choice of appropriate values of *α*_{1 }and *α*_{2}, the proposed CST-based BN method may not be able to determine some Boolean functions that can be estimated by the original BN method. This may be attributed to the missing essential variables due to the usage of extremely stringent cutoff values.

We define the error rate as the discrepancy between the Boolean functions estimated by the original BN and the proposed CST-based BN as follows:

$\text{Errorrate}=1-\frac{\text{Numberof}(B{F}_{OriginalBN}\cap B{F}_{CSTbasedBN})}{\text{Numberof}(B{F}_{OriginalBN})}\text{}\left(1\right)$

where *BF*_{OriginalBN }and *BF*_{CSTbasedBN }are sets of Boolean functions estimated by the original BN and the CST-based BN, respectively. Three data sets with randomly selected 80, 100, and 120 genes were used to compute the error rate. We have calculated the error rate for various values of *α*_{1 }and *α*_{2 }(Figure 3(a),(b) and Figure 4(a)–(d)). Figure Figure33 shows the error rate when the error size of the Best-Fit Extension problem is 0, while Figure Figure44 shows the error rate when the error size is 1. In each plot, the *y*-axis represents the error rate and the *x*-axis represents the value of *α*_{2}. The error rate decreases with an increase in *α*_{1 }and *α*_{2}; this implies that a less conservative cutoff value would be more suitable to construct a BN.

**Error rates of estimated Boolean functions using variable selection method when the error size is 0**. The error rates were calculated from the three data sets with a different number of genes: 80, 100, and 120. The genes were randomly selected from the

**...**

**Error rates of estimated Boolean functions using variable selection method when the error size is 1**. The error rates were calculated from the three data sets with a different number of genes: 80, 100, and 120. The genes were randomly selected from the

**...**

In order to select appropriate values of *α*_{1 }and *α*_{2}, the error rates were obtained for various combination of (*α*_{1}, *α*_{2}). Some of the results are shown in Figures Figures33 and and4.4. To obtain an error rate of zero, the values of *α*_{1 }and *α*_{2 }should be greater than 1% and 2%, respectively, when the error size is zero (Figure 3(a),(b)). However, when the error size is one, larger values of *α*_{1 }and *α*_{2 }are required to obtain an error rate of zero (Figure 4(a)–(d)). Based on these results, we suggest that the following values be used when the error size is 0, *α*_{1 }= 1%, *α*_{2 }= 2% and when the error size is 1, *α*_{1 }= 7.5%, *α*_{2 }= 10%.

### Comparison between the computing times of the original and the proposed BN algorithms

In order to compare the computing times, we executed the BN program based on the Best-Fit Extension problem (written in C language). Figure Figure55 shows the computing times with a change in the number of genes from 40 to 120. We set the value of error size in the Best-Fit Extension problem as 0 and 1 and used the variable selection criteria *α*_{1 }= 1%, *α*_{2 }= 2% and *α*_{1 }= 7.5%, *α*_{2 }= 10%, respectively. The line with circles represents the computation time of the original BN. The dotted line with rectangles and the dashed line with triangles represent the computation times of the CST-based BN when the error size are 0 and 1, respectively. As shown in Figure Figure5,5, the original BN required 14489.2 s to estimate all Boolean functions with 120 genes for *k *= 3. On the other hand, the proposed CST-based BN required only 219.3 s for *α*_{1 }= 1%, *α*_{2 }= 2% and 2127.7 s for *α*_{1 }= 7.5%, *α*_{2 }= 10%. Therefore, the overall computation times of the proposed CST-based BN are approximately 70.8 times (error size = 0) and 7.6 times (error size = 1) faster than those of the original BN method.

### Construction of gene networks with yeast cell cycle related 800 genes

We also applied the CST-based BN to the subset of the yeast cell cycle data with 800 genes [33] for demonstration. Figure Figure66 shows a partial structure of the gene network structure constructed by using the CST-based BN. The Best-Fit Extension problem provided several Boolean functions for a gene at time *t*. For the demonstration, we randomly selected a Boolean function from the estimated Boolean functions of each gene; the method used for this purposed was similar to that used by the PBN [6,34] to select a set of Boolean functions for a given gene using the coefficient of determination (COD).

**Gene network structure with 800 genes**. 800 gene network structure with yeast cell cycle using CST-based BN. The cutoff values are

*α*

_{1 }= 1% and

*α*

_{2 }= 2%. This structure is an example of many possible structures. Only a partial structure is

**...**

For all 800 genes, the CST-based BN required approximately three days to construct the network structure. In order to estimate the total computation time of the original BN, we selected the first target gene and constructed the BN, which required approximately 37,011 s. Therefore, the total computation times for all 800 genes will be approximately 342 days to build the network structure. Hence, the computing time of the proposed CST-based BN method is approximately 114 times faster than that of the original BN method.

## Discussions and Conclusion

Recent studies [14,15] have emphasized that thousands of genes must be considered simultaneously in order to construct gene regulatory networks in an organism. The BN method is useful for constructing a gene regulatory network. If the gene expression data contain a considerable amount of noise, the binary transformation of these data can reduce the error [35]. The BN has been successfully used to model a nonlinear system [27] and the dynamic behavior of living systems [18,26]. Despite these advantages, it is difficult to apply the BN method to large-scale gene regulatory network studies due to the extremely high computation times.

In order to overcome this computational drawback, we proposed the variable selection method using the CST for the two-way and three-way contingency tables of Boolean count observations. This method reduces the computation times significantly; for example, for 120 genes, the computation time is approximately 70.8 times faster than that of the original BN method. If the total number of genes and the value of *k *increase, the improvement in the computation time is expected to be significantly greater than the original BN method. Also the proposed method can be easily implemented with the existing BN modeling algorithms such as the PBNs by efficiently selecting only the most relevant genes for determining the Boolean functions. This method is thus demonstrated to reduce the false positive rate, which is an important problem in network studies conducted on a genome-wide scale.

In our method, the value of *k *is assumed to be three. However, it is possible to use a large value of *k *greater than 3. Since our method uses the Best-Fit Extension problem, a gene can be controlled by more than one Boolean function. Therefore, it appears that *k *= 3 provides a large number of Boolean functions that can model the gene regulatory network successfully.

The proposed CST-based BN used the two-step discovery of 3-indegree Boolean functions because the prediction information of addtional genes in such high-dimensional Boolean functions is mainly observed after considering, or conditional on, primary genes' effects. This strategy, in turn, resulted in much more efficient discovery of the most predictive high-dimensional Boolean functions in our BN modeling.

The result of the proposed CST-based BN may be sensitive to the sample size *n*. When *n *is small, the contingency table may contain many cells with low and zero frequencies. To ensure that the expectation value is not equal to zero, a continuity correction is used by adding a small constant 0.1 to the observed frequency in each cell [36]. This simple correction produces a successful result in the real data set [33] that contains 17 time points. However, we should be more careful while applying the CST method to data with small time points because the result of the CST can be less reliable for the sparse data set. In this case, we suggest that the CST be replaced with Fisher's exact test that provides a more reliable result for the small sample size data [36]. The small sample size problem also makes it difficult for the original BN algorithm to produce a reliable result. We think that in the near future the advancement of high throughput techniques and the cost-down of microarrays will enable us to solve the sparse data problem by producing large data sets easily.

The improvement of the computing times using the CST-based BN will significantly increase the utility and applicability of the BN to the inference of various regulatory networks, particularly those based on current large screening biological data such as microarrays. In order to apply the proposed variable selection method, we must first select the values of *α*_{1 }and *α*_{2}. A small values of *α *cause the exclusion of essential Boolean functions and produces a high error rate. On the other hand, large values of *γ *cause the inclusion of most of the genes, thereby resulting in long computing times. For the yeast cell cycle data, we applied various combinations of (*α*_{1}, *α*_{2}). As shown in Figure Figure3,3, it appears that the cutoff values do not significantly affect much the accuracy of the method for the yeast cell cycle data, provided the values of *α*_{1 }and *α*_{2 }are greater than 1% and 2%, respectively, when the error size of the Best-Fit Extension problem is zero.

Therefore, for practical application, we suggest that *α*_{1 }= 1% and *α*_{2 }= 2% be used when the error size of the Best-Fit Extension problem is zero. We select the cutoff values such that the Boolean functions obtained by the CST-based BN are the same as those obtained by the original BN. However, we can use smaller cutoff values to reduce the number of false positive Boolean functions, because the original BN method tends to yield many false positive relationships, as shown in the simulation result.

In addition, a more careful dichotomization is required for a more accurate biological interpretation of the network structure. For example, since microarray data have continuous expression values with a considerably large amount of information, the dichotomization may require the selection of an appropriate threshold value depending on the biological function of each gene [35]. The performance may not be remarkable when a small number of time points and genes are available. However, we show that the proposed variable selection method is significantly more efficient for large-scale gene regulatory network studies. For example, the CST-based BN is approximately 114 times faster than the original BN for 800 genes (Figure (Figure66).

The next step would be to perform a biological evaluation of the selected network structure. However, the main focus of our study is to improve the computation times of the BN by using the CST. Our approach allows the application of the BN to genome-wide network construction and discovery. A future study will evaluate the accuracy of the BN and compare it with other network methods such as the Bayesian network and hierarchical scale-free network.

## Methods

The proposed CST-based BN consists of two steps. The first step is to determine a pair of genes that are associated with each other. The second step is to determine the third gene that is conditionally associated with the pair of genes identified in the first step.

### First step for the main effect

Let *n *be the total number of genes. In the first step, 2 × 2 contingency tables are constructed from the dichotomized gene expression data. The *p*th row comprises the *i*th gene expression level at time *t *- 1 while the *q*th column of the table comprises the *j*th gene expression level at time *t *(*i *= 1, ..., *n*; *j *= 1, ..., *n*; *p *= 0,1; *q *= 0,1). For the *i*th and *j*th genes, a 2 × 2 contingency table is constructed with four cells: {0, 0}, {0,1}, {1, 0}, and {1,1}, where {*p*, *q*} represent the *i*th gene expression level at time *t *- 1 and the *j*th gene expression level at time *t*, respectively.

A CST statistic is then computed for testing the independence between two genes. For multinomial sampling with probabilities {*π*_{pq}} in the contingency table, the null hypothesis of independence is *H*_{0 }: *π*_{pq }= *π*_{p+}*π*_{q+ }(the *i*th gene at time *t *- 1 and the *j*th gene at time *t *are independent) for all *p *(= 0,1) and *q *(= 0,1). The conventional Pearson's CST can be used to test *H*_{0 }using the observed frequency *O*_{pq }and the expected frequency *E*_{pq }under *H*_{0}. For the continuity correction, we add an arbitrary small number *a *to each observed frequency in order to prevent *E*_{pq }from becoming zero [36]. We use *a *= 0.1 for the correction. Generally, {*π*_{p+}} and {*π*_{+q}} are unknown. The maximum likelihood (ML) estimates are the sample marginal proportions {$\widehat{\pi}$_{p+ }= *O*_{p+}/*O*_{++}} and {$\widehat{\pi}$_{+q }= *O*_{+q}/*O*_{++}}, where *O*_{++ }= Σ_{p}Σ_{q}*O*_{pq}. *E*_{pq }is estimated as *E*_{pq }= *O*_{++}$\widehat{\pi}$_{p+}$\widehat{\pi}$_{+q }= *O*_{p+}*O*_{+q}/*O*_{++}. Therefore, the chi-square statistic is expressed as follows:

${\chi}^{2}={\displaystyle \sum _{p}{\displaystyle \sum _{q}\frac{{({O}_{pq}-{E}_{pq})}^{2}}{{E}_{pq}}}}\text{}\left(2\right)$

Using this CST, the significant genes are selected by an appropriate selection criterion *α*_{1}. A further discussion on the appropriate choice of *α*_{1 }is provided in the Result section.

### Second step for the conditional effect

Assume that the *i*th gene at time *t *- 1 is selected in the first step for the *j*th gene at time *t*. Then, a 2 × 2 × 2 contingency table can be constructed that consists of three genes – the *i*th and *j*th genes selected in the first step and an additional new gene *h *at time *t *- 1. This contingency table consists of eight cells: {0,0,0}, {0,0,1}, {0,1,0}, {0,1,1}, {1,0,0}, {1,0,1}, {1,1,0}, and {1,1,1}, where {*o*, *p*, *q*} represent the *h*th gene expression level at time *t *- 1, *i*th gene expression level at time *t *- 1, and *j*th gene expression level at time *t*, respectively (*i *= 1, ..., *n*; *j *= 1, ..., *n*; *h *= 1, ..., *n*; *o *= 0,1; *p *= 0,1; *q *= 0,1).

For the given expression value of *h*, there are two 2 × 2 contingency tables for the *i *and *j *genes. We focus on the conditional independence test. The null hypothesis that the *i*th gene at time *t *- 1 and the *j*th gene at time *t *are conditionally independent when the *h*th gene expression level at time *t *- 1 is given by *H*_{0 }: *π*_{pq|o }= *π*_{p+|o}*π*_{q+|o }for all *p *(= 0, 1) and *q *(= 0,1), where *π*_{..|o }represents the conditional probability for the given *o*. We use the CST to test *H*_{0 }using the observed frequency *O*_{opq }and the expected frequency *E*_{opq }under *H*_{0}. We also add 0.1 to each observed frequency for the continuity correction. The ML estimates of *π*_{p+|o }and *π*_{+q|o }are the sample conditional proportions {$\widehat{\pi}$_{p+|o }= *O*_{op+}/*O*_{o++}} and, {$\widehat{\pi}$_{+q|o }= *O*_{o+q}/*O*_{o++}}, respectively where *O*_{o++ }= Σ_{p}Σ_{q}*O*_{opq}. *E*_{pq|o }is estimated as *E*_{pq|o }= *O*_{o++}$\widehat{\pi}$_{p+|o}$\widehat{\pi}$_{+q|o }= *O*_{op+}*O*_{o+q}/*O*_{o++}. Then, the chi-square statistic are given by

${\chi}_{o}^{2}={\displaystyle \sum _{p}{\displaystyle \sum _{q}\frac{{({O}_{opq}-{E}_{opq})}^{2}}{{E}_{opq}}}}\text{}\left(3\right)$

for *o *= 0,1. We assume that the *i*th and *j*th genes are not independent from the first step. We select the *h*th gene if at least one of the two CST in the second step is significant (the p-value of the test is less than *α*_{2}).

The rationale for using this conditional independence test is that *h *affects the association between two genes *i *and *j*. The conditional test approach is very effective in the determination of a relationship for more than two genes.

### Implementation of two step variable selection method

We select *n*_{1, j }genes at time *t *- 1 that are associated with the *j*th gene at time *t *in the first step where 1 ≤ *n*_{1, j }≤ *n*. If the *i*th gene is one of the *n*_{1, j }genes, we select *n*_{2, ij }genes in the second step for 1 ≤ *n*_{2, ij }≤ *n *- 1 (excluding the *i*th gene). Then, we consider all possible combinations for selected three genes (when *k *= 3); one gene is the *i*th gene selected in the first step and the other two genes are selected in the second step. These combinations are used instead of all possible combinations in the original BN algorithms. The time complexity of determining the Boolean functions for the *j*th gene is *O*(${2}^{{2}^{k}}\cdot {\displaystyle {\sum}_{i=1}^{{n}_{1,j}}\cdot \left(\begin{array}{c}{n}_{2,ij}\\ k\end{array}\right)}$·*m*·*poly*(*k*)) and that of variable selection using the CST is *O*(*n*^{2 }+ *n*_{1, j}·(*n *- 1)). Hence, the total time complexity of the proposed algorithm is expressed as follows:

$O({n}^{2}+{n}_{1,j}\cdot (n-1))+O({2}^{{2}^{k}}\cdot {\displaystyle \sum _{j=1}^{n}{\displaystyle \sum _{i=1}^{{n}_{1,j}}\cdot \left(\begin{array}{c}{n}_{2,ij}\\ k\end{array}\right)}}\cdot m\cdot poly(k))\text{}\left(4\right)$

As *n *increases, the time complexity of determining the Boolean functions dominates the time complexity of variable selection because the former increases more rapidly than the latter.

### EXAMPLE

Table Table33 shows the expression profiles of eight genes with 17 time points. Here, only two Boolean functions – *f*_{1 }= ¬*G*3 (¬*G*4 ∧ ¬*G*8) and *f*_{3 }= ¬*G*1 (*G*2 ∧ *G*6) – are true. To determine these functions, the original BN searches all possible combinations of genes at time *t *- 1 for every target gene at time *t *(_{8}*C*_{3 }× 8 = 448 when the indegree is three). We can reduce the BN combinations by using the proposed variable selection method. Table Table44 shows the result obtained by using the proposed variable selection method. Five genes at time *t *(2nd, 4th, 5th, 6th, and 8th genes) are excluded because they do not have any genes selected in the first step.

Figures 7(a) and 7(b) show the 2 × 2 contingency tables using (*G*1^{t}, *G*3^{t - 1}) and (*G*3^{t}, *G*1^{t - 1}), respectively. The second step is performed only for the selected genes in the first step in order to identify genes that are conditionally associated with the target gene. Figure Figure88 shows 2 × 2 × 2 tables with three genes – a gene at time *t*, a gene at time *t *- 1 from the first step, and new gene at time *t *- 1: (a) for (*G*1^{t}, *G*3^{t - 1}, *G*4^{t - 1}), (b) for (*G*1^{t}, *G*3^{t - 1}, *G*8^{t - 1}), (c) for (*G*1^{t}, *G*3^{t - 1}, *G*2^{t - 1}), and (d) for (*G*1^{t}, *G*3^{t - 1}, *G*6^{t - 1}). The total number of possible combinations of the CST-based BN is 47. Therefore, the total time complexity of the CST-based BN is 9.5 times faster than that of the original BN.

**First step for the main effect**. 2 × 2 contingency table with (a)

*G*3 at time

*t*and

*G*1 at time

*t*- 1 and (b)

*G*3 and

*G*1 at time

*t*- 1. We added 0.1 to each cell for the continuity correction.

## Availability and requirements

Project name: Boolean networks for Large-scale gene regulatory network Project home page: http://bibs.snu.ac.kr/supplement/2006/Boolean/

## Supplementary Material

**Additional file 1:**

Boolean functions for a toy example. R code for true Boolean functions in a toy example.

^{(109 bytes, txt)}

**Additional file 2:**

Data set for toy example. Binary data set of 18 time points × 8 genes generated by using the two Boolean functions.

^{(161 bytes, txt)}

**Additional file 3:**

27 Boolean functions for the simulation study. R code for true functions in the simulation study.

^{(1.1K, txt)}

**Additional file 4:**

Data set for the simulation study. 43 data set of 7 time points × 40 genes generated by using 27 Boolean functions

^{(12K, txt)}

**Additional file 5:**

Yeast cell cycle data. Binary data set of randomly selected 40–120 genes. The Each data set consist of time points (row) number of genes (column). The mean value was used as a dichotomization criterion.

^{(13K, txt)}

## Acknowledgements

The authors would like to thank to anonymous referees whose comments were extremely helpful. This study was supported by the National Research Laboratory Program of the Korea Science and Engineering Foundation (M10500000126), the Brain Korea 21 Project of the Ministry of Education of T.P., and the US NIH grant 1R01HL081690 of J.K.L.

## References

- D'Haeseleer P, Wen X, Fuhrman S, Somogyi R. Linear modeling of mRNA expression levels during CNS development and injury. Pacific Symposium on Biocomputing. 1999;4:41–52. [PubMed]
- van Someren EP, Wessels LFA, Reinders MJT. Linear Modeling of Genetic Networks from Experimental Data. Intelligent Systems for Molecular Biology. 2000;8:355–366. [PubMed]
- Kauffman SA. Metabolic stability and epigenesis in randomly constructed genetic nets. Journal of Theoretical Biology. 1969;9:3273–3297. [PubMed]
- Akutsu T, Miyano S, Kuhara S. Identification of genetic networks from a small number of gene expression patterns under the Boolean network model. Pacific Symposium on Biocomputing. 1999;4:17–28. [PubMed]
- Liang S, Fuhrman S, Somogyi R. REVEAL, A general reverse engineering algorithm for inference of genetic network architectures. Pacific Symposium on Biocomputing. 1998;3:18–29. [PubMed]
- Shmulevich I, Dougherty ER, Seungchan K, Zhang W. Probabilistic Boolean networks: A rule-based uncertainty model for gene regulatory networks. Bioinformatics. 2002;18:261–274. doi: 10.1093/bioinformatics/18.2.261. [PubMed] [Cross Ref]
- Friedman N, Goldszmidt M, Wyner A, Eds Data analysis with baysian networks: A bootstrap approach Proc Fifteenth Conf on Uncertainty in Artificial Intelligence (UAI) 1999.
- Imoto S, Goto T, Miyano S. Estimation of Genetic Networks and Functional Structures Between Genes by Using Bayesian Networks and Nonparametric Regression. Pacific Symposium on Biocomputing. 2002;7:175–186. [PubMed]
- Weaver DC, Workman CT, Stormo GD. Modeling regulatory networks with weight matrices. Pacific Symposium on Biocomputing. 1999;4:112–123. [PubMed]
- Chen T, He HL, Church GM. Modeling gene expression with differential equations. Pacific Symposium Biocomputing. 1999;4:29–40. [PubMed]
- Perrin B, Ralaivola L, Mazurie A, Bottani S, Mallet J, D'Alche-Buc F. Gene networks inference using dynamic Bayesian networks. Biofincormatics. 2003;19:138–148. [PubMed]
- Dojer N, Gambin A, Mizera A, Wilczynski B, Tiuryn J. Applying dynamic Bayesian networks to perturbed gene expression data. BMC Bioinformatics. 2006;7:249. doi: 10.1186/1471-2105-7-249. [PMC free article] [PubMed] [Cross Ref]
- Zou M, Conzen S. A new dynamic Bayesian network(DBN) approach for identifying gene regulatory networks from time course microarray data. Bioinformatics. 2005;21:71–79. doi: 10.1093/bioinformatics/bth463. [PubMed] [Cross Ref]
- Han JDJ, Bertin N, Hao T, Goldberg DS, Berriz GF, Zhang LV, Dupuy D, Walhout AJM, Cusic ME, Roth FP, Vidal M. Evidence for dynamically organized modularity in the yeast protein-protein interaction network. Nature. 2004;430:88–93. doi: 10.1038/nature02555. [PubMed] [Cross Ref]
- Jeong H, Tombor B, Albert R, Oltvai ZN, Barabasi AL. The large-scale organization of metabolic networks. Nature. 2000;407:651–654. doi: 10.1038/35036627. [PubMed] [Cross Ref]
- Basso K, Margolin AA, Stolovitzky G, Klein U, Dalla-Favera R, Califano A. Reverse engineering of regulatory networks in human B cells. Nature Genetics. 2005;37:382–390. doi: 10.1038/ng1532. [PubMed] [Cross Ref]
- Huang S. Gene expression profiling, genetic networks and cellular states: An integrating concept for tumorigenesis and drug discovery. Journal of Molecular Medicine. 1999;77:469–480. doi: 10.1007/s001099900023. [PubMed] [Cross Ref]
- Shmulevich I, Gluhovsky I, Hashimoto RF, Dougherty ER, Zhang W. Steady-state analysis of genetic regulatory networks modelled by probabilistic Boolean networks. Comparative and Functional Genomics. 2003;4:601–608. doi: 10.1002/cfg.342. [PMC free article] [PubMed] [Cross Ref]
- Kauffman SA. The Origins of Order: Self-organization and Selection in Evolution. New York. Oxford University Press; 1993.
- Boros E, Ibaraki T, Makino K. Error-Free and Best-Fit Extensions of partially defined Boolean functions. Information and Computation. 1998;140:254–283. doi: 10.1006/inco.1997.2687. [Cross Ref]
- Shmulevich I, Saarinen A, Yli-Harja O, Astola J, Eds . Inference of genetic regulatory networks under the best-fit extension paradigm, in Computational and Statistical Approaches To Genomics. Boston, MA: Kluwer; 2002.
- Schwarzer C. Matlab Random Boolean Network Toolbox 2003 http://www.teuscher.ch/rbntoolbox/
- Schilstra MJ, Bolouri H. Modeling the regulation of gene expression in genetic regulatory networks http://strc.herts.ac.uk/bio/maria/NetBuilder
- Kauffman SA, Peterson C, Samuelsson B, Troein C, Eds Random Boolean network models and the yeast transcriptional network Journal of Molecular Medicine 1999, USA. 2003. pp. 469–480.
- Johnson S, Ed . Boolean network inference and experiment design for the B-Cell single ligand screen 2004. AfCS annual meeting; 2004.
- Shmulevich I, Dougherty ER, Zhang W. Gene perturbation and intervention in probabilistic Boolean networks. Bioinformatics. 2002;18:1319–1331. doi: 10.1093/bioinformatics/18.10.1319. [PubMed] [Cross Ref]
- Thomas R. Regulatory networks seen as asynchronous automata: a logical description. Journal of Theoretical Biology. 1991;153:1–23. doi: 10.1016/S0022-5193(05)80350-9. [Cross Ref]
- Boros E, Hammer PL, Ibaraki T, Kogan A. Logical analysis of numerical data. Math Program. 1997;79:163–190. doi: 10.1016/S0025-5610(97)00050-6. [Cross Ref]
- Akutsu T, Miyano S, Eds . Selecting informative genes for cancer classification using gene expression data In Proceddings of the IEEE-EURASIP Workshop on NonlinSignal and Image Processing (NSIP) Baltimore, MD; 2001.
- Pfahringer B, Ed . In: Compression-based discretization of continuous attributes Machine Learning: Procees of the Twelfth International Conference. Prieditis A, Russell S, editor. San Francisco: Morgan Kaufmann; 1995.
- Dougherty J, Kohavi R, Sahami M, Eds . Supervised and unsupervised discretization of continuous features In Proceedings of the Twelfth International Conference on Machine Learning. Tahoe City, CA: Morgan Kaufmann; 1995.
- Lahdesmaki H, Shmulevich I, Yli-Harja O. On learning gene regulatory networks under the Boolean network model. Machine Learning. 2003;52:147–167. doi: 10.1023/A:1023905711304. [Cross Ref]
- Spellman PT, Sherlock G, Zhang MQ, Iyer VR, Anders K, Eisen MB, Brown PO, Botstein D, Futcher B. Comprehensive identification of cell cycle-regulated genes of the yeast Saccharomyces cerevisiae by microarray hybridization. Mol Biol Cell. 1998;9:3273–3297. [PMC free article] [PubMed]
- Dougherty ER, Kim S, Chen Y. Coefficient of determination in nonlinear signal processing. Signal Process. 2000;80:2219–2235. doi: 10.1016/S0165-1684(00)00079-7. [Cross Ref]
- Shmulevich I, Zang W. Binary analysis and optimization-based normalization of gene expression data. Bioinformatics. 2002;18:555–565. doi: 10.1093/bioinformatics/18.4.555. [PubMed] [Cross Ref]
- Agresti A. Categorical data analysis. second. wiley-interscience; 2002.

**BioMed Central**

## Formats:

- Article |
- PubReader |
- ePub (beta) |
- PDF (891K)

- Inferring gene regulatory networks with time delays using a genetic algorithm.[Syst Biol (Stevenage). 2005]
*Wu FX, Poirier GG, Zhang WJ.**Syst Biol (Stevenage). 2005 Jun; 152(2):67-74.* - Inference of gene regulatory networks using boolean-network inference methods.[J Bioinform Comput Biol. 2009]
*Hickman GJ, Hodgman TC.**J Bioinform Comput Biol. 2009 Dec; 7(6):1013-29.* - Rank-based edge reconstruction for scale-free genetic regulatory networks.[BMC Bioinformatics. 2008]
*Chen G, Larsen P, Almasri E, Dai Y.**BMC Bioinformatics. 2008 Jan 31; 9:75. Epub 2008 Jan 31.* - Boolean dynamics of genetic regulatory networks inferred from microarray time series data.[Bioinformatics. 2007]
*Martin S, Zhang Z, Martino A, Faulon JL.**Bioinformatics. 2007 Apr 1; 23(7):866-74. Epub 2007 Jan 31.* - From biophysics to evolutionary genetics: statistical aspects of gene regulation.[BMC Bioinformatics. 2007]
*Lässig M.**BMC Bioinformatics. 2007 Sep 27; 8 Suppl 6:S7. Epub 2007 Sep 27.*

- Integrating Genomics and Proteomics Data to Predict Drug Effects Using Binary Linear Programming[PLoS ONE. ]
*Ji Z, Su J, Liu C, Wang H, Huang D, Zhou X.**PLoS ONE. 9(7)e102798* - Discovery of Possible Gene Relationships through the Application of Self-Organizing Maps to DNA Microarray Databases[PLoS ONE. ]
*Chavez-Alvarez R, Chavoya A, Mendez-Vazquez A.**PLoS ONE. 9(4)e93233* - Refining Ensembles of Predicted Gene Regulatory Networks Based on Characteristic Interaction Sets[PLoS ONE. ]
*Windhager L, Zierer J, Küffner R.**PLoS ONE. 9(2)e84596* - LegumeGRN: A Gene Regulatory Network Prediction Server for Functional and Comparative Studies[PLoS ONE. ]
*Wang M, Verdier J, Benedito VA, Tang Y, Murray JD, Ge Y, Becker JD, Carvalho H, Rogers C, Udvardi M, He J.**PLoS ONE. 8(7)e67434* - Inference of Biological Pathway from Gene Expression Profiles by Time Delay Boolean Networks[PLoS ONE. ]
*Chueh TH, Lu HH.**PLoS ONE. 7(8)e42095*

- MedGenMedGenRelated information in MedGen
- PubMedPubMedPubMed citations for these articles
- StructureStructurePublished 3D structures
- TaxonomyTaxonomyRelated taxonomy entry
- Taxonomy TreeTaxonomy Tree

- Boolean networks using the chi-square test for inferring large-scale gene regula...Boolean networks using the chi-square test for inferring large-scale gene regulatory networksBMC Bioinformatics. 2007; 8()37PMC

Your browsing activity is empty.

Activity recording is turned off.

See more...