Logo of bmcbioiBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Bioinformatics
BMC Bioinformatics. 2006; 7: 205.
Published online Apr 13, 2006. doi:  10.1186/1471-2105-7-205
PMCID: PMC1479841

SIMAGE: simulation of DNA-microarray gene expression data

Abstract

Background

Simulation of DNA-microarray data serves at least three purposes: (i) optimizing the design of an intended DNA microarray experiment, (ii) comparing existing pre-processing and processing methods for best analysis of a given DNA microarray experiment, (iii) educating students, lab-workers and other researchers by making them aware of the many factors influencing DNA microarray experiments.

Results

Our model has multiple layers of factors influencing the experiment. The relative influence of such factors can differ significantly between labs, experiments within labs, etc. Therefore, we have added a module to roughly estimate their parameters from a given data set. This guarantees that our simulated data mimics real data as closely as possible.

Conclusion

We introduce a model for the simulation of dual-dye cDNA-microarray data closely resembling real data and coin the model and its software implementation "SIMAGE" which stands for simulation of microarray gene expression data. The software is freely accessible at: http://bioinformatics.biol.rug.nl/websoftware/simage.

Background

No two laboratories produce the same expression data when performing seemingly identical DNA microarray experiments. This is simply due to the fact that experimental conditions and factors such as growth media composition, RNA sampling methodology and scanner calibration are never exactly identical [1]. Even within one and the same laboratory differences in the outcome of experiments executed by different laborants can be observed [2,3]. These and many other factors lead to sometimes unexpected gene expression variations that can occur at several levels. Figure Figure11 shows a schematic and simplified overview of those levels in dual-color DNA microarray data (top) as well as the effect of some of these levels on the composition of the expression signals (bottom).

Figure 1
Schematic overview of the SIMAGE model (A) and a few layers visualized (B and C). The blue-marked boxes (A) indicate layers that are further visualized (B and C). A simulation of the entire 'non-biological' signal is shown in B and C. Top row, sum of ...

It is obvious that knowledge about the properties that gene expression signals hold as shown in Figure Figure11 is very important to any researcher. This knowledge can be used to design an optimal new DNA microarray experiment and to carry out the best analysis of that generated data set. To this end, real and simulated data has been used for a long time in data analysis workshops. And in case it is not (yet) obvious for a novice in the field, the visualization as shown in Figure Figure11 can be of educational value. In all three cases – design, analysis and education – the availability of simulation software would be very helpful. It is of eminent importance that the simulated data resembles experimental data as much as possible [4] and, therefore, there is a need for software that can (roughly) estimate levels of variation.

Various software packages for simulating dual-color DNA microarray data have been described in the literature (Table (Table1).1). Some of these packages aim at validating image analysis and spot quantification and simulate TIF-images of the visualized spots. Other software focuses on gene networks. In this paper, we present new software that fits in between these two categories: we simulate the gene expression data as it is tabulated after image analysis. In addition, we provide software that can be used to roughly estimate the levels of variation in real data. These computer programs, named SIMAGE, are freely available via a web-resource.

Table 1
Comparison of the properties of different DNA-microarray simulation models described in literature. '+' and '-' indicate availability of the indicated feature in the specified model. Note that the modeling of features in the specific models is usually ...

Implementation

Software overview

The SIMAGE web site [5] consists of three parts: (i) a start page where the user may upload parameters for a simulation; (ii) a web-page where the user specifies a number of parameters, after which (iii) the results, namely simulated data (see below), are presented. Each run is assigned a unique session, which allows the user to inspect the results at any given time. SIMAGE provides the user with three types of text files containing: (i) the parameters used for the simulation. This file can, in turn, be provided to SIMAGE for future simulations; (ii) the (differential) gene expressions, which are obtained after applying only the gene-layer; and (iii) the observed signals (including their location on the slide and the corresponding genes) after applying the layers explained in the following paragraphs. The estimates from a provided dataset are determined by a self-explanatory web site which is linked from the SIMAGE web site.

SIMAGE was written in Pascal and compiled by FreePascal version 1.0.10 [6]. Estimates for parameters, based on real data, are provided by a script developed in R [7]. The software requires an Apache web-server and is integrated with a PHP web-interface.

The general model

Figure Figure11 shows a schematic representation of the model used in this study. Throughout this manuscript, and in the software package, the base-2 logarithm is used, unless stated otherwise. In this model the (log) expression signals are composed of the following components: (i) gene expression, (ii) a raw background gradient signal, (iii) a channel effect, (iv) a spot pin effect, (v) a nonlinear effect, (vi) a quantization and saturation effect, and (vii) random error due to unknown and/or unmodeled factors. The model is explained in more detail in the following text.

Dimensions and notation

A DNA-microarray slide consists of a number of spots arranged in a two-dimensional matrix, which, in turn is divided into nrow × ncol square (sub)grids (see supplementary Fig. S1). Each grid contains nspot2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWGUbGBdaqhaaWcbaGaem4CamNaemiCaaNaem4Ba8MaemiDaqhabaGaeGOmaidaaaaa@34E0@ spots (nspot in both the horizontal and vertical direction), amounting to a total number of nrow × ncol × nspot2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWGUbGBdaqhaaWcbaGaem4CamNaemiCaaNaem4Ba8MaemiDaqhabaGaeGOmaidaaaaa@34E0@ spots per slide. In total, nslide slides are simulated with each spot providing a measure of the green (Cy3) and the red (Cy5) signal. The simulated log expression at spot (i, j) of array l and channel k is denoted by yijkl.

Gene expressions

To distinguish between non-regulated and regulated genes, the log ratio is considered. Assuming absence of other systematic deviations, the log ratio of the Cy3 and C5 channel signals log(Cy3/Cy5) = log(Cy3) - log(Cy5), is zero for non-regulated genes (with deviances only due to randomness), positive for up-regulated genes, and negative for down-regulated genes. The part of yjikl that is affected in this gene expression layer will be called yijkl* MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWG5bqEdaqhaaWcbaGaemyAaKMaemOAaOMaem4AaSMaemiBaWgabaGaeiOkaOcaaaaa@34A8@. This yijkl* MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWG5bqEdaqhaaWcbaGaemyAaKMaemOAaOMaem4AaSMaemiBaWgabaGaeiOkaOcaaaaa@34A8@ will be the same on all spots where the same gene g is spotted (see also formula 3), hence we can use the notation yg* MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWG5bqEdaqhaaWcbaGaem4zaCgabaGaeiOkaOcaaaaa@3087@. We split yg* MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWG5bqEdaqhaaWcbaGaem4zaCgabaGaeiOkaOcaaaaa@3087@ into two parts: Gg;k, which is concerned with the 'true' expression of gene g on channel k before any other layer is applied, and Dg;k, which is a (possible) deviation due to up- or down-regulation of gene g. The modeling of yg* MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWG5bqEdaqhaaWcbaGaem4zaCgabaGaeiOkaOcaaaaa@3087@ is done via yg;k* MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWG5bqEdaqhaaWcbaGaem4zaCMaei4oaSJaem4AaSgabaGaeiOkaOcaaaaa@32E4@ = Gg;k + Dg;k. To start with Gg;k, we assume that this latent (i.e. unobservable) variable is distributed as Gg;k ~ N(μ,σG2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaem4raCeabaGaeGOmaidaaaaa@30AC@). Here, μ is the average expression value, and σG2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaem4raCeabaGaeGOmaidaaaaa@30AC@ can be interpreted as the variation in gene expression. Hence, the expressions of non-differentially expressed genes are distributed symmetrically around μ, according to a normal distribution. For a comment on the normality assumption of Gg;k, see the end of this paragraph. In most DNA-microarray data Gg;1 and Gg;2 are not statistically independent [8], which can be observed by considering a plot of Cy3 versus Cy5 signals. Therefore the covariance cov(Gg;1,Gg;2) = ρσG2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaem4raCeabaGaeGOmaidaaaaa@30AC@ is introduced, where ρ is the correlation coefficient between the signals from the two channels.

For each gene we model the probability of being up-, down- and non-regulated π+, π-, and π0= 1 - π+ - π-, respectively. For up-regulated genes the log ratio is increased by 2μD and for down-regulated genes the log ratio is decreased by 2μD. The effect of regulation is modeled via Dg;k:

( D g ; 1 D g ; 2 ) = ( k 1 k 2 ) μ D , where  ( k 1 , k 2 ) = { ( 1 , 1 ) if gene  g  is downregulated; ( 0,0 ) if gene  g  is nonregulated; ( 1, 1 ) if gene  g  is upregulated .       ( 1 ) MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaadaqadaqaauaabeqaceaaaeaacqWGebardaWgaaWcbaGaem4zaCMaei4oaSJaeGymaedabeaaaOqaaiabdseaenaaBaaaleaacqWGNbWzcqGG7aWocqaIYaGmaeqaaaaaaOGaayjkaiaawMcaaiabg2da9maabmaabaqbaeqabiqaaaqaaiabdUgaRnaaBaaaleaacqaIXaqmaeqaaaGcbaGaem4AaS2aaSbaaSqaaiabikdaYaqabaaaaaGccaGLOaGaayzkaaacciGae8hVd02aaSbaaSqaaiabdseaebqabaGccqqGSaalcqqGGaaicqqG3bWDcqqGObaAcqqGLbqzcqqGYbGCcqqGLbqzcqqGGaaidaqadaqaaiabdUgaRnaaBaaaleaacqaIXaqmaeqaaOGaeiilaWIaem4AaS2aaSbaaSqaaiabikdaYaqabaaakiaawIcacaGLPaaacqGH9aqpdaGabaqaauaabaqadiaaaeaadaqadaqaaiabgkHiTiabigdaXiabcYcaSiabigdaXaGaayjkaiaawMcaaaqaaiabbMgaPjabbAgaMjabbccaGiabbEgaNjabbwgaLjabb6gaUjabbwgaLjabbccaGiabdEgaNjabbccaGiabbMgaPjabbohaZjabbccaGiabbsgaKjabb+gaVjabbEha3jabb6gaUjabbkhaYjabbwgaLjabbEgaNjabbwha1jabbYgaSjabbggaHjabbsha0jabbwgaLjabbsgaKjabbUda7aqaamaabmaabaGaeeimaaJaeeilaWIaeeimaadacaGLOaGaayzkaaaabaGaeeyAaKMaeeOzayMaeeiiaaIaee4zaCMaeeyzauMaeeOBa4MaeeyzauMaeeiiaaIaem4zaCMaeeiiaaIaeeyAaKMaee4CamNaeeiiaaIaeeOBa4Maee4Ba8MaeeOBa4MaeeOCaiNaeeyzauMaee4zaCMaeeyDauNaeeiBaWMaeeyyaeMaeeiDaqNaeeyzauMaeeizaqMaee4oaSdabaWaaeWaaeaacqqGXaqmcqqGSaalcqGHsislcqqGXaqmaiaawIcacaGLPaaaaeaacqqGPbqAcqqGMbGzcqqGGaaicqqGNbWzcqqGLbqzcqqGUbGBcqqGLbqzcqqGGaaicqWGNbWzcqqGGaaicqqGPbqAcqqGZbWCcqqGGaaicqqG1bqDcqqGWbaCcqqGYbGCcqqGLbqzcqqGNbWzcqqG1bqDcqqGSbaBcqqGHbqycqqG0baDcqqGLbqzcqqGKbazcqqGUaGlaaaacaGL7baacaWLjaGaaCzcamaabmaabaGaeGymaedacaGLOaGaayzkaaaaaa@C919@

Although μD is a fixed number, because of the sum yg;k* MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWG5bqEdaqhaaWcbaGaem4zaCMaei4oaSJaem4AaSgabaGaeiOkaOcaaaaa@32E4@ = Gg;k + Dg;k that is 'measured' this layer behaves as if regulated genes get a random sized shift up or down. Note that Gg;k, as well as almost all other stochastic variables are modeled in SIMAGE as outcomes of normal distributions. Although this brings about some oversimplification, we consider this not really an issue or, in the words of Wit and McClure (2004) [8], 'the misspecification made by using a normal approximation is typically negligible'. In addition, the superposition of the various normally distributed layers does not imply that the generated expressions levels themselves are normally distributed. Furthermore, modeling of yg* MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWG5bqEdaqhaaWcbaGaem4zaCgabaGaeiOkaOcaaaaa@3087@ as a combination of three (normal) densities (non-, up- and down-regulated genes) enables estimating the model parameters (see "gene expressions" below). A more extensive modeling of the gene expressions, although biologically somewhat more correct, will result in a significantly more complex estimation of parameters compared to the parameters described in this study.

Replication variation

Spotting (spot pin effects), hybridization (non-uniform distribution of the labeled probe over the slide surface), and quantization (due to slide scanner properties) introduce variation in yijkl in addition to the 'natural biological variation'. This natural variation is modeled as follows. When a simulated gene g is spotted on spot ijkl, random errors εij1l and εij2l are drawn from N(0,σε2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGae8xTdugabaGaeGOmaidaaaaa@3137@) and are added to the two replicated measurements yij1l* MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWG5bqEdaqhaaWcbaGaemyAaKMaemOAaOMaeGymaeJaemiBaWgabaGaeiOkaOcaaaaa@3439@ and yij2l* MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWG5bqEdaqhaaWcbaGaemyAaKMaemOAaOMaeGOmaiJaemiBaWgabaGaeiOkaOcaaaaa@343B@. Each gene will be replicated nrep times.

Background surface variation

The signal distribution over the surface of the DNA-microarray glass-slide is affected by various factors, e.g. slide surface chemistry and hybridization effects, leading to an irregular distribution of the labeled probe on the slide [8-10]. The most simplistic way to model such gradient signals is by using a tilted plane, such that the signals on one side of the slide are higher than on the other. A more sophisticated method is that of Balagurunathan and coworkers (2002) [24] where a quadratic function is implemented. Such a function, however, is limited in the sense that it has only one local extreme (and some extremes located on the slide edges).

We use a method that allows for a number of local extremes to exist. A number nbg of bivariate normal densities with random parameter settings identifying the location and size on the slide are computed and subsequently multiplied by a random amplitude I (between ±1). Each density is computed by:

f m ( i , j ) = I m 2 π σ b g x 2 σ b g y 2 1 ρ b g 2 e [ 1 2 ( 1 ρ b g 2 ) ( ( i μ b g , x ) 2 σ b g , x 2 2 ρ ( i μ b g , x ) ( j μ b g , y ) σ b g , x σ b g , y + ( j μ b g , y ) 2 σ b g , y 2 ) ] ,       ( 2 ) MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWGMbGzdaWgaaWcbaGaemyBa0gabeaakmaabmaabaGaemyAaKMaeiilaWIaemOAaOgacaGLOaGaayzkaaGaeyypa0ZaaSaaaeaacqWGjbqsdaWgaaWcbaGaemyBa0gabeaaaOqaaiabikdaYGGaciab=b8aWjab=n8aZnaaDaaaleaacqWGIbGycqWGNbWzcqWG4baEaeaacqaIYaGmaaGccqWFdpWCdaqhaaWcbaGaemOyaiMaem4zaCMaemyEaKhabaGaeGOmaidaaOWaaOaaaeaacqaIXaqmcqGHsislcqWFbpGCdaqhaaWcbaGaemOyaiMaem4zaCgabaGaeGOmaidaaaqabaaaaOGaemyzau2aaWbaaSqabeaadaWadaqaaiabgkHiTmaalaaabaGaeGymaedabaGaeGOmaiZaaeWaaeaacqaIXaqmcqGHsislcqWFbpGCdaqhaaadbaGaemOyaiMaem4zaCgabaGaeGOmaidaaaWccaGLOaGaayzkaaaaamaabmaabaWaaSaaaeaadaqadaqaaiabdMgaPjabgkHiTiab=X7aTnaaBaaameaacqWGIbGycqWGNbWzcqGGSaalcqWG4baEaeqaaaWccaGLOaGaayzkaaWaaWbaaWqabeaacqaIYaGmaaaaleaacqWFdpWCdaqhaaadbaGaemOyaiMaem4zaCMaeiilaWIaemiEaGhabaGaeGOmaidaaaaaliabgkHiTiabikdaYiab=f8aYnaalaaabaWaaeWaaeaacqWGPbqAcqGHsislcqWF8oqBdaWgaaadbaGaemOyaiMaem4zaCMaeiilaWIaemiEaGhabeaaaSGaayjkaiaawMcaamaabmaabaGaemOAaOMaeyOeI0Iae8hVd02aaSbaaWqaaiabdkgaIjabdEgaNjabcYcaSiabdMha5bqabaaaliaawIcacaGLPaaaaeaacqWFdpWCdaWgaaadbaGaemOyaiMaem4zaCMaeiilaWIaemiEaGhabeaaliab=n8aZnaaBaaameaacqWGIbGycqWGNbWzcqGGSaalcqWG5bqEaeqaaaaaliabgUcaRmaalaaabaWaaeWaaeaacqWGQbGAcqGHsislcqWF8oqBdaWgaaadbaGaemOyaiMaem4zaCMaeiilaWIaemyEaKhabeaaaSGaayjkaiaawMcaamaaCaaameqabaGaeGOmaidaaaWcbaGae83Wdm3aa0baaWqaaiabdkgaIjabdEgaNjabcYcaSiabdMha5bqaaiabikdaYaaaaaaaliaawIcacaGLPaaaaiaawUfacaGLDbaaaaGccqGGSaalcaWLjaGaaCzcamaabmaabaGaeGOmaidacaGLOaGaayzkaaaaaa@B5C9@

where the parameters are provided by the user. These densities are summed, together with a linear gradient with a random tilt lower than s, to constitute the background surface signals (see Fig. Fig.1B,1B, top panel; see also the supplementary document). An additive modeling of the background effect is chosen over a multiplicative model. As to the reasons why, see the supplementary document.

Channel deviations, gene-dye interactions and spot pin deviation

The rationale behind the modeling of these three layers is the same: for each of the layer values a deviation, drawn from a normal distribution, is added to (a subset of) the Cy3 / Cy5 signals.

In some actual DNA-microarray experiments, the average Cy3 signal is significantly different from the average Cy5 signal obtained for a spot; reasons are: gene-to-gene variation in dye incorporating efficiencies, global differences in Cy3 and Cy5 abundance in the DNA preparations, and bleaching of the dyes (Cy5 is inactivated faster than Cy3). This effect is incorporated in the model by a random deviation C1 for N(0,σchannel2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaem4yamMaemiAaGMaemyyaeMaemOBa4MaemOBa4MaemyzauMaemiBaWgabaGaeGOmaidaaaaa@3906@) to all Cy3-measurements and another random deviation C2 from this distribution to all Cy5-measurements.

Differential incorporation of dyes in DNA occurs due to (i) the preference of reverse transcriptase for the physically smaller Cy3 label in case of direct labeling and (ii) differential hybridization because of the physically larger Cy5 label. The effects differ between genes as a consequence of DNA size and the distribution of the labeled nucleotides in the DNA molecule [11,12]. Gene-dye interactions are embedded in the model similarly to the channel effect: for all measurements belonging to gene g and dye d a random deviation Xgk from N(0,σg×d2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaem4zaCMaey41aqRaemizaqgabaGaeGOmaidaaaaa@3454@) is added to the signal.

Spot pins show systematic deviations in the amount of probe delivered to the glass surface. The signals measured of targets spotted with one spot pin might differ significantly from those spotted with another spot pin. The npin drawings Spin(ij) from N(0,σpin2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaemiCaaNaemyAaKMaemOBa4gabaGaeGOmaidaaaaa@33BE@) are used to model these effects. Spot pin effects are equal for both channels.

Non-linearity

(M, A) plots [13] from experimentally obtained DNA-microarray data often look somewhat curved (e.g. "banana shaped") and / or tilted, generally with higher deviations for lower A values (see "quantization and saturation" below). The SIMAGE model allows for non-linearity using a transformation fnl based on two parameters: α1, specifying the maximum amount of curvature to be allowed, and α2, which specifies the maximum amount of linear tilt. Although the transformation is relatively simple, the resulting data mimics experimental data closely enough with respect to non-linearity. The exact definition of the modeling of this layer and some examples of the resulting curvature is presented in the supplementary document.

Fishtails

A common artifact of DNA-microarray data is that genes with a lower expression tend to be noisier. This is apparent in the 'fishtail' appearance of (M, A) graphs. The main reason for this artifact is mainly that spots with a lower signal are quantified with larger errors than spots with higher signals [14]. Another reason could be the 'over-transformation' of data due to the log-transformation, and that a less influential power transformation would be more appropriate to obtain normally distributed gene expressions. It would, however, be extremely complicated to use another transformation, since the property of logarithms that it turns multiplicative effects into additive effects is used throughout the complete SIMAGE model. We have to content ourselves with this approximation.

The fishtailing behavior is incorporated in SIMAGE by a parameter δ that inflates the log ratio for spots with an average expression Aijl below μ by a factor (1+δσM2(Aijlμ)2) MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaadaqadaqaaiabigdaXiabgUcaRGGaciab=r7aKjab=n8aZnaaDaaaleaacqWGnbqtaeaacqGHsislcqaIYaGmaaGcdaqadaqaaiabdgeabnaaBaaaleaacqWGPbqAcqWGQbGAcqWGSbaBaeqaaOGaeyOeI0Iae8hVd0gacaGLOaGaayzkaaWaaWbaaSqabeaacqaIYaGmaaaakiaawIcacaGLPaaaaaa@4154@. A higher value of δ will result in a stronger effect and δ = 0 indicates no fishtail effect. The parameter σM2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaemyta0eabaGaeGOmaidaaaaa@30B8@ will be introduced below ("gene expressions"). Our model mimics biological replicates by randomizing the effect of δ for non-regulated genes. For each slide these genes have a probability of 1/2 of being influenced by fishtailing. In this way, the expressions of non-regulated genes are seldom distributed in such a way that they appear differentially regulated in a simulated experiment with replicated slides.

Quantization and saturation

Slide scanning introduces another non-linearity artifact. The scanning device uses 16 bits to describe signal strength, i.e. signals are always between log(20) = 0 and log(216) = 16. Furthermore, some DNA-microarray data scanners tend to over-measure low values, and under-measure high values [15]. When no over- or under-measurement occurs, the signal transformation l0(y) = min(max(0,y),16) on y will be used to incorporate the cutoff at log(20) = 0 and log(216) = 16. A maximal over- or under-measurement effect will result in the signal transformation l1(y)=16/(1+exp(2y4)) MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacqWGSbaBdaWgaaWcbaGaeGymaedabeaakmaabmaabaGaemyEaKhacaGLOaGaayzkaaGaeyypa0JaeGymaeJaeGOnayJaei4la8YaaeWaaeaacqaIXaqmcqGHRaWkcyGGLbqzcqGG4baEcqGGWbaCdaqadaqaaiabikdaYiabgkHiTmaaleaaleaacqWG5bqEaeaacqaI0aanaaaakiaawIcacaGLPaaaaiaawIcacaGLPaaaaaa@439B@. This transformation inflates low signals, deflates high signals, and leaves medium signals unchanged.

Via a parameter w (w between 0 and 1) the SIMAGE model is instructed on the severity of the bias. The transformation gnl used is a weighted average of l0 and l1, namely gnl = (1 - w)l0(y) + wl1(y). The supplementary document provides a visualization of the effect of different choices of w.

Missing data

In actual DNA-microarray data measurements may be missing. Reasons are: slide surface imperfections, hybridization effects, no DNA delivered to the glass surface during the spotting process or presence of fibers or dust particles. Our simulation model implements three types of missing data (with signals set to 0): (i) line-segments mimic 'hairs', (ii) 'donuts' comprising multiple spots mimic dirty areas and (iii) missing spots. The implementation of the model allows specifying the number of occurrences of these types of missing data as well as their maximum size and shape.

The SIMAGE model

In the SIMAGE model 29 parameters have to be specified (Table (Table2),2), of which 6 are known constants (e.g. the number of spots in a grid). The model, which results from the components described above, is defined as follows: the simulated log expression at spot (i, j) of array l and channel k is denoted by yijkl as:

Table 2
Overview of parameters in the SIMAGE model. Some parameters are known (such as number of spots per grid), others should be set by the user (the flag indicates when the parameter can also be estimated from the data). Details concerning these parameters ...

y i j k l = g n l ( t δ ( f n l ( b g i j l + z i j k l ) ) ) m i j l ,  with z i j k l = G g e n e ( i j l ) ; k + D g e n e ( i j l ) ; k + C k + S p i n ( i j ) + X g e n e ( i j l ) ; k + ε i j k l       ( 3 ) MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakqaabeqaaiabdMha5naaBaaaleaacqWGPbqAcqWGQbGAcqWGRbWAcqWGSbaBaeqaaOGaeyypa0Jaem4zaC2aaSbaaSqaaiabd6gaUjabdYgaSbqabaGcdaqadaqaaiabdsha0naaBaaaleaaiiGacqWF0oazaeqaaOWaaeWaaeaacqWGMbGzdaWgaaWcbaGaemOBa4MaemiBaWgabeaakmaabmaabaGaemOyaiMaem4zaC2aaSbaaSqaaiabdMgaPjabdQgaQjabdYgaSbqabaGccqGHRaWkcqWG6bGEdaWgaaWcbaGaemyAaKMaemOAaOMaem4AaSMaemiBaWgabeaaaOGaayjkaiaawMcaaaGaayjkaiaawMcaaaGaayjkaiaawMcaaiabgwSixlabd2gaTnaaBaaaleaacqWGPbqAcqWGQbGAcqWGSbaBaeqaaOGaeiilaWIaeeiiaaIaee4DaCNaeeyAaKMaeeiDaqNaeeiAaGgabaGaemOEaO3aaSbaaSqaaiabdMgaPjabdQgaQjabdUgaRjabdYgaSbqabaGccqGH9aqpcqWGhbWrdaWgaaWcbaGaem4zaCMaemyzauMaemOBa4Maemyzau2aaeWaaeaacqWGPbqAcqWGQbGAcqWGSbaBaiaawIcacaGLPaaacqGG7aWocqWGRbWAaeqaaOGaey4kaSIaemiraq0aaSbaaSqaaiabdEgaNjabdwgaLjabd6gaUjabdwgaLnaabmaabaGaemyAaKMaemOAaOMaemiBaWgacaGLOaGaayzkaaGaei4oaSJaem4AaSgabeaakiabgUcaRiabdoeadnaaBaaaleaacqWGRbWAaeqaaOGaey4kaSIaem4uam1aaSbaaSqaaiabdchaWjabdMgaPjabd6gaUnaabmaabaGaemyAaKMaemOAaOgacaGLOaGaayzkaaaabeaakiabgUcaRiabdIfaynaaBaaaleaacqWGNbWzcqWGLbqzcqWGUbGBcqWGLbqzdaqadaqaaiabdMgaPjabdQgaQjabdYgaSbGaayjkaiaawMcaaiabcUda7iabdUgaRbqabaGccqGHRaWkcqWF1oqzdaWgaaWcbaGaemyAaKMaemOAaOMaem4AaSMaemiBaWgabeaakiaaxMaacaWLjaWaaeWaaeaacqaIZaWmaiaawIcacaGLPaaaaaaa@B3F0@

where

gene(ijl) the gene spotted at location (i, j,l) (see "dimensions and notation" above);

pin(ij) the spot pin used to spot location (i, j);

gnl a transformation due to quantization and saturation;

tδ a transformation due to 'fishtailing';

fnl a transformation due to non-linearity in measurements;

mijkl equals 0 if the spot at location (i, j,l) is 'missing', and 1 otherwise (see "missing data" above);

bgijl the background gradient level (see "background variation" above);

Gg;k the expression level of gene g in channel k;

Dg;k the change in expression due to up-/down-regulation;

Ck the channel effect;

Spin(ij) the spot pin effect;

Xgene(ijl);k the gene × dye interaction;

εijkl the replication error.

Datasets used and estimation of the parameters

In order to estimate the parameters for a number of slides hybridized at the Department of Molecular Genetics (MolGen), DNA-microarray data from 47 Lactococcus lactis IL1403 slides from MolGen [3,16-18] were used (supplementary Table T1). These datasets specify, for each spot: (i) the annotated gene names, (ii) the raw expression values for both channels, and (iii) an estimated background signal. Parameters were determined from the net intensity values of the slides (i.e. corrected for background signals).

Besides MolGen slides, several slides from the public domain were analyzed. Datasets GDS69, GDS100, and GDS273 were obtained from the Gene Expression Omnibus from NCBI [19]. The dataset MEXP-225 was obtained from EBI's ArrayExpress [20]. In the supplementary web site [5], the exact slides used for the parameter estimations are listed.

The SIMAGE web site provides a tool for the estimation steps described in the following sections. In order to obtain robust estimates for the slides, some slides yielding obviously outlying estimates, i.e. when σchannel2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaem4yamMaemiAaGMaemyyaeMaemOBa4MaemOBa4MaemyzauMaemiBaWgabaGaeGOmaidaaaaa@3906@ was larger than μ, were discarded. Only those experiments were used for which at least 3 slides with acceptable estimates were obtained. The estimates of the MolGen "experiment" were determined by the median of the "experiment" slides, while the MolGen "validation" estimates were determined by the median of the estimates of the validation slide data [3] (supplementary Table T1). For each of the 5 experiments, DNA-microarray data obtained from the same slide batch were used to estimate the experiment-specific parameters (see Results). This was done to minimize slide batch-specific bias in parameter estimation. The median, rather than the mean, of the estimates for each parameter is used as input in SIMAGE simulation interface because of the nonsymmetrical distribution of the estimates.

Background gradient and densities

Spot background signals for the MolGen slides were determined as described [3]. Estimates for the number of background densities to be estimated, as well as their average standard deviations, were obtained by visually inspecting a number of experimentally obtained background densities. Furthermore, estimates for the average horizontal and vertical linear tilt were obtained by fitting a regression plane through the background signal distribution.

Non-linearity, quantization and saturation

A direct way to estimate the scanning device bias parameter w is not feasible since this parameter is confounded within the other variables in the SIMAGE model. One could assume absence of scanning device bias (w = 0). We used an alternative method to estimate this parameter (for more details see the supplementary document). The estimation of the non-linearity parameters α1 and α2 is done as follows: in the (M, A) plot for background-corrected data (hence, the net signals), a Lowess curve [21] is fitted. Then a second degree polynomial is fitted to this Lowess curve, and the parameters α1 and α2 are directly derived from the parameters of the polynomial (see the supplementary document for details).

Spot pin effects, channel effects, fishtails and replication variation

After subtracting the estimates for the background signals and the non-linearity effects from yijkl (the original signal) we obtain zijkl, where zijkl = Ggene(ijl);k + Dgene(ijl);k + Ck + Spin(ij) + Xgene(ijl);k + εijkl. The estimation of the gene layer factors G and D is discussed in the following paragraph. For all other factors, the estimation of their parameters is a matter of calculating a variance components model.

The gene-dye interaction is strongest when direct labeling of RNA is applied. An analysis by ANOVA of indirectly-labeled RNA used in self hybridization slides [3] and dye-swapped replicated slides (results not shown) performed at MolGen showed that the gene-dye interaction effects did not differ significantly. Note that the factor Xgene(ijl);k can only reliably be estimated in case dye-swaps are performed with the same RNA.

The fishtail parameter δ was estimated by fitting a quadratic curve through the data points (Aijl,|Mijl|) with Aijl <μ (for details see the supplementary document).

Gene expressions

After correcting zijkl for all factors except G and D, the parameters for G and D are estimated as follows: define Y˜g,k MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacuWGzbqwgaacamaaBaaaleaacqWGNbWzcqGGSaalcqWGRbWAaeqaaaaa@31B8@ as the average value of the nrepreplications Yijkl with gene(ijl) = g : Y˜g;k=1nrepijl|gene(ijl)=gYijl MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacuWGzbqwgaacamaaBaaaleaacqWGNbWzcqGG7aWocqWGRbWAaeqaaOGaeyypa0ZaaSaaaeaacqaIXaqmaeaacqWGUbGBdaWgaaWcbaGaemOCaiNaemyzauMaemiCaahabeaaaaGcdaaeqbqaaiabdMfaznaaBaaaleaacqWGPbqAcqWGQbGAcqWGSbaBaeqaaaqaaiabdMgaPjabdQgaQjabdYgaSjabcYha8jabdEgaNjabdwgaLjabd6gaUjabdwgaLnaabmaabaGaemyAaKMaemOAaOMaemiBaWgacaGLOaGaayzkaaGaeyypa0Jaem4zaCgabeqdcqGHris5aaaa@543C@. Given the distributional assumptions outlined in "gene expressions" above, standard statistical theory provides that both the average log ratio (M˜g=Y˜g;1Y˜g;2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacuWGnbqtgaacamaaBaaaleaacqWGNbWzaeqaaOGaeyypa0JafmywaKLbaGaadaWgaaWcbaGaem4zaCMaei4oaSJaeGymaedabeaakiabgkHiTiqbdMfazzaaiaWaaSbaaSqaaiabdEgaNjabcUda7iabikdaYaqabaaaaa@3AE0@) of the gene and the average intensity (A˜g=12(Y˜g;1+Y˜g;2) MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacuWGbbqqgaacamaaBaaaleaacqWGNbWzaeqaaOGaeyypa0ZaaSqaaSqaaiabigdaXaqaaiabikdaYaaakmaabmaabaGafmywaKLbaGaadaWgaaWcbaGaem4zaCMaei4oaSJaeGymaedabeaakiabgUcaRiqbdMfazzaaiaWaaSbaaSqaaiabdEgaNjabcUda7iabikdaYaqabaaakiaawIcacaGLPaaaaaa@3E58@) of the gene are independently normally distributed, with variances σM2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaemyta0eabaGaeGOmaidaaaaa@30B8@ and σA2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaemyqaeeabaGaeGOmaidaaaaa@30A0@, respectively. The distribution A˜g MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacuWGbbqqgaacamaaBaaaleaacqWGNbWzaeqaaaaa@2F49@ does not depend on whether gene g is up-, down- or non-regulated, and the parameters μ and σA2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaemyqaeeabaGaeGOmaidaaaaa@30A0@ involved, as well as the variance σε2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGae8xTdugabaGaeGOmaidaaaaa@3137@, are estimated in a straightforward way. The mean of the distribution of M˜g MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacuWGnbqtgaacamaaBaaaleaacqWGNbWzaeqaaaaa@2F61@ depends on whether the gene is up-, down- or non-regulated. The parameters π-, π+, μD and σM2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaemyta0eabaGaeGOmaidaaaaa@30B8@ are estimated using the EM-algorithm [22] (Figure (Figure2)2) with some restrictions (see the supplementary document). Note that for self-self hybridizations π- = π+ = 0 and the estimation of σM2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaemyta0eabaGaeGOmaidaaaaa@30B8@ is straightforward (it is the 'ordinary' variance of the M-values). Furthermore, fishtailing does not affect the spots with above-average intensities (Aijl > μ), nor the A-values. For all spots with average intensities higher than the overall average intensity, the A- and M-values are used to estimate parameters.

Figure 2
The gene expression parameters. These parameters (Table 2) were estimated by using the EM-algorithm (see "gene expressions" in the implementation section). The vertical lines constitute a stem-plot of the data. The red, green and blue curves indicate ...

The estimates for σG2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaem4raCeabaGaeGOmaidaaaaa@30AC@ and ρ (see "gene expressions" above), required for the SIMAGE model, are calculated from the estimates for σA2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaemyqaeeabaGaeGOmaidaaaaa@30A0@ and σM2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaemyta0eabaGaeGOmaidaaaaa@30B8@.

Results

To illustrate the use of SIMAGE in drawing meaningful conclusions about the design and analysis of DNA microarray experiments we show a number of examples based on DNA microarray data generated within the MolGen department. SIMAGE is used as follows: (i) define parameters based on real DNA microarray data that are laboratory / experiment-specific, (ii) these parameters are roughly estimated by our estimation procedure, (iii) using these estimated parameters DNA microarray data is simulated mimicking real DNA microarray data as close as possible.

The parameter estimation

On the basis of a number of experiments that were performed at the MolGen department, the "MolGen experiment" parameters, 100 slides were simulated using SIMAGE. For each simulated slide, the model parameters were estimated using the estimation web-interface. Deviations of the mean and median of the estimated parameters from the original parameters are shown in Table Table33 and Figure Figure33.

Figure 3
Distribution of the deviations of several of the model parameters estimated from 100 simulated DNA-microarray slides. The deviation is calculated as (estimate - true value) / (standard deviation of 100 estimates).
Table 3
Estimation of parameters from the simulation of 100 DNA-microarray slides. The mentioned deviations are the number of estimated standard-deviations that the estimated mean, respectively median, lie away from the true value of the parameter.

The estimation of μ, σchannel and σε are good (Table (Table3).3). Parameter σpin is somewhat systematically overestimated (Fig. (Fig.3).3). The parameters σG2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaem4raCeabaGaeGOmaidaaaaa@30AC@ and ρ tend to be systematically mildly underestimated. This is likely because of the nonsymmetric estimation of ρ (the true value of ρ is usually close to 1), which influences σG2 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaaiiGacqWFdpWCdaqhaaWcbaGaem4raCeabaGaeGOmaidaaaaa@30AC@ which is calculated from the estimate of ρ. The performance of the estimations of δ, α1, α2 and w depends highly on the actual values of these parameters. For low values of these parameters, they tend to be overestimated, while they are for high values underestimated. However, the estimation is rather good. As an indication, based on 100 slides with δ, α1, α2, and w all zero, the maxima of the 100 estimates for these parameters are 0.01, 0.004, 0.08, and 0.16 respectively.

The quality of the estimations of μ-, μ+, π-, π+ is highly experiment-dependent. Table Table33 and Figure Figure33 show results for the choice of μ- = -1, μ+ = 1, π- = π+ = 10%, hence when the proportions of regulated genes and their average shifts in log ratio are considerable. The theory of Dempster and coworkers (1977) [22] indicates that the estimates of μ-, μ+, π-, π+ are unbiased: provided the correctness of our underlying statistical assumptions, no other estimators perform better. This is in concordance with the deviations listed in Table Table3.3. In some cases where the true values of μ-, μ+, π-, and π+ are small their estimates are rather poor (Fig. (Fig.3).3). The user of the web-interface is suggested to 'tweak' these gene-expression estimates somewhat, if necessary.

Within-laboratory experiment-dependency of estimated parameters

In order to investigate whether parameter estimates for different experiments from the same laboratory are significantly different, two profiles were generated: (i) "real" experiments [16-18] and (ii) validation experiments [3]. A Bonferonni-corrected Mann-Whitney test (α = 5%) showed that only parameters μ and ρ differ between the DNA-microarray data simulated using both profiles (supplementary Fig. S2, upper panel). Within the various "real" experiments, only the parameters describing regulation (μ+, π+,μ-, and π-) differ significantly (supplementary Fig. S2, lower panel). Parameters concerned with technical aspects of the DNA microarray spotter and scanner are, as expected, not significantly different, since the same equipment in one laboratory was used. Future studies on datasets obtained in other laboratories may implicate other parameters than those described above.

Between-laboratory experiment-dependency of estimated parameters

The model parameters were estimated from five different datasets, obtained by different laboratories and querying the mRNA levels of different organisms. The CVs of the model parameters obtained for individual datasets are, in general, lower than those obtained for the combined experiments (Fig. (Fig.4).4). Parameters which differ strongly between the datasets (combined CV values are higher than the CVs of the individual experiment) are: average expression (μ), tail behavior (δ), gene variance (σ2gene), and the general error (σε). For a few datasets the estimation of the parameters is quite "noisy", e.g. the CV for the non-linearity of scanner parameter (w) of the GDS69 dataset (Fig. (Fig.4).4). ANOVA shows that the estimated parameters, with the exception of the spot pin variation σpin and the covariance ρ, are strongly experiment-dependent (Fig. (Fig.4).4). In particular the gene variance (σ2gene) is strongly influenced by the experiment (p-value of 10-21; Fig. Fig.44).

Figure 4
Experiment-dependency of the parameters of the SIMAGE model. The bar-graph shows the CVs ((standard deviation / average) × 100%) of the parameters, estimated from the individual datasets. The resulting CV was determined from the average estimates ...

Graphical features of the simulated data

To ensure that the simulated data contains similar properties as experimentally obtained data, several aspects of the simulated slides were inspected. In supplementary Figure S3 three simulated and three "real" slides are visualized via an (M, A)-plot and by grid-based box plots. Several properties of the experimental slides are clearly present in a similar way in the simulated slides. Figure Figure55 shows a graphical representation of the net and background spot signals of a simulated slide.

Figure 5
Visualization of the signals of a simulated slide. The upper picture shows a visualization of the measured expressions, while the lower picture is a visualization of the measured background signals. The areas designated as 'missing' are grey.

The modeled differentially expressed genes

SIMAGE allows modeling differentially expressed genes as is demonstrated in an in silico simulated experiment (Fig. (Fig.6).6). In almost all cases the p-values and ratios of the 66 modeled differentially expressed genes (the blue diamonds in Fig. Fig.6)6) are significantly lower than those of the non-modeled genes (the red squares in Fig. Fig.6).6). Relatively few of the known differentially expressed genes had signals that were close to the background signals: these genes get p-values close to 1. The inset in Figure Figure66 clearly demonstrates the signal dependency of the p-values: differentially expressed genes with higher expression levels are assigned lower p-values. This is in concordance with the p-value distributions in "real" DNA-microarray datasets.

Figure 6
Distribution of p-values of a DNA-microarray experiment simulated by SIMAGE. Data for 2200 genes, in 6 slides with technical duplicates hybridized in dye-swaps, was simulated using the MolGen experiment profile (supplementary Table T1) with some changes: ...

Discussion

As various factors, of both technical and biological nature, affect the quality of DNA-microarray data, it is essential to use a proper experiment design and sophisticated statistics and bioinformatics methods to deal with these variables. Since the factors involved, as well as their relative influence on data quality, vary between DNA-microarray laboratories and differ even between experiments executed in the same laboratory, the question as to which design and analysis method is best, cannot be answered in general terms. SIMAGE, a model and web-implementation to simulate gene expressions, requires the specification of up to 29 parameters. It allows simulating data that resemble experimental DNA-microarray data. To determine the relative contribution of the various parameters in DNA-microarray data is a knowledgeable task. A second web-implementation is provided to easily provide rough but reasonable estimates of most of these parameters from experimental DNA-microarray datasets. There is an important educational aspect about the simulation of DNA-microarray data, which is clearly illustrated in Figure Figure1B:1B: it provides clear insights in the contribution of each background layer of the model to the measured signal.

Almost all parameters in the model are strongly dependent on the experiment performed (Fig. (Fig.44 and supplementary Fig. S2). This holds both for biological parameters in several different experiments from the same laboratory and for technical and biological parameters in experiments from different laboratories. The experiment-dependency of the μ estimations (Fig. (Fig.4)4) is obvious from the fact that the average signals in the prokaryote datasets are higher than those in the eukaryote datasets. This is due to the fact that prokaryotes generally express a larger complement of their genes. The experiment-dependency of the gene variance (σ2gene) might also be attributed to differences in gene expression in the different organisms interrogated in the DNA-microarray experiments discussed above. The latter is also clearly reflected by the high significance of the σ2gene parameter obtained by ANOVA.

Any method for simulation of DNA microarray data can be questioned and criticized, mainly because there is neither established theory for the relation between expression (observed) and factors involved (some can be observed, others are hidden), nor for the statistical distribution of differential expression given by various causes across genes. Choices about the statistical aspects of the data need to be made when building a simulation model such as SIMAGE. Different choices would lead to (slightly) different models with other 'optimal parameter estimation methods'. We have compared the distribution of simulated data (under various circumstances) with that of experimentally obtained data and adapted our model to be able to mimic experimental data as much as possible.

Creating a SIMAGE-like model to simulate data from other than dual-dye DNA microarray platforms might be interesting for future work. Our approach, using layers to model the factors involved, could be universally applied to simulate such data. This is, however, quite a task, since each type of DNA microarray platform has its own specific properties. Affymetrix, for instance, employs single-dye chips. The model of the synthesis of oligonucleotides on the chip surface and the different signals obtained for multiple probes would have to be quite sophisticated. Another interesting approach would be to expand SIMAGE to incorporate gene-regulatory interactions or genes involved in documented pathways. The use of simulated gene-regulatory networks would provide a powerful tool to estimate the efficiency of network reconstruction algorithms.

Conclusion

A number of models for DNA microarray data simulation have recently been developed (Table (Table1).1). The question how to simulate DNA microarray data in the best way is not easily and straight-forwardly answered. There are many considerations that pose a researcher wanting to simulate DNA microarray data for difficult choices. We have developed SIMAGE: software that simulates dual-dye DNA microarray data. The model that we employ, although more advanced than existing models, is still a simplification of reality. To ensure that the simulated DNA microarray data mimics real data as close as possible the model is "fitted" onto "real" DNA microarray data.

Availability and requirements

Project name: SIMAGE

Project home page: http://bioinformatics.biol.rug.nl/websoftware/simage

Operating system(s): Runs on any JavaScript enabled web-browser.

Programming languages: PHP, Pascal, R, and shell scripting.

Other requirements: Additional files and figures are contained in the supplementary web site which is accessible from the above-mentioned web site.

License: The web-resource is freely accessible. Details concerning the conditions for using SIMAGE are available from the above-mentioned web site.

Authors' contributions

SvH and CA conceived the SIMAGE concept and methodology. SvH programmed SIMAGE including the web-interface and CA programmed the estimator script. CA and SvH drafted the manuscript and generated the figures and tables. RJ, JK and OK critically read and revised the final manuscript. All authors read and approved the final manuscript.

Acknowledgements

We would like to thank Gerard te Meerman, Anne de Jong, and Paul Eilers for useful discussion and suggestions.

References

  • Piper MDW, ran-Lapujade P, Bro C, Regenberg B, Knudsen S, Nielsen J, Pronk JT. Reproducibility of oligonucleotide microarray transcriptome analyses - An interlaboratory comparison using chemostat cultures of Saccharomyces cerevisiae. J Biol Chem. 2002;277:37001–37008. [PubMed]
  • Chen JJ, Delongchamp RR, Tsai CA, Hsueh HM, Sistare F, Thompson KL, Desai VG, Fuscoe JG. Analysis of variance components in gene expression data. Bioinformatics. 2004;20:1436–1446. [PubMed]
  • Van Hijum SAFT, De Jong A, Baerends RJ, Karsens HA, Kramer NE, Larsen R, Den Hengst CD, Albers CJ, Kok J, Kuipers OP. A generally applicable validation scheme for the assessment of factors involved in reproducibility and quality of DNA-microarray data. BMC Genomics. 2005;6:77. [PMC free article] [PubMed]
  • Kerr MK, Martin M, Churchill GA. Analysis of variance for gene expression microarray data. J Comput Biol. 2000;7:819–837. [PubMed]
  • The SIMAGE web-site. 2006. http://bioinformatics.biol.rug.nl/websoftware/simage
  • The FreePascal homepage. 2006. http://www.freepascal.org
  • The R project. 2006. http://www.r-project.org
  • Wit E, McClure J. Statistics for Microarrays - Design, Analysis and Inference. first. Hobroken NJ, John Wiley & Sons; 2004.
  • Efron B, Tibshirani R, Storey J, Tusher V. Empirical Bayes analysis of a microarray experiment. J Am Stat Assoc. 2001;96:1151–1160.
  • Wolkenhouer O, Moeller-Levet C, Sanchez-Cabo F. The curse of normalization. Comp Func Genomics. 2002;3:375–379. [PMC free article] [PubMed]
  • Dombkowski AA, Thibodeau BJ, Starcevic SL, Novak RF. Gene-specific dye bias in microarray reference designs. FEBS Lett. 2004;560:120–124. [PubMed]
  • Martin-Magniette ML, Aubert J, Cabannes E, Daudin JJ. Evaluation of the gene-specific dye bias in cDNA microarray experiments. Bioinformatics. 2005;21:1995–2000. [PubMed]
  • Dudoit S, Yang YH, Luu P, Speed TP. Normalization for cDNA microarray data. Proc SPIE. 2001;4266:141–152.
  • Widrow B, Kollár I, Liu MC. Statistical theory of quantization. IEEE Trans Instrum Meas. 1996;45:353–361.
  • García de la Nava J, Van Hijum SAFT, Trelles O. Saturation and Quantization Reduction in Microarray Experiments using Two Scans at Different Sensitivities. Stat Appl Gen Mol Biol. 2004;3:Article 11. [PubMed]
  • Larsen R. Transcriptional regulation of central amino acid metabolism in Lactococcus lactis. the Netherlands, University of Groningen; 2005.
  • Kramer NE. Nisin-resistance in Gram-positive bacteria. the Netherlands, University of Groningen; 2005.
  • Den Hengst CD, Van Hijum SAFT, Geurts JM, Nauta A, Kok J, Kuipers OP. The Lactococcus lactis CodY regulon: identification of a conserved cis-regulatory element. J Biol Chem. 2005;280:34332–34342. [PubMed]
  • The gene expression omnibus (GEO) from NCBI. 2006. http://www.ncbi.nlm.nih.gov/geo
  • EBI databases - ArrayExpress home. 2006. http://www.ebi.ac.uk/arrayexpress
  • Yang YH, Dudoit S, Luu P, Lin DM, Peng V, Ngai J, Speed TP. Normalization for cDNA microarray data: a robust composite method addressing single and multiple slide systematic variation. Nucleic Acids Res. 2002;30:e15. [PMC free article] [PubMed]
  • Dempster AP, Laird NM, Rubin DB. Maximum Likelihood from Incomplete Data Via EM Algorithm. J R Stat Soc Ser B Methodol. 1977;39:1–38.
  • Lalush DS. Characterization, modeling, and simulation of mouse microarray data. In: Lin S and Johnson K, editor. Methods of Microarray Data Analysis III. first. Boston, USA, Kluwer; 2003.
  • Balagurunathan Y, Dougherty ER, Chen YD, Bittner ML, Trent JM. Simulation of cDNA microarrays via a parameterized random signal model. J Biomed Opt. 2002;7:507–523. [PubMed]
  • Lonnstedt I, Speed T. Replicated microarray data. Stat Sin. 2002;12:31–46.
  • Wierling CK, Steinfath M, Elge T, Schulze-Kremer S, Aanstad P, Clark M, Lehrach H, Herwig R. Simulation of DNA array hybridization experiments and evaluation of critical parameters during subsequent image and data analysis. BMC Bioinformatics. 2002;3:29. [PMC free article] [PubMed]
  • Gene expression data simulator. 2006. http://bioinformatics.upmc.edu/GE2/index.html

Articles from BMC Bioinformatics are provided here courtesy of BioMed Central
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...