• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of genbioBioMed CentralBiomed Central Web Sitesearchsubmit a manuscriptregisterthis articleGenome BiologyJournal Front Page
Genome Biol. 2006; 7(10): R100.
Published online Oct 31, 2006. doi:  10.1186/gb-2006-7-10-r100
PMCID: PMC1794559

CellProfiler: image analysis software for identifying and quantifying cell phenotypes

Abstract

Biologists can now prepare and image thousands of samples per day using automation, enabling chemical screens and functional genomics (for example, using RNA interference). Here we describe the first free, open-source system designed for flexible, high-throughput cell image analysis, CellProfiler. CellProfiler can address a variety of biological questions quantitatively, including standard assays (for example, cell count, size, per-cell protein levels) and complex morphological assays (for example, cell/organelle shape or subcellular patterns of DNA or protein staining).

Rationale

Examining cells by microscopy has long been a primary method for studying cellular function. When cells are stained appropriately, visual analysis can reveal biological mechanisms. Advanced microscopes can now, in a single day, easily collect thousands of high resolution images of cells from time-lapse experiments and from large-scale screens using chemical compounds, RNA interference (RNAi) reagents, or expression plasmids [1-5]. However, a bottleneck exists at the image analysis stage. Several pioneering large screens have been scored through visual inspection by expert biologists [6,7], whose interpretive ability will not soon be replicated by a computer. Still, for most applications, image cytometry (automated cell image analysis) is strongly preferable to analysis by eye. In fact, in some cases image cytometry is absolutely required to extract the full spectrum of information present in biological images, for reasons we discuss here.

First, while human observers typically score one or at most a few cellular features, image cytometry simultaneously yields many informative measures of cells, including the intensity and localization of each fluorescently labeled cellular component (for example, DNA or protein) within each subcellular compartment, as well as the number, size, and shape of those subcellular compartments. Image-based analysis is thus versatile, inherently multiplexed, and high in information content. Like flow cytometry, image cytometry measures the per-cell amount of protein and DNA, but can more conveniently handle hundreds of thousands of distinct samples and is also compatible with adherent cell types, time-lapse samples, and intact tissues. In addition, image cytometry can accurately measure protein texture and localization as well as cell shape and size.

Second, human-scored image analysis is qualitative, usually categorizing samples as 'hits' (where normal physiology is grossly disturbed) or 'non-hits'. By contrast, automated analysis rapidly produces consistent, quantitative measures for every image. In addition to uncovering subtle samples of interest that would otherwise be missed, systems-level conclusions can be drawn directly from the quantitative measures for every image. Measuring a large number of features, even features undetectable by eye, has proven useful for screening as well as cytological/cytometric profiling, which can group similar genes or reveal a drug's mechanism of action [3,8-14].

Third, image cytometry individually measures each cell rather than producing a score for the entire image. Because individual cells' responses are inhomogeneous [15], multiparametric single cell data from several types of instruments have proven much more powerful than whole-population data (for example, western blots or mRNA expression chips) for clustering genes, deriving causal networks, classifying protein localization, and diagnosing disease [10,16-18]. In addition, individual cell measurements can reveal samples that differ in only a subpopulation of cells, which would otherwise be masked in whole-population measures.

Fourth, quantitative image analysis is able to detect some features that are not readily detectable by a human observer. For example, the two-fold difference in DNA staining intensity that reveals whether a cell is in G1 or G2 phase of the cell cycle are measurable by computer but are difficult for the human eye to observe in cell images. Furthermore, small but biologically significant differences, for example, a 10% increase in nucleus size, are not noticeable by eye. Other features, for example, the texture (smoothness) of protein or DNA staining, are observable but not quantifiable by eye. Pathologists have known for years that changes in DNA or protein texture can correlate to profound and otherwise undetectable changes in cell physiology, a fact used in diagnosis of disease [17,19]. Even changes not visible to the human eye can reveal disease state [20].

Fifth, image cytometry is much less labor-intensive and higher-throughput. Appropriate software produces reliable results from a large-scale experiment in hours, versus months of tedious visual inspection. This improvement is more than an incremental technical advance, because it relieves the one remaining bottleneck to routinely conducting such experiments.

Prior to the work presented here, the only flexible, open-source biological image analysis package was ImageJ/NIH Image [21]. This package has been successfully used by many laboratories. Its design, however, is geared more towards the analysis of individual images (comparable to Adobe Photoshop) rather than flexible, high-throughput work. Macros can be written in ImageJ for high-throughput work but adapting macros to new projects requires that biologists learn a programming language.

While not creating a general, flexible software tool, many groups have benefited from automated cell image analysis by developing their own scripts, macros, and plug-ins to accomplish specific image analysis tasks. Custom programs written in commercial software (for example, MetaMorph, ImagePro Plus, MATLAB) or Java have been used to identify, measure, and track cells in images and time lapse movies [10,22,23]. Such studies clearly show the power of automated image analysis for biological discovery. However, most of these custom programs are not modular, so combining several steps and changing settings requires interacting directly with the code and is simply not practical for routinely processing hundreds of thousands of images or sending jobs to a cluster. The effort expended by laboratories in creating an analysis solution with a particular software package is often lost after the initial experiment is completed; other laboratories rarely use the methods because they are customized for a particular cell type, assay or even image set. Furthermore, although developing a routine for a new cell type or assay usually requires testing multiple algorithms, it is impractical to implement and test several published methods for a particular project.

Commercial software has also been developed, mainly for the pharmaceutical screening market, by companies including Cellomics, TTP LabTech, Evotec, Molecular Devices, and GE Healthcare [24]. Development of these packages has been guided mainly by mammalian cell types and cellular features of pharmaceutical interest, including protein translocation, micronucleus formation, neurite outgrowth, and cell count [25]. The high cost and the bundling of commercial software with hardware makes it impractical to test several programs for a new project. The proprietary nature of the code prevents researchers from knowing the strategy of a given algorithm and it cannot be modified if desired. As is the case with many laboratories, we have found commercial packages useful for some screens in mammalian cells, but in other cases limiting [1,5,26,27].

Furthermore, key challenges remain in image analysis algorithm development itself [28]. Cell image analysis has been described as one of the greatest remaining challenges in screening [5,29], and as a field is "very much in its infancy" [30] and "lag [s] behind the adoption of high-throughput imaging technologies" [10]. Accurate cell identification is required to extract meaningful measures from images, but even for mammalian cell types, existing software often fails on crowded cell samples, which has severely limited screens thus far. Screens in most non-mammalian organisms have been limited to visual inspection.

In summary, while existing software enables particular assays for particular cell types, high throughput image analysis has, to this point, been impractical unless an image analysis expert develops a customized solution, or unless commercial packages are used with their built-in algorithms for a limited set of cellular features and for a limited set of cell types. There exists a clear need for a powerful, flexible, open-source platform for high-throughput cell image analysis.

Here we describe the open-source CellProfiler project, our effort to develop such a software system for the scientific community. CellProfiler simultaneously measures the size, shape, intensity and texture of a variety of cell types in a high throughput manner. Note that we focus in this paper not on the technical details of the software (which are described in the manual), nor computational validation of the mostly published algorithms, nor on a mechanistic study of any particular biological finding. Rather, we describe the system, validate the software for a variety of real-world biological problems, demonstrate the breadth of its utility (including on various cell types and assays), and hope to stimulate ideas within the biological community for future applications of the software.

Overview of the software system

The following can be freely downloaded from the CellProfiler website [31]: CellProfiler for Windows, Mac, and Unix (compiled, not requiring MATLAB); CellProfiler's MATLAB source code; a full technical description of CellProfiler's algorithms and measurements in an extensive PDF formatted manual (Additional data file 1), identical to the information found in help buttons within CellProfiler; and pipelines to identify the various cell types in this paper (see Additional data file 2 for a list of the modules in each pipeline).

CellProfiler is freely available modular image analysis software that is capable of handling hundreds of thousands of images. The software contains already-developed methods for many cell types and assays and is also an open-source, flexible platform for the sharing, testing, and development of new methods by image analysis experts. CellProfiler meets the needs discussed in the introduction, in that it contains: advanced algorithms for image analysis that are able to accurately identify crowded cells and non-mammalian cell types; a modular, flexible design allowing analysis of new assays and phenotypes; open-source code so the underlying methodology is known and can be modified or improved by others; a user-friendly interface; the capability to make use of clusters of computers when available; and a design that eliminates the tedium of the many steps typically involved in image analysis, many of which are not easily transferable from one project to another (for example, image formatting, combining several image analysis steps, or repeating the analysis with slightly different parameters). CellProfiler was designed and optimized for the most common high-content screening image format, that is, two-dimensional images. It has very limited support for time-lapse and three-dimensional image stack analysis, although researchers interested in these areas could build compatible modules.

Most image analysis projects, even for new cell types or assays, can be accomplished simply by pointing and clicking using CellProfiler's graphical user interface (Figure (Figure1a).1a). The software uses the concept of a 'pipeline' of individual modules (Figure (Figure1b;1b; Additional data file 2). Each module processes the images in some manner, and the modules are placed in sequential order to create a pipeline: usually image processing, then object identification, then measurement. Over 50 CellProfiler modules are currently available (Additional data file 3). Most modules are automatic, but the software also allows interactive modules (for example, the user clicks to outline a region of interest in each image). Modules are mixed and matched for a specific project and each module's settings are adjusted appropriately. Upon starting the analysis, each image (or group of images if multiple wavelengths are available) travels through the pipeline and is processed by each module in order.

Figure 1
CellProfiler overview and features. (a) Main CellProfiler interface, with an analysis pipeline displayed. (b) Schematic of a typical CellProfiler pipeline. (c) Image processing example: uneven illumination from the left to the right within each field ...

The pipeline's modules and their settings are saved and can be used to reproduce the analysis or share with colleagues. Many example pipelines are provided at the CellProfiler website [31] to provide a starting point for new analyses. To explain some features of CellProfiler, we describe in the subsequent sections the general steps in a typical pipeline.

Image processing, including illumination correction

One of the most critical steps in image analysis is illumination correction. Illumination often varies more than 1.5-fold across the field of view, even when using fiber optic light sources, and occasionally even when images are thought to be already illumination-corrected by commercial image analysis software packages (TRJ, AEC, DMS, and PG, unpublished data). This adds an unacceptable level of noise, obscures real quantitative differences, and prevents many types of biological experiments that rely on accurate fluorescence intensity measurements (for example, DNA content of a nucleus, which only varies by two-fold during the cell cycle). CellProfiler contains standard methods plus our new methods [32] to address illumination variation, allowing various methods to be compared side by side and, ultimately, providing less noisy quantitative measures (Figure 1c,d). We use these illumination correction methods for every high-throughput image set we process, because using raw images degrades intensity measurements and, less obviously, can preclude accurate cell identification. This adversely affects all types of measurements, from intensity based measures (for example, DNA content histograms [1]) to area and shape measurements (TRJ, AEC, DMS, and PG, unpublished data). CellProfiler's other image processing modules perform other needed adjustments prior to identifying cells in images, for example, aligning or cropping (Additional data file 3).

Cell identification

Object identification (also called segmentation) is the most challenging step in image analysis and its accuracy determines the accuracy of the resulting cell measurements. CellProfiler's object identification modules contain a variety of published and tested algorithms for identifying cells based on fluorescence, including work from our own group and others (Figure (Figure1e).1e). In most biological images, cells touch each other, causing the simple, fast algorithms used in some commercial software packages to fail. The first objects identified in an image (called primary objects) are often nuclei identified from DNA-stained images, although primary objects can also be whole cells, beads, speckles, tumors, and so on. Several simple algorithms are built into CellProfiler for cases where primary objects are well-dispersed, non-confluent, and bright relative to the background. More importantly, to effectively identify clumped objects, CellProfiler contains a modular three-step strategy based on previously published algorithms [33-37]. First, clumped objects are recognized and separated; second, the dividing lines between objects are found; and third, some of the resulting objects are either removed or merged together based on their measurements, for example, their size or shape.

After primary objects (often nuclei) are identified, the edges of secondary objects that surround each primary object (often cell edges) can be found more easily. Measuring cell size in Drosophila was not previously feasible because the commonly used watershed method [37] often fails to find the borders between clumped cells. We have, therefore, implemented in CellProfiler an improved Propagate algorithm [38], in addition to several standard methods of secondary object identification. Other subcellular compartments can also be identified, including the cytoplasm (the part of each cell excluding the nucleus) and the cell or nuclear membrane (the edge of the cell or nucleus).

The technical description of these algorithms is omitted here but is available in the online help and manual, in addition to previously published references cited therein (Additional data file 1). The identification modules include a 'test mode' for comparing several algorithms side by side in order to choose the best approach. We have found that these cell identification methods are flexible to various cell morphologies. This flexibility is convenient but, more importantly, often allows accurate identification of cells with unusual morphologies within a population of normal cells.

Measurements and data analysis

CellProfiler measures a large number of features for each identified cell or subcellular compartment, including area, shape, intensity, and texture (each feature is described in Additional data file 4). This includes many standard features [39,40], but also complex measurements like Zernike shape features [41], and Haralick and Gabor texture features [42-44], which are described in detail in the online help and manual. There are also modules to measure various features (for example, intensity, texture, saturation, blur, area occupied by a stain) of an image in its entirety. A severe limitation of most commercial software is the inability to adapt to new biological questions by calculating new features from identified cells [5]. By contrast, CellProfiler's modular design and open-source code allows quickly measuring new cellular phenotypes as needed.

Measurements are accessible in several ways: using CellProfiler's built-in viewing and plotting data tools (Additional data file 5); exporting in a tab-delimited spreadsheet format that can be opened in programs like Microsoft Excel or OpenOffice Calc; exporting in a format that can be imported into a database like Oracle or MySQL; or directly in MATLAB.

Usability

Like most new software in the laboratory, the process of setting up a CellProfiler analysis may take several days if the user is learning the software for the first time. Several resources help at this stage: the built-in help, the manual (Additional data file 1), the online discussion forum [31], the 'test mode' for the Identify modules that show results from various options side by side, and built-in image and data tools to interact with processed images and cell measurements (Additional data file 5). The flexible, modular design and point-and-click interface make setting up an analysis feasible for non-programmers. Over time, experienced users typically require less than a day to set up an entirely new experiment (for example, a new cell type or unusual measurement scheme). When performing the same analysis on different image sets where sample preparation is the only variable, we test the analysis on a few sample images and sometimes change one or two settings in the Identify modules. This takes less than an hour and is essentially a quality control step. Once a pipeline is satisfactory, analysis can be performed on the local computer or automatically divided into smaller batches to be sent to a cluster of computers, described in more detail in later sections.

CellProfiler's code is open-source under the GNU public license. Its image handling is flexible: there is no requirement for images to have a certain naming structure and many standard image formats plus some movie formats are supported. Its modular structure allows experts to expand the software to new file formats or add new algorithms. The source code was written in MATLAB because it is a powerful, easy to learn language, commonly used for scientific applications, including prototyping image analysis routines. Because the source code is well-documented, it is understandable even by non-programmers. Computationally intensive tasks use either MATLAB's native compiled functions or our own compiled C++ implementations to improve the speed. Analysis times vary widely depending on the image size, the number of objects found per image, and the number of features measured, but typical pipelines require from 20 seconds to five minutes per image on standard desktop computers.

Validation of CellProfiler for many phenotypes

We first demonstrated that CellProfiler's methods could accurately measure many different biologically important features of cells using several cell types, including Drosophila Kc167 cells because these cells are particularly challenging to identify by automated image analysis [5,27], and they enable rapid genome-wide screens using living cell microarrays [26]. Using the basic cell-culture methods described previously [26], we prepared Drosophila Kc167 cells for experiments shown in Figures Figures11 and and22 by pretreating the cells with double-stranded RNA (dsRNA) against the noted genes for two days prior to plating on plain glass slides and growing for a further 3 days in the presence of dsRNA. Specifically, 50 μg dsRNA plus 30 μl fugene in 1 ml serum-free medium were transfected into a 10 cm plate containing 20 million cells in 10 ml medium. We prepared human HT29 cells (Figures (Figures1,1, ,2,2, ,3)3) as previously described [1].

Figure 2
Validation of CellProfiler for many cellular phenotypes. (a) Cell count: for a set of 6 images of wild-type human HT29 cells (left), two researchers' counts varied by 11%, and CellProfiler's counts were within 6% of their average. For images of Drosophila ...
Figure 3
Identifying mutant shapes and textures. In each case, four images of each sample were quantitatively analyzed and images were adjusted using Adobe Photoshop auto levels for display only. Scale bars = 15 μm. (a) The unusual cell shape induced by ...

Direct comparison of image analysis software is difficult because results from image analysis can be heavily skewed by how the software is tuned and commercial software packages are numerous and expensive. Furthermore, the algorithms in commercial software are proprietary and so cannot be directly compared apart from the entire software package, including preprocessing methods. The best practical comparison, therefore, is for software developers to release the results of their software on standard image sets or versus gold standards (visual inspection, Coulter particle counters, and so on). In subsequent sections, therefore, we present such comparisons. Note that once validated, any of these experiments could be expanded to a large-scale genome-wide RNAi screen or chemical library screen.

Cell count (used to probe cell proliferation/apoptosis/death) is a straightforward phenotype that has, nonetheless, proved challenging for many cell types due to the poor ability of existing software to separate clumped nuclei. For human cells (Figure (Figure2a,2a, left), CellProfiler's accuracy compared to manual counting is twice that reported for a commercial software package [25]. CellProfiler also counted the more difficult-to-identify Drosophila Kc167 cells (Figure (Figure2a,2a, right). Cell size was not previously measurable for many cell types, but CellProfiler's measurements were consistent with the gold standard, a Coulter particle size counter (Figure (Figure2b).2b). While an automated routine has been developed for this cell type [45], this is, to our knowledge, the first report on the quantitative accuracy of any software to count and measure cell size in Drosophila Kc167 cells and the results indicate that such screens are now feasible.

Cell count and size can at least be observed by eye even if quantitative high throughput screening is impractical. In contrast, certain phenotypes, like changes in DNA content, are impossible to discern by eye. Unlike whole population-based methods, image cytometry measures individual cell fluorescence intensities so that the DNA content of DNA-stained cells can be determined [46,47]. These measurements are very easily degraded by anomalies in the illumination of the field of view and poor identification algorithms (the most common errors are counting two nearby nuclei as one nucleus with twice the DNA content and incorrectly splitting a nucleus into two half-nuclei). This is, therefore, a very demanding phenotype to measure from images.

Image analysis with CellProfiler produced the expected DNA content distributions for both human and Drosophila cell populations (Figure (Figure2c).2c). As another test, we confirmed that the green fluorescent protein (GFP)-histone content per cell decreases by roughly half when a cell divides into two daughter cells during mitosis (Figure (Figure2d).2d). Classification of cells based on 2N, 4N, and 8N DNA content is, therefore, possible based on an image of DNA-stained nuclei (Additional data file 6). This is useful not only in studies of cell cycle per se: cell cycle stage is a known cause of variability in biological samples, so analyzing a phenotype of interest with respect to the cell cycle eliminates a confounding variable (for example, the phenotype of interest could be assessed only in G1 phase cells, which have 2N DNA content).

Further, image cytometry adds an additional level of information about cell cycle distribution. Whereas flow cytometry based on a DNA stain alone cannot distinguish cells in G2 and M phase (both having the same 4N DNA content), image cytometry reveals that these two populations differ in that mitotic cells have smaller nuclei on average (Figure (Figure2e,2e, right).

The total amount of a protein or phospho-protein per cell can be measured by analysis of fluorescent antibody staining (Figure (Figure2e,2e, left), amounting to single-cell western blots. Furthermore, image cytometry can determine the localization of staining relative to other labeled cellular compartments. The change in localization of the nuclear factor (NF)κB transcription factor in response to tumor necrosis factor (TNF)α in MCF7 cells can be monitored (Figure (Figure2f).2f). We have previously used the software to confirm the localization of a protein predominantly at the membrane [48]. The software can also identify, count, and measure the shape, size, and intensity of subcellular structures such as nuclear speckles (Figure (Figure2g2g).

Finally, image analysis can probe other phenotypes that are not otherwise easily measured, such as shape and texture/smoothness. Cell morphology has not often been quantitatively measured, despite its importance in normal cellular physiology and in disease diagnosis [6,17,19,49]. Many of the shape and texture measurements for wild-type cells show non-Gaussian distributions (Additional data file 7). Therefore, independently measuring every cell by image analysis is particularly valuable because the population cannot be accurately described by reduction to a few parameters like mean and standard deviation. We found that changes in cell shape and actin texture induced by gene-specific RNAi were measurable (Figure (Figure3),3), opening up the possibility for high-throughput screens for these and other morphologies.

Cytological profiling to reveal pathways targeted by drugs

Having demonstrated CellProfiler's ability to measure a large number of relevant phenotypes, we applied it to a publicly available dose-response image set of a Forkhead-EGFP cytoplasm to nucleus translocation assay in human cells grown in multi-well plates (Figure (Figure4a).4a). First, we ran a CellProfiler pipeline (Additional data file 2, part E) to calculate an illumination correction function for each of the five slides and each of the two channels (<10 minutes processing time per slide on a single computer). We then used another CellProfiler pipeline (Additional data file 2, part A) to load each image, correct its illumination using the pre-calculated functions, identify nuclei, identify cell edges, and use the nucleus and cell outlines to define the cytoplasmic region of each cell, thereby defining three compartments for each cell: nucleus, cell, and cytoplasm. For each slide, we tested the pipeline on several random test images and fine-tuned settings in the identification modules as needed. Modules in the pipeline were included to measure: multiple features describing the area and shape of each compartment for each cell; multiple features describing the intensity and texture of each channel within each compartment, including several scales of texture; and the overall intensity, the percent saturation and the amount of blur for the entire image, for quality control purposes. The analysis was run on a desktop computer at a rate of >1 image/minute.

Figure 4
CellProfiler analysis of a Forkhead (FOXO1A) cytoplasm-nucleus translocation assay. (a) Example images from the high throughput image set in human U2OS osteosarcoma cells, showing no treatment (left) and 150 nM Wortmannin (right) after 1 hour treatment, ...

The translocation was easily quantified by many features (Figure (Figure4b;4b; Additional data file 8), the best of which achieved the highest published scores for assay quality yet (Figure (Figure4c),4c), indicating this software's improved ability to identify samples of interest in screens versus algorithms in commercial software [50,51].

Existing commercial software for this assay typically measures translocation only, but we wondered whether the broad spectrum of measurements recorded by CellProfiler (the cytological profiles) could reveal further insights. We noticed that certain features of nuclear shape change in response to increasing doses of wortmannin but, interestingly, not the other positive control drug in this assay, LY294002 (Figure (Figure4d).4d). These subtle changes were seen at all doses at and above the EC50 of wortmannin but at none of the doses of LY294002, even those that clearly are sufficient for translocation of Forkhead, the main readout of this screen. Because wortmannin and LY294002 target an overlapping set of proteins, this result indicates that using this software in a primary screening assay would allow classification of any positively scoring samples as being wortmannin-specific or not, immediately narrowing down the potential pathways involved. While billions of samples have been scored using translocation assays, this is, to our knowledge, the first report of the ability to sub-classify samples based on morphological changes using primary screening data.

Cluster computing

We routinely run CellProfiler on large image sets (more than 45,000 four-color images) using a cluster of computers. To do this, we add modules to the end of a pipeline to enable processing batches of images on the cluster and exporting data into a database. We then process the first image on a desktop computer, after which CellProfiler automatically divides the remainder of the large image set into groups and creates the files needed to submit each group to a computing cluster. We then use simple commands, outside of CellProfiler, to submit the jobs to our cluster of computers and export the resulting measurements to a database. Each of these steps is described in the CellProfiler help for batch processing, and researchers without a computing cluster can now rent one remotely and inexpensively. Given that a typical image analysis takes approximately two minutes, a single CPU can process 30 images/hour and a 100 CPU cluster processes 3,000 images/hour. This is a much faster rate than existing image acquisition instruments, such that image analysis is not a bottleneck.

Broad applicability

Here we have shown that CellProfiler is useful for measuring a number of cell features, including cell count, cell size, cell cycle distribution, organelle number and size, cell shape, texture, and the levels and localization of proteins and phospho-proteins. Unlike previously existing software, CellProfiler is effective in a number of cell types and organisms, such that new avenues of research in both standard and high-throughput biology laboratories can now be pursued.

CellProfiler is already being used by laboratories worldwide studying a variety of biological processes in other cell types and organisms, including Drosophila (S2R+ cells, epithelial tissue), human (TOV21G, biopsied prostate gland tissue, adult mesenchymal stem cells, H1299 lung carcinoma), mouse (NIH/3T3, neural precursor cells derived from embryos, lung tissue sections, isolated germ cells), and rat (H9c2 cells) [1,26,48,52-54] (KA Hartwell, personal communication). We have also modified CellProfiler to measure yeast colonies, yeast growth patches, wounds in scratch assays, and tumors [55].

Importantly, the only successfully completed Drosophila screen using automated image analysis, to date, has been a cell-count/object-count screen in the S2 line whose appearance is comparable to human cell lines [56]. We are currently using CellProfiler to analyze screens using the clumpy Drosophila Kc167 cell type (AEC, TRJ, MRL, DB Wheeler, PG, DMS, unpublished data). Given the power of RNA interference and genetic tools in Drosophila and the demand for screening in its community [57], this is an area that can now move past tedious visual analysis of thousands of images, accelerating the rate of discovery.

Future development

We hope that computer vision researchers will contribute new algorithms to the project so that their theoretical work can be applied to practical biological problems. For example, while CellProfiler can currently analyze each slice of a time-lapse movie or three-dimensional image set independently, implementation of algorithms specifically designed to take advantage of the extra context information present in this type of data would be necessary for most experiments using these image types. Furthermore, CellProfiler is currently being integrated with the open-source Open Microscopy Environment project (OME) [58], which would provide a complete open-source infrastructure for organizing and analyzing images from high-throughput experiments.

With the successful application of sophisticated image analysis methods, the bottleneck of image-based genome-wide screens is now moving downstream to data visualization, exploration, and statistical analysis in order to accommodate the number and richness of measurements that result from image-based genome-wide assays [32]. Fully exploiting these rich data sets will reveal cellular signaling networks and lead to the unprecedented rich annotation of hundreds of genes in parallel.

Additional data files

The following additional data are available with the online version of this paper. Additional data file 1 is the CellProfiler manual. Additional data file 2 shows the CellProfiler pipelines for experiments shown in this paper, listing the modules in the order used. Additional data file 3 is a table listing CellProfiler modules by category, with their descriptions. Additional data file 4 is a table listing the measurements made by CellProfiler modules. Additional data file 5 lists the data and image tools in CellProfiler, with their descriptions. Additional data file 6 is a figure showing an example from CellProfiler analysis of DNA content (cell cycle) in Drosophila Kc167 cells. Additional data file 7 is a figure showing histograms of shape and texture features for wild-type cells. Additional data file 8 is a table listing measures for the cytoplasm-nucleus translocation assay (Figure (Figure4)4) for which the Z' factor is above 0.5.

Supplementary Material

Additional data file 1:

CellProfiler manual

Additional data file 2:

CellProfiler pipelines for experiments shown in this paper, listing the modules in the order used

Additional data file 3:

CellProfiler modules by category, with their descriptions

Additional data file 4:

Measurements made by CellProfiler modules

Additional data file 5:

Data and image tools in CellProfiler, with their descriptions

Additional data file 6:

Example from CellProfiler analysis of DNA content (cell cycle) in Drosophila Kc167 cells

Additional data file 7:

Histograms of shape and texture features for wild-type cells

Additional data file 8:

Measures for the cytoplasm-nucleus translocation assay (Figure (Figure4)4) for which the Z' factor is above 0.5

Acknowledgements

We gratefully thank the researchers providing images for this study: Steve N Bailey (Whitehead Institute, Figure Figure1c),1c), Scott Floyd (MIT, Figure Figure2g),2g), Kirsten Hagstrom (C. elegans, Figure Figure2d2d[59]), Ruth Brack and Horst Wolff (GSF-Institute for Molecular Virology, Neuherberg, Germany, HeLa, Figure Figure2d2d[60]), Dominic Hoepfner, Arndt Brachat and Peter Philippsen (Universitat Basel, Switzerland, Saccharomyces cerevisiae, Figure Figure2d),2d), Ilya Ravkin (Vitra CNT, Figure Figure2f2f and BioImage CNT, Figure Figure44[61]). We are grateful to Wayne Rasband for his work on the open-source NIH Image/ImageJ package and for advice from Zach E Perlman, both of whom served to inspire this project. We appreciate Ilya Ravkin's work to provide test images for the community; those who provided technical assistance, Dianne Carpenter, Biao Luo, Nora Taylor, Susan Ma, and James Whittle; those who contributed to the software, Steve Lowe; and those who provided helpful comments, Doug Wheeler, Tamar Resnick and Kimberly Hartwell. This work was supported by a Merck/CSBi postdoctoral fellowship (AEC), a Novartis fellowship from the Life Sciences Research Foundation (AEC), a Society for Biomolecular Screening Academic grant (AEC), the MIT EECS/Whitehead/Broad Training Program in Computational Biology (NIH grant DK070069-01) supporting TRJ, a Damon Runyon Cancer Research Foundation fellowship (DAG), an NSERC postdoctoral fellowship (JM), DOD TSC research program grant W81XWH-05-1-0318-DS (DMS), NIH grant R01 GM072555-01 (DMS), and the Keck Foundation (DMS).

References

  • Moffat J, Grueneberg DA, Yang X, Kim SY, Kloepfer AM, Hinkle G, Piqani B, Eisenhaure TM, Luo B, Grenier JK, et al. A lentiviral RNAi library for human and mouse genes applied to an arrayed viral high-content screen. Cell. 2006;124:1283–1298. [PubMed]
  • Dasgupta R, Perrimon N. Using RNAi to catch Drosophila genes in a web of interactions: insights into cancer research. Oncogene. 2004;23:8359–8365. [PubMed]
  • Carpenter AE, Sabatini DM. Systematic genome-wide screens of gene function. Nat Rev Genet. 2004;5:11–22. [PubMed]
  • Vanhecke D, Janitz M. Functional genomics using high-throughput RNA interference. Drug Discov Today. 2005;10:205–212. [PubMed]
  • Echeverri CJ, Perrimon N. High-throughput RNAi screening in cultured cells: a user's guide. Nat Rev Genet. 2006;7:373–384. [PubMed]
  • Kiger A, Baum B, Jones S, Jones M, Coulson A, Echeverri C, Perrimon N. A functional genomic analysis of cell morphology using RNA interference. J Biol. 2003;2:27. [PMC free article] [PubMed]
  • Kim JK, Gabel HW, Kamath RS, Tewari M, Pasquinelli A, Rual JF, Kennedy S, Dybbs M, Bertin N, Kaplan JM, et al. Functional genomic analysis of RNA interference in C. elegans. Science. 2005;308:1164–1167. [PubMed]
  • Mitchison TJ. Small-molecule screening and profiling by using automated microscopy. Chembiochem. 2005;6:33–39. [PubMed]
  • Perlman ZE, Mitchison TJ, Mayer TU. High-content screening and profiling of drug activity in an automated centrosome-duplication assay. Chembiochem. 2005;6:145–151. [PubMed]
  • Perlman ZE, Slack MD, Feng Y, Mitchison TJ, Wu LF, Altschuler SJ. Multidimensional drug profiling by automated microscopy. Science. 2004;306:1194–1198. [PubMed]
  • Taylor DL, Giuliano KA. Multiplexed high content screening assays create a systems cell biology approach to drug discovery. Drug Discov Today: Technologies. 2005;2:149–154. [PubMed]
  • Abraham VC, Taylor DL, Haskins JR. High content screening applied to large-scale cell biology. Trends Biotechnol. 2004;22:15–22. [PubMed]
  • Bjorklund M, Taipale M, Varjosalo M, Saharinen J, Lahdenpera J, Taipale J. Identification of pathways regulating cell size and cell-cycle progression by RNAi. Nature. 2006;439:1009–1013. [PubMed]
  • Ohya Y, Sese J, Yukawa M, Sano F, Nakatani Y, Saito TL, Saka A, Fukuda T, Ishihara S, Oka S, et al. High-dimensional and large-scale phenotyping of yeast mutants. Proc Natl Acad Sci USA. 2005;102:19015–19020. [PMC free article] [PubMed]
  • Levsky JM, Singer RH. Gene expression and the myth of the average cell. Trends Cell Biol. 2003;13:4–6. [PubMed]
  • Sachs K, Perez O, Pe'er D, Lauffenburger DA, Nolan GP. Causal protein-signaling networks derived from multiparameter single-cell data. Science. 2005;308:523–529. [PubMed]
  • Gil J, Wu H, Wang BY. Image analysis and morphometry in the diagnosis of breast cancer. Microsc Res Tech. 2002;59:109–118. [PubMed]
  • Chen X, Murphy RF. Objective clustering of proteins based on subcellular location patterns. J Biomed Biotechnol. 2005;2005:87–95. [PMC free article] [PubMed]
  • Doudkine A, Macaulay C, Poulin N, Palcic B. Nuclear texture measurements in image cytometry. Pathologica. 1995;87:286–299. [PubMed]
  • Guillaud M, Adler-Storthz K, Malpica A, Staerkel G, Matisic J, Van Niekirk D, Cox D, Poulin N, Follen M, Macaulay C. Subvisual chromatin changes in cervical epithelium measured by texture image analysis and correlated with HPV. Gynecol Oncol. 2005;99:S16–23. [PubMed]
  • Abramoff MD, Magalhaes PJ, Ram SJ. Image processing with ImageJ. Biophotonics International. 2004;11:36–42.
  • Zhou X, Cao X, Perlman Z, Wong ST. A computerized cellular imaging system for high content analysis in Monastrol suppressor screens. J Biomed Inform. 2006;39:115–125. [PubMed]
  • Lindblad J, Wahlby C, Bengtsson E, Zaltsman A. Image analysis for automatic segmentation of cytoplasms and classification of Rac1 activation. Cytometry A. 2004;57:22–33. [PubMed]
  • Garippa RJ. A multi-faceted approach to the advancement of cell-based drug discovery. Drug Discovery World. 2004;6:43–55.
  • Harada JN, Bower KE, Orth AP, Callaway S, Nelson CG, Laris C, Hogenesch JB, Vogt PK, Chanda SK. Identification of novel mammalian growth regulatory factors by genome-scale quantitative image analysis. Genome Res. 2005;15:1136–1144. [PMC free article] [PubMed]
  • Wheeler DB, Bailey SN, Guertin DA, Carpenter AE, Higgins CO, Sabatini DM. RNAi living-cell microarrays for loss-of-function screens in Drosophila melanogaster cells. Nat Methods. 2004;1:127–132. [PubMed]
  • Armknecht S, Boutros M, Kiger A, Nybakken K, Mathey-Prevot B, Perrimon N. High-throughput RNA interference screens in Drosophila tissue culture cells. Methods Enzymol. 2005;392:55–73. [PubMed]
  • Price JH, Goodacre A, Hahn K, Hodgson L, Hunter EA, Krajewski S, Murphy RF, Rabinovich A, Reed JC, Heynen S. Advances in molecular labeling, high throughput imaging and machine intelligence portend powerful functional cellular biochemistry tools. J Cell Biochem. 2002;39(Suppl):194–210. [PubMed]
  • Eggert US, Mitchison TJ. Small molecule screening by imaging. Curr Opin Chem Biol. 2006;10:232–237. [PubMed]
  • Murphy RF, Meijering E, Danuser G. Special issue on molecular and cellular bioimaging. Ieee T Image Process. 2005;14:1233–1236.
  • CellProfiler Project http://www.cellprofiler.org
  • Jones TR, Carpenter AE, Sabatini DM, Golland P. Methods for high-content, high-throughput image-based cell screening. In: Metaxas DN, Whitaker RT, Rittcher J, Sebastian T, editor. Proceedings of the Workshop on Microscopic Image Analysis with Applications in Biology held in association with MICCAI06 (Medical Image Computing and Computer-Assisted Intervention) held in Copenhagen, Denmark, October 5, 2006. pp. 65–72.
  • Wahlby C. Acta Universitatis Upsaliensis. Vol. 896. Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology Uppsala; 2003. Algorithms for Applied Digital Image Cytometry. p. 75.
  • Malpica N, de Solorzano CO, Vaquero JJ, Santos A, Vallcorba I, Garcia-Sagredo JM, del Pozo F. Applying watershed algorithms to the segmentation of clustered nuclei. Cytometry. 1997;28:289–297. [PubMed]
  • Wahlby C, Sintorn IM, Erlandsson F, Borgefors G, Bengtsson E. Combining intensity, edge and shape information for 2D and 3D segmentation of cell nuclei in tissue sections. J Microsc. 2004;215:67–76. [PubMed]
  • Ortiz de Solorzano C, Rodriguez EG, Jones A, Pinkel D, Gray JW, Sudar D, Lockett SJ. Segmentation of confocal microscope images of cell nuclei in thick tissue sections. J Microsc Oxford. 1999;193:212–226. [PubMed]
  • Meyer F, Beucher S. Morphological segmentation. J Visual Communication Image Representation. 1990;1:21–46.
  • Jones TR, Carpenter AE, Golland P. ICCV Workshop on Computer Vision for Biomedical Image Applications. Vol. 2005. Springer-Verlag, Berlin; 2005. Voronoi-based segmentation of cells on image manifolds. pp. 535–543.
  • Boland MV, Murphy RF. A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells. Bioinformatics. 2001;17:1213–1223. [PubMed]
  • Rodenacker K, Bengtsson E. A feature set for cytometry on digitized microscopic images. Anal Cell Pathol. 2003;25:1–36. [PubMed]
  • Boland MV, Markey MK, Murphy RF. Automated recognition of patterns characteristic of subcellular structures in fluorescence microscopy images. Cytometry. 1998;33:366–375. [PubMed]
  • Haralick RM, Shanmuga K, Dinstein I. Textural features for image classification. Ieee T Syst Man Cyb. 1973;SMC3:610–621.
  • Gabor D. Theory of communication. J Institute Electrical Engineers. 1946;93:429–441.
  • Turner MR. Texture discrimination by Gabor functions. Biol Cybern. 1986;55:71–82. [PubMed]
  • Zhou X, Liu KY, Bradley P, Perrimon N, Wong ST. Towards automated cellular image segmentation for RNAi genome-wide screening. Med Image Comput Comput Assist Interv Int Conf Med Image Comput Comput Assist Interv. 2005;8:885–892. [PubMed]
  • Lockett SJ, Jacobson K, Herman B. Quantitative precision of an automated, fluorescence-based image cytometer. Anal Quant Cytol Histol. 1992;14:187–202. [PubMed]
  • Poulin NM, Matthews JB, Skov KA, Palcic B. Effects of fixation method on image cytometric measurement of DNA content and distribution in cells stained for fluorescence with propidium iodide. J Histochem Cytochem. 1994;42:1149–1156. [PubMed]
  • Bailey SN, Ali SM, Carpenter AE, Higgins CO, Sabatini DM. Microarrays of lentiviruses for gene function screens in immortalized and primary cells. Nat Methods. 2006;3:117–122. [PubMed]
  • Porter KR. Changes in cell topography associated with transformation to malignancy. Adv Pathobiol. 1975;1:29–47. [PubMed]
  • BioImageA/S Assay Application Note 21: Image analysis using Definiens Cellenger, Version 1. January 2005.
  • Ravkin I, Temov V. Poster PO2025: Comparison of Several Classes of Algorithms for Cytoplasm to Nucleus Translocation. Society for Biomolecular Screening Annual Meeting: 2005. 2005.
  • Cowen LE, Carpenter AE, Matangkasombut O, Fink GR, Lindquist S. Genetic architecture of Hsp90-dependent drug resistance. Eukaryot Cell [PMC free article] [PubMed]
  • Baltus AE, Menke DB, Hu YC, Goodheart ML, Carpenter AE, de Rooij DG, Page DC. In germ cells of mouse embryonic ovaries, the decision to enter meiosis precedes premeiotic DNA replication. Nat Genet [PubMed]
  • Sigal A, Milo R, Cohen A, Geva-Zatorsky N, Klein Y, Alaluf I, Swerdlin N, Perzov N, Danon T, Liron Y, et al. Dynamic proteomics in individual human cells uncovers widespread cell-cycle dependence of nuclear proteins. Nat Methods. 2006;3:525–531. [PubMed]
  • Lamprecht M, Sabatini DM, Carpenter AE. CellProfiler: free, versatile software for automated biological image analysis. Biotechniques. [PubMed]
  • Philips JA, Rubin EJ, Perrimon N. Drosophila RNAi screen reveals CD36 family member required for mycobacterial infection. Science. 2005;309:1251–1253. [PubMed]
  • Flockhart I, Booker M, Kiger A, Boutros M, Armknecht S, Ramadan N, Richardson K, Xu A, Perrimon N, Mathey-Prevot B. FlyRNAi: the Drosophila RNAi screening center database. Nucleic Acids Res. 2006;34:D489–494. [PMC free article] [PubMed]
  • Swedlow JR, Goldberg I, Brauner E, Sorger PK. Informatics and quantitative analysis in biological imaging. Science. 2003;300:100–102. [PMC free article] [PubMed]
  • Genes & Development http://www.genesdev.org/cgi/content/full/16/6/729/DC1
  • Carl Zeiss MicroImaging Gallery http://www.zeiss.com/C12567BE0045ACF1/Contents-Frame/FDE18DAAE4583A5CC1256C3D004831FF
  • Invitation to Participate in the Comparison of Image Analysis Algorithms for Intracellular Screening http://www.ravkin.net/SBS/Invitation.htm
  • Stevens B, Alvarez CM, Bohman R, O'Connor JD. An ecdysteroid-induced alteration in the cell cycle of cultured Drosophila cells. Cell. 1980;22:675–682. [PubMed]
  • Zhang JH, Chung TD, Oldenburg KR. A simple statistical parameter for use in evaluation and validation of high throughput screening assays. J Biomol Screen. 1999;4:67–73. [PubMed]
  • Ravkin I. Quality measures for imaging-based cellular assays. Society Biomol Screen Conference Posters 2004:#P12024. http://www.ravkin.net/posters/P12024-Quality Measures for Imaging-based Cellular Assays.pdf
  • Ravkin I, Temov V, Nelson AD, Zarowitz MA, Hoopes M, Verhovsky Y, Ascue G, Goldbard S, Beske O, Bhagwat B, et al. Multiplexed high-throughput image cytometry using encoded carriers. Proc SPIE. 2004;5322:52–63.

Articles from Genome Biology are provided here courtesy of BioMed Central
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...