|
|
BMC Bioinformatics. 2006; 7: 30. Published online 2006 January 19. doi: 10.1186/1471-2105-7-30. | PMCID: PMC1388242 |
Copyright © 2006 Yi et al; licensee BioMed Central Ltd. WholePathwayScope: a comprehensive pathway-based analysis tool for high-throughput data Reviewed by Ming Yi, 1 Jay D Horton, 2 Jonathan C Cohen, 2,3 Helen H Hobbs, 2,3,4 and Robert M Stephens  11Advanced Biomedical Computing Center, National Cancer Institute-Frederick/SAIC-Frederick Inc., Frederick, MD 21702, USA 2McDermott Center for Human Growth and Development, University of Texas Southwestern Medical Center at Dallas, TX 75390-9046, USA 3Departments of Internal Medicine and Molecular Genetics, University of Texas Southwestern Medical Center at Dallas, TX 75390-9046, USA 4The Howard Hughes Medical Institute, University of Texas Southwestern Medical Center at Dallas, TX 75390-9046, USA Received May 9, 2005; Accepted January 19, 2006. This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Background Analysis of High Throughput (HTP) Data such as microarray and proteomics data has provided a powerful methodology to study patterns of gene regulation at genome scale. A major unresolved problem in the post-genomic era is to assemble the large amounts of data generated into a meaningful biological context. We have developed a comprehensive software tool, WholePathwayScope (WPS), for deriving biological insights from analysis of HTP data. Result WPS extracts gene lists with shared biological themes through color cue templates. WPS statistically evaluates global functional category enrichment of gene lists and pathway-level pattern enrichment of data. WPS incorporates well-known biological pathways from KEGG (Kyoto Encyclopedia of Genes and Genomes) and Biocarta, GO (Gene Ontology) terms as well as user-defined pathways or relevant gene clusters or groups, and explores gene-term relationships within the derived gene-term association networks (GTANs). WPS simultaneously compares multiple datasets within biological contexts either as pathways or as association networks. WPS also integrates Genetic Association Database and Partial MedGene Database for disease-association information. We have used this program to analyze and compare microarray and proteomics datasets derived from a variety of biological systems. Application examples demonstrated the capacity of WPS to significantly facilitate the analysis of HTP data for integrative discovery. In today's post-genomic era, the sequencing projects and the development of High Throughput (HTP) technologies such as microarray and proteomics provide great opportunities to uncover and explore the complexity of biological problems using systems biology. HTP technologies have provided a powerful approach to address a diverse array of biological questions by allowing analysis of the complete transcriptional and translational repertoire of cells or tissues. Pathologically identical tumors can be differentiated into clinically meaningful subgroups by microarray analysis [ 1- 4], and new pathways perturbed in disease states have been identified using microarray analysis [ 5- 7]. Expression arrays also reveal new participants in biological pathways [ 8- 11], new gene targets for pharmaceutical agents, and new functions of genes [ 12]. Today, the use of DNA microarrays is increasingly widespread and affordable and great expectations have been placed on technological advances in proteomics. However, analyzing the enormous quantity of data generated from such HTP experiments remains a major challenge. A variety of software tools are available to extract and analyze HTP data that primarily focus on microarray data. Two major strategies used are: 1) unsupervised clustering, in which genes are clustered according to changes in expression pattern with no accommodation for biological context, and 2) supervised classification, in which genes are classified according to an underlying or pre-known biology. Numerous existing microarray analysis tools such as GeneCluster [ 13], TreeView [ 14], TM4 [ 15]; and GeneSpring [ 16] primarily use clustering algorithms, which require significant user effort to connect with biological information. Current HTP data analysis methods, which are primarily based on the computation of data values for each individual gene, such as clustering and classification (Hierarchical, Principle Component Analysis [ 17], and Significance Analysis of Microarray [ 18]), do provide great insights in many aspects of experimental analysis. However, a more comprehensive way to integrate and analyze HTP data in the context of biological pathways and networks has become the current need in both academics and industry. As the amount of HTP data has increased and more insightful analysis approaches have been identified, the exploration of the underlying gene regulatory and biochemical networks of pathways to analyze data derived from a variety of HTP technologies has become one of the major challenges in the fields of bioinformatics and computational biology. Many software tools capable of analyzing HTP data within the context of biological pathways have been developed [ 19- 22]. Recently released commercial software packages including PathwayAssist™ [ 23], PathArt [ 24], Ingenuity Pathways Analysis tool [ 25], MetaCore [ 26] also compete in the field of pathway-based HTP analysis. These tools provide an assortment of interfaces for the visualization of gene networks, natural language processing (NLP) extracted, or hand-curated biological pathway/association network databases and accept gene-list based data input. Each of these tools has one or more unique features that distinguish it from others. Some open source or publicly accessible software, such as GenMAPP [ 27], Cytoscape [ 28], Pathway Processor [ 29] and ViMac [ 30], display microarray data within the context of pathways annotated in the Kyoto Encyclopedia of Genes and Genomes (KEGG) pathways [ 19, 22], and provide statistical assessment of the reliability of each differentially expressed gene [ 29]. However, one of the limitations of these tools is the inability to handle multiple datasets simultaneously in an intuitive way. There is a need for more flexibile and comprehensive HTP data analysis software tools in the public domain that are accessible to the academic community and can provide a suite of utilities to analyze HTP data in biological contexts, such as pathways. To facilitate the simultaneous analysis and comparison of multiple HTP experiments in the context of biological pathways and association networks, and allow pattern extraction of a selected gene list with biological themes, we developed a stand-alone, Windows-based software tool called WholePathwayScope, or WPS. This software program not only provides many unique ways to analyze and visualize HTP data, but also combines advantages of clustering methodology with a more intuitive pathway or association network-based analysis, and many other features that allow for more comprehensive data analysis. WPS provides a pathway-based platform for integrative data analysis WholePathwayScope or WPS is a software tool that displays HTP data in user-defined or stored gene groups or pathways. The program incorporates a suite of pre-defined biological pathways and allows for the construction of additional user-defined pathways or collections of genes. It also allows generation of biological association networks composed of gene-pathway/term relationships, which can be further manipulated and converted to subnetworks, gene-gene, or pathway/term-pathway/term networks. Results from multiple HTP experiments can be visualized simultaneously, both as summary data from multiple pathways (WSCP) and as detailed data for individual pathways (PSCP). Results can be displayed numerically and can be color-coded according to user-defined criteria to facilitate visual analysis. The program also offers statistical evaluation of global functional category (GO term, pathway etc.) enrichment in a user's gene list, or of user-defined pattern enrichment of choice genes that have been color-coded with HTP data directly. The program is written in Microsoft Visual Basic 6 and runs in the Microsoft Windows environment. It utilizes Microsoft Access Databases including the internal databases for gene annotations, pathways, gene ontology and disease association information as well as designated criteria (CRI) files for HTP data. Pathways and association networks are created and presented in windows or graphical user interfaces (GUIs), and stored and accessed either in individual files or dynamically within Microsoft Access Databases. Users control the program through a user interface involving GUIs provided from a series of panels, menus and windows. There is also an extensive context-sensitive help system. Internal database for gene, pathway, and disease annotation WPS includes an internal database for integrating gene annotation information from both mouse and human genomes. Annotation covered includes GenBank accession numbers (GenBank IDs), Unigene IDs, Locuslink IDs (Now Entrez Gene), Gene Symbols, Aliases [ 31], SwissProt IDs (Protein IDs) [ 32], and disease information from both Genetic Association Database [ 33] and a partial MedGene Database [ 34]. It also carries pathway/term information including KEGG [ 19, 22, 35], Biocarta [ 36], CGAP [ 37] and Gene Ontology information [ 38- 40] for the purpose of gene-term association network generation and Fisher's exact test. Designed Files in WPS The overall program layout is described in Figure . Three types of files with different formats have been developed to display the HTP data. These three file types lay out the pathways being visualized, interconnections amongst those pathways, and data filtering and color criteria for the HTP data respectively. The first file type is the PathwayScope File (PSCP), which is graphical presentation of many metabolic pathways and gene groupings. PSCP files contain the identifiers (gene tags) for each gene in a group of related genes or in a pathway, which is colorable (see PSCP file examples in Figure and ). PSCP files can be customized and created by users or created dynamically from the internal database. For Biocarta pathways, the pathway graphs can be also visualized in a separate internet browser and data of selected genes in CRI files (see below) can be highlighted in the graphs as well (see Additional file 1 for screenshot). The second file type is the WholeScope File (WSCP file), which is composed of a series of pathway tags. Each pathway tag in the WSCP file is linked to a PSCP file saved in a user's desktop or represents a term (either a pathway or GO term in the internal database), which is also colorable like gene tags. The PCSP file can be accessed if it is linked by a pathway tag or a new PSCP file(s) can be dynamically created if the pathway tag represents a database associated term from the WSCP file by clicking on the pathway tag. Global changes in expression levels of genes in each pathway or term can be indicated by setting criteria in CRI files (see below) to color code the pathway tags (see WSCP file example in Figure ). The third file type is the criteria (CRI) file, which is used to enter the user-defined color criteria and HTP data (see Additional files 35–50 for examples of raw data files used in this manuscript). Each CRI file is a Microsoft Access file that contains a HTP (e.g. microarray) dataset, the mapped gene identifiers (BaseGenBankID) for each microarray element, and the user-defined color criteria for the PSCP and WSCP files (see Additional files 19–34 for examples of CRI files used in this manuscript). HTP datasets are converted to CRI files in the program from Excel files (Microsoft, Inc) containing the HTP data through a Data Conversion Window (Fig. ). WPS can be used for any high-throughput data as long as it is formatted as spreadsheets in Excel files and contains one of the three types of standard gene or protein identifiers including GenBank Accessions, Unigene IDs, or SwissProt IDs (see Additional file 2 or our program demo web page [ 41] for the file format and procedure for conversion into CRI files). For genes without available standard IDs, they can also be included into CRI files with user-assigned identifiers and used for analysis such as Pattern Extraction (see below). The HTP data in an Excel file can be an individual dataset, or combined multiple datasets in a single file (i.e. in Stanford format [ 42]). In the latter case, the user can select an appropriate data column to build color criteria specifically for one dataset in the whole file as individual CRI file, or multiple data columns to build color criteria even for multiple datasets within a single CRI file (see the Additional file 3 for more details on the three file types in WPS). Data analysis using WPS Once a series of PSCP, WSCP and CRI files have been loaded into the program, the user has the option of proceeding along several analysis courses. Some of the features available for this analysis are described briefly below. The result section of this manuscript illustrates the program using real data examples to describe some scenarios to apply the program for data analysis. In addition, a set of tutorial movies and illustration image files may be obtained from our program demo web page [ 41] for many major features and general usage of the program (see additional files 15, 16, 17, 18 for some examples of demo movies). Pattern extraction of a list of genes using color cue templates for biological themes In CRI files, users can define criteria to color code specific categories of behaviors of genes in datasets (e.g. red color for no less than 2 fold change of genes, or green color for genes flagged as down-regulated genes etc.). This kind of criteria definition can be used to extract a gene list of genes matching a specific pattern of such criteria across one or more CRI dataset files. Pattern extraction can work in two ways: global pattern extraction across datasets, or local or pathway PSCP file scoped pattern extraction. The extracted gene list can be immediately copied and pasted to other utility windows for further analysis (see Fig. , , and Additional file 4 for illustrative examples). Generation and manipulation of Gene-Term Association Network (GTAN) to explore gene-pathway or gene-term relations Using an input or filtered gene list, such as a list of genes derived from clustering analysis from other programs or pattern extraction in WPS, the associated pathways or GO terms can be identified from the internal database or user-defined PSCP files. These results are listed into the result table in a gene-term pairwise format (Fig. ). Then, the pairwise relationships between genes and their associated pathways or GO terms in the results table can be used to generate a gene-term association network (GTAN) within a PSCP file and is illustrated in a graphical view (Fig. ). The generation of such a network is based on the Scalable Vector Graphics (SVG) technology [ 43], a standard for describing the layout of two-dimensional graphics in XML. The gene-term association network can be manipulated and filtered for the purpose of different analysis needs in many ways (see a concrete example illustrated in Fig. , , , and see Additional file 5 for more detailed description of this feature). In addition, genes associated with disease terms, which were derived from Genetic Association Database and MedGene Database and included in the internal database described above, can be highlighted and selected from the network for further analysis and network manipulation (see Additional file 6 for screenshot). Fisher's exact test for biological significance of gene lists and pathway-level pattern enrichment of high-throughput data The Fisher's exact test is performed based on 2 × 2 contingency tables (whether a gene is in the given list or not vs whether this gene is associated with a pathway/term or not; see Additional file 7 for illustration of an example of 2 × 2 contingency table). Similar to EASE [ 44], Fisher's exact test p-values are computed for each term in a chosen system, which are then ranked from smaller to larger values, to estimate the statistical significance and enrichment of global functional categories (GO terms, pathways etc.) within a given system for a list of genes of a user's interests or that match a pattern. The biological themes of the gene list can be rapidly retrieved from GO system and Biocarta and KEGG pathway collections as top ranked terms or pathways based on the Fisher's exact test p-values (see Figure and Additional file 8 for a concrete example). In contrast to the global functional statistical estimation of a gene list, within a PSCP file being analyzed and colored by CRI file(s), the statistical significance and enrichment of genes with certain user-defined criteria, can be also estimated by Fisher's exact test for the corresponding CRI file(s) (see Additional file 9 for a screenshot illustration of this feature). Other utilities: information search and dataset manipulation Within the information search window, one can type in a keyword (e.g. Gene Name, GenBankID etc.) to search for its relevant information, including annotation information, as well as associated disease information from the internal database. Two dataset manipulation utilities are available to conveniently manipulate the size of data files so that one or more subsets of a dataset, or sum of multiple datasets can be used for further analysis: 1. Sorting a dataset into pathway/term scoped "sub-datasets" based on PSCP files, or pathways/terms in the internal database (see Additional file 10 for screenshot); 2. Merge data files. Some of the features of WPS are illustrated using experimental data in the following section. Although only microarray data is utilized, any source of HTP data would be equally suited to the analysis. Comparison of multiple datasets within multiple pathways WholePathwayScope displays HTP data within a biological context. Figure provides an overview of the basic work flow of the WPS program for data and file processing. Microarray data or other HTP data are entered into criteria (CRI) files in which the parameters for analysis are set. The data are then loaded into the PSCP/WSCP files either from the provided file collections or from the internal database, and those genes and pathways that meet user-defined criteria are flagged. In addition, gene lists can be extracted from CRI files for further Fisher's exact test analysis or creation of GTAN. Figure provides an example of the data conversion window, in which gene and pathway criteria are entered. For each gene, GenBank accession numbers that correspond to the gene are collated and given a single BaseGenbank ID number. By way of example, the WPS program was used to compare gene expression profiles between wild-type mice and two strains of genetically-modified mice that either express high levels of ABCG5 and ABCG8 ( G5G8 Tg mice) or no ABCG5 or ABCG8 ( G5G8 -/- mice) [ 45, 46] also see Additional file 11 for a description of material and data preparation). ABCG5 and ABCG8 encode ABC half transporters that heterodimerize to limit the intestinal absorption of dietary sterols and to promote the secretion of sterols from the liver into bile [ 47]. To compare gene expression patterns in the G5G8 Tg and G5G8 -/- mice and assess the reproducibility of the microarray results, microarray datasets from five expression array experiments (two from G5G8 Tg mice and three from G5G8 -/- mice) were analyzed simultaneously in a WSCP file, which includes a subset of the biochemical pathways and gene families involved in lipid metabolism (Fig. ). If two or more genes in a pathway were significantly up-regulated or down-regulated (designated "UpHighCertainty" or "DownHighCertainty" in Table 1, respectively) for a dataset, the corresponding divided box of the pathway tag was colored red or green, respectively. Comparison of the data from the two experiments from the G5G8 Tg mice demonstrated consistent results for some pathways (e.g. cholesterol synthesis and bile acid synthesis) but not for other pathways (e.g. glycogen synthesis). | Table 1An example of gene criteria for the microarray dataset for G5G8 Tg mice vs wild-type mice. |
When the WSCP file window is displayed in the program, it is interactive. Each pathway tag in the WSCP file links to a PSCP file or a term in the internal database. For example, clicking on one of its divided boxes of the pathway tag "Cholesterol Synthesis" (Fig. ) will open a new window with the details of the pathway, including the expression levels of the individual genes (Fig. ). Many genes in the cholesterol biosynthetic pathway were colored red indicative of up-regulation in both datasets from the G5G8 Tg mice (Fig. ). These genes were expressed at significantly lower levels (colored green) in samples from the G5G8 -/-, confirming that differences in expression levels of ABCG5 and ABCG8 have a significant impact on cholesterol biosynthesis in the liver. When cholesterol synthesis was measured in these two genetically-modified strains of mice, it was found to be increased in the transgenic animals and decreased in the knockouts, verifying the biochemical changes seen in these experiments [ 45, 46]. To assess the ontogeny of expression of genes in the cholesterol biosynthetic pathway, we analyzed microarray datasets from livers of wild-type mice or embryos sacrificed at different time points during development (Fig. ). In utero, most cholesterol for the developing mouse is derived from endogenous synthesis, as reflected by the increased expression of many genes in the biosynthetic pathway at day -5 and day -3. Most of these mRNAs decreased within 24 h of birth, which correlates with the initiation of nursing. Many hepatic mRNAs in the group were increased between postnatal days 18 and 21, when the pups transition from consuming a high cholesterol diet (milk) to a low cholesterol chow diet (0.02% cholesterol by weight). During this time period, endogenous cholesterol synthesis compensates for the reduced dietary intake of cholesterol associated with weaning. Pattern extraction and statistical evaluation of gene lists for biological themes One strategy to analyze microarray or other HTP data is to look for genes with certain user-defined expression patterns across one or more datasets with some biological implications and themes. The expression level-switch phenomenon at birth and weaning across the time course experiment within the cholesterol synthesis pathway described earlier (Fig. ), prompts us to further investigate the underlying mechanisms and relevant genes and biological processes to cholesterol metabolism. We used WPS to perform pattern extraction with a defined color criteria pattern that reflects the expression level switch around the birth and weaning time points from the time course experiments (Fig. ). The pattern-matching panel and color template affords the user great flexibility in determining which dataset(s) to include and what color(s) to accept (Fig. ). The resulting gene list containing 24 unique genes was copied and pasted to Fisher's exact test window to evaluate the statistical enrichment of pathways or GO terms within this list (Fig. ; also see Additional file 8 for complete result list). As expected, the Fisher's exact test clearly indicated enrichment of sterol/lipid metabolism and synthesis GO terms in the resulting gene list (Fig. ). Gene-Term Association Network (GTAN) for gene-specific functional subnetwork domains or function-oriented gene clusters To further study the underlying relationships between genes and involved/enriched pathways or GO terms, we used WPS to search involved pathways from Biocarta, KEGG and GO/Biological Processes terms for the extracted gene list from Fig. , and then dynamically generated a gene-term association network (GTAN) (Fig. , ). Thereby, we visualized gene-term association as well as gene-gene and term-term relationship in a graphical manner. Within a typical GTAN, any gene with an associated term has a line linked to it representative of the association relation. In this interactive window, the line linkage between the gene and its associated term will still be maintained even if the gene or the term is moved to a different location. As shown in Fig. , among total 24 genes from the above extracted gene list, only 14 genes have annotated association pathway/GO terms from Biocarta, KEGG and GO/Biological Processes, totalling 90 terms and 206 gene-term associations, which are included in the network (see Additional file 12 for complete pair-wise gene-term relations in this GTAN). All the genes that are highlighted in red (Fig. ) are presented as a network along with their associated pathways/terms. At this level of a GTAN, the legends of genes and associated terms are invisible (Fig. ). One can explore the network by moving the mouse over the top of genes or terms, the legend of which can then be displayed visibly near the mouse. Alternatively, one can "zoom in" on a selected area of the network to take a closer look at the subnetwork. There is also a specialized window available for users to manipulate, filter, and explore the network (Fig. ). To investigate the biological themes from the resulting GTAN, we used a variety of manipulation methods available in a utility window to filter and simplify the network within WPS (Fig. ). In combination with the Fisher's exact test result (Fig. ), we filtered out a subnetwork of genes with associated GO terms that have Fisher's exact test p-values no larger than 0.05 (Fig. , ). Interestingly, although the majority of the enriched terms are engaged in sterol/lipid synthesis and metabolism, endocytosis and vesicle-mediated transport GO terms, which are enriched in the extracted gene list, link Ldlr and Rab4a together in the subnetwork (Fig. ). We also retrieved terms with minimal associations with genes, which tend to be unique terms/pathways describing their involved genes (see Additional file 13). Notably, Rab4a is functionally involved in signaling and cell communication (see Additional file 13). Thus, it appears that Rab4a could be the critical signaling component that triggers and mediates the sterol/lipid synthesis machinery in the body through Ldlr , probably by the mechanism of endocytosis (Fig. , and see Additional file 13). Shared term extraction and disease gene annotation We then filtered out genes with minimal association of terms and looked for shared terms within the network (Fig. ). As evident in Fig. , sterol/lipid synthesis and metabolism are major shared terms in the network, which is consistent with the filtered network from the Fisher's exact test result (Fig. ). The fact that Hmgcs1 , Hes6 and srebf1 (SREBP) heavily shared transcription-related terms (Fig. ), is consistent with the facts that Hmgcs1 and srebf1 have been previously shown to be involved in sterol metabolism regulation and Hes6 has been implicated in transcriptional regulation [ 48], suggesting that they may collaborate in metabolism-related transcriptional regulation. Egln3 only shared high level or more generic GO terms (e.g. cellular biological process) with other genes (Fig. ), confirming its unique functional involvement in cell death among the gene list (see Additional file 13). Furthermore, Rab4a and Ldlr shared many pathway/terms, suggesting these two may be functionally coupled. Interestingly, when we used disease-association highlight feature in WPS (see Additional file 6 for screenshot), we found that Rab4a , Ldlr , and srebf1 are all more or less associated with obesity annotated in Genetic Association Database [ 33] and MedGene databases [ 34] (data not shown). Gene-gene networks and neighbor identification To study how genes are related to each other directly within the network, we merged the gene-term association network in Figure into a gene-gene network by their shared terms, after eliminating some generic terms for clarity purposes. The gene-gene network formed a domain-like architecture (see Additional file 14, Fig ). The genes that are heavily involved in sterol/lipid synthesis and metabolism formed a clustered domain with massive links among them. Distinct genes with different functional trends from others tended to be separated out of the "crowded" region such as Egln3 , Hes6 , and Rab4a . In order to learn more relationships among these "distinct genes", we highlighted them in red with WPS (see Additional file 14, Fig. ) and then retrieved the immediate neighbors for them from the original GTAN network to create a subnetwork (Fig. ). Since Ldlr is the only one from the "Sterol metabolism clustered domain" that connects to Egln3 , we also included it for further analysis. Notably, within the newly created subnetwork, all the selected genes are linked, although distinct domains or clusters for each gene are apparently separated very well (Fig. ). All these domains may represent the major functional aspects underlying the "expression level-switch" phenomenon and are networked together as a dynamic biological theme. Interestingly, these genes were originally selected due to a similar expression pattern across the "cholesterol metabolism" switch points (Fig. , Fig. ). Especially, Rab4a , Egln3 and Hes6 have been previously implicated in their functional categories including signaling and endocytosis [ 49], cell death [ 50] and transcription regulation [ 48], respectively. Whether and/or how they play roles in cholesterol metabolism related signaling, cell death and transcription regulation remains to be investigated. WPS has unique features not found in a single similar application The new software program, WPS, is described that facilitates and enhances the analysis of HTP data. Unique features of WPS include the ability to simultaneously display HTP data from multiple experiments within the context of known biological pathways, visualizing and analyzing gene-pathway/term and gene-gene relationships and biological implications within created gene-term association networks, extracting a gene list that may reflect certain biological themes by means of a user-defined pattern template with color cues, and statistically estimating the enrichment of biological pathways or GO terms within a distinguished list or a PSCP file under analysis (see Table 2 for comparison with several free and commercial pathway analysis tools). | Table 2Comparison of major features of WPS with other pathway analysis tools. |
WPS also interfaces easily with clustering programs by accepting the gene lists from clustering analysis. This will aid in the identification of interactions among biological pathways and relating the expression profiles of genes of unknown function to those of established pathways. The program accepts data from any microarray platform (including oligonucletide arrays and cDNA arrays), and accommodates data generated by SAGE (serial analysis of gene expression) [ 51] as well as proteomics data. In summary, WPS was developed to provide the following important features which were not previously available under a single application (Table 2): Analyze multiple datasets simultaneously First, many of the current programs display data from just a single HTP experiment. This limitation hampers direct visual comparison of results from different HTP experiments. When the number of datasets is large, as in a typical time course experiment, it becomes much harder for investigators to remember what is happening at each time point. So far, to our knowledge, our unique way in WPS of displaying multiple datasets simultaneously is absent from most, if not all, of the free and commercial pathway-based HTP data analysis tools. Even a very large number of datasets, if pre-processed and combined for same or similar categories, can still be effectively displayed and visualized in the program. In our example, shown in Figure , the ability of WPS to display and analyze datasets of a time course experiment in the cholesterol synthesis pathway simultaneously is very helpful for pattern recognition, especially within the genes in this pathway at the time points of birth and weaning (Most genes tended to be down-regulated after birth and up-regulated after weaning). This is more difficult to discover in such an easy and intuitive way within a pathway without using the simultaneous coloring feature of the program. Benefited from this feature in WPS, the resulting pattern recognition in turn would lead to pattern extraction of a specific color pattern in WPS, which might have biological implications (Fig. , discussed below). Analyze multiple pathways simultaneously and generation of GTAN to explore gene-term relations in an intuitive graphical manner The second feature that distinguishes WPS from current microarray programs is the ability to display multiple pathways simultaneously, either in their entirety or in summary form. A given collection of pathway files can be grouped into a single WSCP file by means of pathway tags, and changes in the behavior of genes in each pathway can be flagged according to criteria specified by the user. Thus, the pathway(s) that are significantly affected by the experimental conditions are easily identified without having to visualize each pathway individually. Furthermore, the generation and manipulation of biological gene-term association network (GTAN) greatly expands the capacity to study the gene-term and gene-gene relationships in a genome-wide fashion and provides a new way to look at genes and their involved pathways or functional GO terms. WPS has the statistical capacity, specifically using the Fisher's exact test method, to identify over-represented biological themes (pathways/processes/GO terms) in a given list of genes. More importantly, the filtering of the GTANs based on the Fisher's exact test result would give rise to a subnetwork enriched in genes and terms/pathways with statistical significance. This would help to narrow down the "core" genes and their associated terms/pathways with biological relevance of higher priority. A solid example of network filtering with the help of Fisher's exact test result is described in Fig. . Endocytosis and vesicle-mediated transport, which are enriched in the extracted gene list, co-exists and connects with the major enriched function sterol/lipid synthesis and metabolism in the filtered subnetwork. The layout of the filtered subnetwork brought these functions together with visible relations within the genes of interest (Fig. ). Some specialized tools with more sophisticated statistical methods have been previously described including EASE [ 44, 52], Fatigo [ 53] and GOMiner [ 54], which prioritize biological themes embedded in the given gene list. However, none of these tools directly visualize and study the gene-term and gene-gene relationship within the biological contexts represented by the gene list in an intuitive graphical manner, nor do they take advantage of the statistical enrichment of terms to grasp the relations of the key genes and their associated terms/pathways like in WPS. In contrast, within a GTAN created by WPS, displaying all possible associated pathways/terms for genes of interests and allowing the dynamic layout of a network based on the current biological contexts, will allow one or more context-dependent, specific functional terms to be assigned to the gene based on its current role in such context. On the other hand, its shared terms with other genes would implicate the biological connection of this gene with its "neighbor" genes. We believe such visual cues derived from GTANs not only provide an overall biological picture of the current biological context, but also shed light on the function of a gene in the network, which might only be obvious when seen with its partners. Currently, prediction and creation of genome-wide pathways [ 55], as well as utilization, and exploration of biological networks (genetic, regulation, and biochemical) as a method for data analysis is becoming a major trend in systems biology and computational biology [ 56, 57]. There are many new tools and algorithms being developed to move in this direction [ 58- 61]. Many use complicated algorithms such as Bayesian network, Petri nets, probabilistic graphical model or newly defined rules to simulate regulatory networks and dynamic trajectories of genes. In addition, most of the commercial tools use gene-gene relationships as their major components of the networks, such that the users may easily lose track of the role of genes. The GTAN approach in WPS is not only simple to use, but also unique and effective in that gene-term association relationships are the major components of the network, so that users can easily keep track of genes and their involved functional terms or pathways and predict gene-gene relationships through their shared terms. Color cue template-based pattern extraction of gene lists for biological themes A third unique feature of WPS is pattern extraction, which is different from other pattern or profile-based approaches (e.g. typical clustering and classification methods) and some statistics-based methods (e.g. SAM [ 18]). Instead of relying solely on data values, the pattern extraction method in WPS takes advantage of user-defined color criteria in CRI files representing HTP datasets. Since users define criteria in CRI files with logical expression and not just based on the data values of genes in datasets, genes with quite different data values can be defined as the same class of data in terms of their behaviors. For example, a gene with fold change of 2 may be defined into the same data class category as another gene with fold change of 8, if the user defines "no less than 2 fold" as up-regulated genes. If the user defined this criterion with red color, then red color would represent a class category of genes, which are up-regulated, with fold change no less than 2 fold no matter whether it is 2 fold or 8 fold change, as long as the user is confident with the definition based on his own experience. In fact, one can enhance this definition by adding other quality control factors such as p-value in the definition logical expression, another advantage of CRI color criteria. Thus, this kind of definition eliminates the mathematical difference but maintains the embedded biological meanings in the data values, since biological processes are more qualitative than quantitative in most cases. Limitations and future direction WPS facilitates comprehensive analysis and visualization of HTP data within the context of known biological pathways and gene-term association networks. The program will continue to be improved, as characterization of biological pathways and networks becomes increasingly comprehensive and challenging. The ultimate goal of WPS is to integrate all the available information and databases as well as an individual user's data with different forms and formats in the contexts of biological pathways and networks. The current version of WPS is a windows-based program and serves as proof of concept of pathway/gene analysis of HTP data. The future version of the program will move to a three-tier architecture in a production-scale platform to allow WPS, through a middle layer, such as Java Servlets, to communicate with the server's resource, which may have excellent data storage as well as computation capacity. Its front end interface will also evolve into a platform-independent client such as a web-browser, depending on resource performance and other factors. Integration with other data sources and additional pathways are also to be added, so that the magnitude of HTP data analysis can be largely extended with the power of an expandable server. WPS provides Fisher's exact test method for statistical evaluation in both global system and local current PSCP files either derived from internal database or user-customized under analysis. It could be improved by the addition of more sophisticated statistical utilities such as false discovery rate (FDR) estimation [ 62] or other statistical enhancements (e.g. bootstrap method) to analyze HTP data and determine the significance of functional enrichment in individual pathways or GO terms in a more solid way. Computational requirements limit the full integration of these statistical methods, but even without them, our software contributes significantly to improve integrative data analysis. We have described WPS, as a new pathway-based analysis tool, that facilitates and enhances the analysis of HTP data in the context of biological pathways and networks. WPS has many unique features not found in a single existing application. WPS has implemented a clustering analysis-like approach but using a more biologically relevant approach in the color cue-templated pattern extraction method. In addition, WPS uses Fisher's exact test to evaluate statistical significance of identified genes. Finally, WPS incorporates pathway and association network-based biological contexts as a platform, and unique coloring scheme with multiple datasets and multiple pathways as an intuitive way to visualize and analyze data of different resources. This is likely to be important for comparison of HTP data from diverse sources such as microarray and proteomics. Within WPS, the new way of pattern extraction may provide another dimension for uncovering genes with more quality-based, not just quantity-based, expression patterns likely with implications and themes more closely related to ongoing biological processes. Within WPS, the new way of visualizing and analyzing the biological relations among genes, pathways, and terms under GTANs provides a new platform for integrated discovery. This tool represents a pathway-based platform for discovery integration to maximize analysis power. Availability and requirements Project name: Pathway analysis tool WPS for high-throughput data; Operating system: Microsoft Window 2000 or XP Programming language: Microsoft Visual Basic 6 Other requirements: Internal databases for different species and a collection of over 1900 PathwayScopeFiles (PSCP files for mouse) available on web site; Additional user-provided PSCP files and those from other sources will be made available as they are collected. License: Free to academics; distributed through license agreement Any restrictions to use by non-academics: commercial license needed List of abbreviations used WPS – WholePathwayScope PSCP – PathwayScope File WSCP – WholeScope File CRI – Criteria File GTAN – Gene-Term Association Network HTP – High Throughput G5G8 – ABCG5 and ABCG8 ABC – ATP-binding cassette Tg – Transgenic KO – Knockout KEGG – Kyoto Encyclopedia of Genes and Genomes CGAP – The Cancer Genomes Anatomy Project SVG – Scalable Vector Graphics technology GO – Gene Ontology SAGE – Serial analysis of gene expression M Y – Programmer Analyst III and Scientific Application Specialist from ABCC, responsible for design and implementation of WPS, a former member of UTSW. J D H – Assistant Professor of UTSW, a collaborator who provided microarray data in the application examples. J C C – Associate Professor of UTSW, a scientific partner of H H H, responsible for initial design of WPS in UTSW. H H H – Director of McDermott Center and Investigator of HHMI, responsible for initial funding and design of WPS in UTSW. R M S – Senior author, Supervisor of M Y in ABCC, responsible for design and improvement of WPS and funding for WPS in ABCC. Additional File 1 A Microsoft PowerPoint file including a few slides of screenshots to describe the features for displaying a Biocarta pathway graph and highlighting selected genes to display their data in the graph. Slide1: The window for creating a PSCP file for a Biocarta pathway from the internal database. Slide 2: The PSCP file including all the genes in the created Biocarta pathway "FXR and LXR Regulation of Cholesterol Metabolism". Slide 3: Color the created PSCP file with loaded CRI files (the time-course data used in Fig. ) with gradient coloring scheme. Slide 4: WPS can display the corresponding Biocarta pathway diagram in a separate internet browser and show the data with designated arrows (red arrows) for the selected genes highlighted in created PSCP file (slide 3). Clickable buttons labeled with names of loaded datasets are to allow displaying of data for corresponding CRI file for the selected genes. Additional File 2 A Microsoft PowerPoint file including a slide of a screenshot for a microarray raw dataset in a worksheet of an Excel file to graphically illustrate the format and 3 requirements of a data file to be converted into a CRI file in WPS. Additional File 3 A Microsoft Word file including a detailed description of the three types of files in WPS. Additional File 4 A Microsoft PowerPoint file including a few slides of screenshots to describe the feature for pattern extraction of genes from a colored PSCP file. Slide1: A colored PSCP file (previously has been loaded with CRI files) subjected to pattern extraction. Slide 2: The pattern extraction window for extraction of genes from the colored PSCP file in slide 1 that match with the defined color pattern in the color template panel. Slide 3: The created PSCP file including the extracted genes in slide 2 to verify the pattern of extracted genes colored with same set of CRI files. Additional File 5 A Microsoft Word file including description of the feature for manipulation and filtering of GTANs. Additional File 6 A Microsoft PowerPoint file including a slide for screenshot of the window for searching network for specific genes or terms or for disease-associated genes. The selected disease from database is used to search and highlight the associated genes in current GTAN/PSCP file for further analysis. Additional File 7 A Microsoft PowerPoint file including a slide for illustration of a 2 × 2 contingency table used as basis for Fisher's exact test. Additional File 8 A Microsoft Excel file including an example result of Fisher's exact test exported from WPS in Figure . Additional File 9 A Microsoft PowerPoint file including a few slides of screenshots to describe the feature for pathway or PSCP-scoped "local Fisher's exact test" of user-defined pattern enrichment of choice genes colored with CRI file(s) in a PSCP file being analyzed. Slide1: A colored PSCP file (previously has been loaded with CRI files) subjected to "local Fisher's exact test". Slide 2: The "local Fisher's exact test" window for measuring statistically the enrichment of genes with user-defined criteria, in this example, the enrichment degree of differentiated expressed genes (red and green colors in the color template panel) for each dataset within this pathway. Additional File 10 A Microsoft PowerPoint file including a slide for screenshot of the window from WPS for sorting a dataset to pathway/term scoped sub-datasets for further processing. Additional File 11 A Microsoft Word file describing the materials and methods for preparation of microarray data used for describing the program features. Additional File 12 A Microsoft Excel file including the complete pair-wise gene-term relations in the GTAN in Fig. . Additional File 13 A graphical tif file to illustrate a filtered GTAN from the GTAN of Fig. for terms with minimal associations of genes, which tend to be unique or specific for their associated genes. Genes are highlighted in red. Additional File 14 A graphical tif file to illustrate a GTAN derived from the GTAN of Fig. by merging into a gene-gene network through shared terms. Some genes are highlighted in red used for further manipulation. Additional File 15 A Shockwave Flash file to show a movie clip as a program demo for how to convert a dataset file to a CRI file to be used in WPS. (Note: the movie files can be viewed directly using internet browser with Flash Animation plug-in) Additional File 16 A Shockwave Flash file to show a movie clip as a program demo for how to load CRI files(s) to color a PSCP or a WSCP file. Additional File 17 A Shockwave Flash file to show a movie clip as a program demo for how to create a PSCP file or WSCP file from the internal database. Additional File 18 A Shockwave Flash file to show a movie clip as a program demo for how to do pattern extraction from selected CRI file(s), how to do the global Fisher's exact test for a given list (e.g. a gene list from pattern extraction), and how to create a GTAN from a given list. Additional Files 19–34 zip files that include each of 16 microarray CRI files used in the application examples in the manuscript (Day-5.zip, Day-3.zip, Day1.zip, Day5.zip, Day10.zip, Day14.zip, Day18.zip, Day21.zip, Day30.zip, Day60.zip, Day90.zip, G5G8KO1.zip, G5G8KO2.zip, G5G8KO3.zip, G5G8Tg1.zip, G5G8Tg2.zip) (unzip them using WinZip program or other appropriate programs before use). Additional Files 35–50 zip files that include each of 16 microarray raw files (Excel files) used in the application examples in the manuscript (rDay-5.zip, rDay-3.zip, rDay1.zip, rDay5.zip, rDay10.zip, rDay14.zip, rDay18.zip, rDay21.zip, rDay30.zip, rDay60.zip, rDay90.zip, rG5G8KO1.zip, rG5G8KO2.zip, rG5G8KO3.zip, rG5G8Tg1.zip, rG5G8Tg2.zip (unzip them using WinZip program or other appropriate programs before use) We thank Linda Giang, Jigui Shan, Tammy Qiu, and Gary Smythers for technical assistance. We also thank Yanhui Hu and Joshua Labaer from Harvard Medical School for kindly providing partial MedGene database, Richard A. Lempicki and Wei Gao from NIAID, NIH for technical assistance and valuable discussion. We sincerely thank Carl Schaefer from National Cancer Institute Center for Bioinformatics (NCICB) for providing CGAP biocarta pathway data and information as well as other technical assistance. We especially thank Robert Guzman, Norma Anderson and Esther Nie from UT Southwestern Med Ctr. for excellent technical assistance. We also thank David W. Russell, Alexander Pertsemlidis and Jeff Schageman from UT Southwestern Med Ctr. for their helpful discussions. This work has been funded in whole or in part with Federal funds from the National Cancer Institute, National Institute of Health, under Contract No. NO1-CO-12400. Initial funding came from The Howard Hughes Medical Institute and the National Institute of Health (ROI HL72304 and NHLBI Program for Genomic Applications UOI HL66880). - Golub TR, Slonim DK, Tamayo P, Huard M, Gaasenbeek M, Mesirov JP, Coller H, Loh ML, Downing JR, Caligiuri MA, Bloomfield CD, Lander ES. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science. 1999;286:531–537. doi: 10.1126/science.286.5439.531. [PubMed]
- Ross DT, Scherf U, Eisen MB, Perou CM, Rees C, Spellman P, Iyer V, Jeffrey SS, Van de Rijn M, Waltham M, Pergamenschikov A, Lee JCF, Lashkari D, Shalon D, Myers TG, Weinstein JN, Botstein D, Brown PO. Systematic variation in gene expression patterns in human cancer cell lines. Nat Genet. 2000;24:227–235. doi: 10.1038/73432. [PubMed]
- Sorlie T, Perou CM, Tibshirani R, Aas T, Geisler S, Johnsen H, Hastie T, Eisen MB, van de Rijn M, Jeffrey SS, Thorsen T, Quist H, Matese JC, Brown PO, Botstein D, Lonning PE, Borresen-Dale AL. Gene expression patterns of breast carcinomas distinguish tumor subclasses with clinical implications. Proc Natl Acad Sci USA. 2001;98:10869–10874. doi: 10.1073/pnas.191367098. [PubMed]
- Van't Veer LJ, Dai H, van de Vijver M, He YD, Hart AAM, Mao M, Peterse HL, van der Kooy K, Marton MJ, Witteveen AT, Schreiber GJ, Kerkhoven RM, Roberts C, Linsley PS, Bernards R, Friend SH. Gene expression profiling predicts clinical outcome of breast cancer. Nature. 2002;415:530–536. doi: 10.1038/415530a. [PubMed]
- Marton MJ, DeRisi JL, Bennett HA, Iyer VR, Meyer MR, Roberts CJ, Stoughton R, Burchard J, Slade D, Dai H, Bassett DE, Hartwell LH, Brown PO, Friend SH. Drug target validation and identification of secondary drug target effects using DNA microarrays. Nat Med. 1998;4:1293–1301. doi: 10.1038/3282. [PubMed]
- Roses AD. Pharmacogenetics and practice of medicine. Nature. 2000;405:857–865. doi: 10.1038/35015728. [PubMed]
- Scherf U, Ross DT, Waltham M, Smith LH, Lee JK, Tanabe L, Kohn KW, Reinhold WC, Myers TG, Andrews DT, Scudiero DA, Eisen MB, Sausville EA, Pommier Y, Botstein D, Brown PO, Weinstein JN. A gene expression database for the molecular pharmacology of cancer. Nat Genet. 2000;24:236–244. doi: 10.1038/73439. [PubMed]
- Hooper LV, Wong MH, Thelin A, Hansson L, Falk PG, Gordon JI. Molecular analysis of commensal host-microbial relationships in the intestine. Science. 2001;291:881–884. doi: 10.1126/science.291.5505.881. [PubMed]
- Huang Q, Liu D, Majewski P, Schulte LC, Korn JM, Young RA, Lander ES, Hacohen N. The plasticity of dendritic cell responses to pathogens and their components. Science. 2001;294:870–875. doi: 10.1126/science.294.5543.870. [PubMed]
- Ideker T, Thorsson V, Ranish JA, Christmas R, Buhler J, Eng JK, Bumgarner R, Goodlett DR, Aebersold R, Hood L. Integrated genomics and proteomics analyses of a systematically perturbed metabolic network. Science. 2001;292:929–934. doi: 10.1126/science.292.5518.929. [PubMed]
- Yoo J-Y, Huso DL, Nathans D, Desiderio S. Specific ablation of Stat3 beta distorts the pattern of Stat3-responsive gene expression and impairs recovery from endotoxic shock. Cell. 2002;108:331–344. doi: 10.1016/S0092-8674(02)00636-0. [PubMed]
- Hughes T, Marton MJ, Jones AR, Roberts CJ, Stoughton R, Armour CD, Bennett HA, Coffey E, Dai H, He YD, Kidd MJ, King AM, Meyer MR, Slade D, Lum PY, Stepaniants SB, Shoemaker DD, Gachotte D, Chakraburtty K, Simon J, Bard M, Friend SH. Functional discovery via a compendium of expression profiles. Cell. 2000;102:109–126. doi: 10.1016/S0092-8674(00)00015-5. [PubMed]
- Tamayo P, Slonim D, Mesirov J, Zhu Q, Kitareewan S, Dmitrovsky E, Lander ES, Golub TR. Interpreting patterns of gene expression with self-organizing maps: Methods and application to hematopoietic differentiation. Proc Natl Acad Sci USA. 1999;96:2907–2912. doi: 10.1073/pnas.96.6.2907. [PubMed]
- Eisen MB, Spellman PT, Brown PO, Botstein D. Clustering analysis and display of genome-wide expression patterns. Proc Natl Acad Sci USA. 1998;95:14863–14868. doi: 10.1073/pnas.95.25.14863. [PubMed]
- The Institute for Genomic Research (TIGR) software download page. http://www.tigr.org/software/tm4/
- GeneSpring, a product from Silicon Genetics Inc. http://www.silicongenetics.com
- Yeung KY, Ruzzo WL. Principal component analysis for clustering gene expression data. Bioinformatics. 2001;17:763–774. doi: 10.1093/bioinformatics/17.9.763. [PubMed]
- Tusher VG, Tibshirani R, Chu G. Significance analysis of microarrays applied to ionizing radiation response. Proc Natl Acad Sci USA. 2001;98:5116–5121. doi: 10.1073/pnas.091062498. [PubMed]
- Kanehisa M, Goto S, Kawashima S, Nakaya A. The KEGG databases at GenomeNet. Nucleic Acids Res. 2002;30:42–46. doi: 10.1093/nar/30.1.42. [PubMed]
- Karp PD, Krummenacker M, Paley S, Wagg J. Integrated pathway-genome databases and their role in drug discovery. Trends Biotechnol. 1999;17:275–281. doi: 10.1016/S0167-7799(99)01316-5. [PubMed]
- Karp PD, Riley M, Paley SM, Pellegrini-Toole A. The MetaCyc Database. Nucleic Acids Res. 2002;30:59–61. doi: 10.1093/nar/30.1.59. [PubMed]
- Nakao M, Bono H, Kawashima S, Kamiya T, Sato K, Goto S, Kanehisa M. Genome-scale gene expression analysis and pathway reconstruction in KEGG. Genome Inform Ser Workshop. 1999;10:94–103.
- Nikitin A, Egorov S, Daraselia N, Mazo L. Pathway studio – the analysis and navigation of molecular networks. Bioinformatics. 2003;19:1–3. doi: 10.1093/bioinformatics/btg290.
- PathArt, a product of Jubilant Biosys Ltd. http://www.jubilantbiosys.com
- Ingenuity Pathways Analysis tool, a product of Ingenuity Systems Inc. http://www.ingenuity.com
- MetaCore, a product of GeneGO Inc. http://www.genego.com
- Dahlquist KD, Salomonis N, Vranizan K, Lawlor SC, Conklin BR. GenMAPP, a new tool for viewing and analyzing microarray data on biological pathways. Nat Genet. 2002;31:19–20. doi: 10.1038/ng0502-19. [PubMed]
- Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, Ramage D, Amin N, Schwikowski B, Ideker T. Cytoscape: A software environment for integrated models of biomolecular interaction networks. Genome Res. 2003;13:2498–2504. doi: 10.1101/gr.1239303. [PubMed]
- Grosu P, Townsend JP, Hartl DL, Cavalieri D. Pathway Processor: a tool for integrating whole-genome expression results into metabolic networks. Genome Res. 2002;12:1121–1126. doi: 10.1101/gr.226602. [PubMed]
- Luyf ACM, de Cast J, van Kampen AHC. Visualizing metabolic activity on a genome-wide scale. Bioinformatics. 2002;18:813–818. doi: 10.1093/bioinformatics/18.6.813. [PubMed]
- National Center for Biotechnology information (NCBI) website. http://www.ncbi.nlm.nih.gov
- UniProt/SwissProt Knowledgebase Home Page. http://us.expasy.org/sprot/
- Becker GK, Barnes CK, Bright JT, Wang SA. The genetic association database. Nat Genet. 2004;36:431–432. doi: 10.1038/ng0504-431. [PubMed]
- MedGene Database, a database from Institute of Proteomics, Harvard Medical School. http://hipseq.med.harvard.edu/MEDGENE/
- Kyoto Encyclopedia of Genes and Genomes (KEGG) home page. http://www.genome.ad.jp/kegg
- Biocarta Pathway Collections. http://www.biocarta.com/genes/allPathways.asp
- CGAP, the Cancer Genomes Anatomy Project home page. http://cgap.nci.nih.gov/
- Gene Ontology Consortium home page. http://www.geneontology.org
- Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, Issel-Tarver L, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G. Gene Ontology: tool for the unification of biology. Nat Genet. 2000;25:25–29. doi: 10.1038/75556. [PubMed]
- The Gene Ontology Consortium. Creating the Gene Ontology Resource: design and implement. Genome Res. 2002;11:1425–1433.
- WPS web pages for illustration image files and demo movies: http://www.abcc.ncifcrf.gov/wps/wps_demo.php
- Stanford format description: http://www.tm4.org/stanford_file_description.pdf
- Scalable Vector Graphics (SVG) specification. http://www.w3.org/TR/SVG/ and Graphviz open source graph visualization technology http://www.graphviz.org.
- Hosack DA, Dennis Jr G, Sherman BT, Lane HC, Lempicki RA. Identifying biological themes within lists of genes with EASE. Genome Biology. 2003;4:R70.1–R70.8.. [PubMed]
- Yu L, Li-Hawkins J, Hammer RE, Berge KE, Horton JD, Cohen JC, Hobbs HH. Overexpression of ABCG5 and ABCG8 promotes biliary cholesterol secretion and reduces fractional absorption of dietary cholesterol. J Clin Invest. 2002;110:671–680. doi: 10.1172/JCI200216001. [PubMed]
- Yu L, Hammer RE, Li-Hawkins J, Von Bergmann K, Lutjohann D, Cohen JC, Hobbs HH. Disruption of Abcg5 and Abcg8 in mice reveals their crucial role in biliary cholesterol secretion. Proc Natl Acad Sci USA. 2002;99:16237–16242. doi: 10.1073/pnas.252582399. [PubMed]
- Berge KE, Tian H, Graf GA Yu L, Grishin NV, Schultz J, Kwiterovich P, Shan B, Barnes R, Hobbs HH. Accumulation of dietary cholesterol in sitosterolemia caused by mutations in adjacent ABC transporters. Science. 2000;290:1771–1775. doi: 10.1126/science.290.5497.1771. [PubMed]
- Bae S, Bessho Y, Hojo M, Kageyama R. The bHLH gene Hes6, an inhibitor of Hes1, promotes neuronal differentiation. Development. 2000;127:2933–2943. [PubMed]
- Cormont M, Mari M, Galmiche A, Hofman P, Le Marchand-Brustel Y. A FYVE-finger-containing protein, Rabip4, is a Rab4 effector involved in early endosomal traffic. Proc Natl Acad Sci USA. 2001;98:1637–1642. doi: 10.1073/pnas.031586998. [PubMed]
- Straub JA, Lipscomb EA, Yoshida ES, Freeman RS. Induction of SM-20 in PC12 cells leads to increased cytochrome c levels, accumulation of cytochrome c in the cytosol and caspase-dependent cell death. J Neurochem. 2003;85:318–328. [PubMed]
- Velculescu VE, Zhang L, Vogelstein B, Kinzler KM. Serial analysis of gene expression. Science. 1995;270:484–487. [PubMed]
- EASE download page. http://david.niaid.nih.gov/david/ease.htm
- Fatigo, Data mining tool with Gene Ontology from Spanish National Cancer Center. http://fatigo.bioinfo.cnio.es
- Gominer, a Gene Ontology-based tool for biological interpretation of "omic" data from National Cancer Institute. http://discover.nci.nih.gov/gominer/index.jsp
- Romero P, Wagg J, Green ML, Kaiser D, Krummenacker M, Karp PD. Computational prediction of human metabolic pathways from the complete human genome. Genome Biology. 2004;6:R2.1–R2.17. doi: 10.1186/gb-2004-6-1-r2. [PubMed]
- Kelley R, Ideker T. Systematic interpretation of genetic interactions using protein networks. Nat Biotech. 2005;23:561–566. doi: 10.1038/nbt1096.
- Rahman SA, Advani P, Schunk R, Schrader R, Schomburg D. Metabolic pathway analysis web service (Pathway Hunter Tool at CUBIC). Bioinformatics. 2005;21:1189–1193. doi: 10.1093/bioinformatics/bti116. [PubMed]
- de Jong H, Geiselmann J, Hernandez C, Page M. Genetic network analyzer: qualitative simulation of genetic regulatory network. Bioinformatics. 2003;19:336–344. doi: 10.1093/bioinformatics/btf851. [PubMed]
- Hanisch D, Sohler F, Zimmer R. Topnet – An application for interactive analysis of expression data and biological networks. Bioinformatics. 2004;20:1470–1471. doi: 10.1093/bioinformatics/bth096. [PubMed]
- Li F, Long T, Lu Y, Ouyang Q, Tang C. The yeast cell-cycle network is robustly designed. Proc Natl Acad Sci USA. 2004;101:4781–4786. doi: 10.1073/pnas.0305937101. [PubMed]
- Segal E, Shapira M, Regev A, Pe'er D, Botstein D, Koller D, Friedman N. Module networks: identifying regulatory modules and their condition-specific regulators from gene expression data. Nat Genet. 2003;34:166–176. [PubMed]
- Storey JD, Tibshirani R. Statistical significance for genomewide studies. Proc Natl Acad Sci USA. 2003;100:9440–9445. doi: 10.1073/pnas.1530509100. [PubMed]
- Download website for WholePathwayScope (WPS). http://www.abcc.ncifcrf.gov/wps/wps_index.php
|
This article has been 
