Logo of bmcbioiBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Bioinformatics
BMC Bioinformatics. 2008; 9: 388.
Published online Sep 20, 2008. doi:  10.1186/1471-2105-9-388
PMCID: PMC2567998

Sequence based residue depth prediction using evolutionary information and predicted secondary structure

Abstract

Background

Residue depth allows determining how deeply a given residue is buried, in contrast to the solvent accessibility that differentiates between buried and solvent-exposed residues. When compared with the solvent accessibility, the depth allows studying deep-level structures and functional sites, and formation of the protein folding nucleus. Accurate prediction of residue depth would provide valuable information for fold recognition, prediction of functional sites, and protein design.

Results

A new method, RDPred, for the real-value depth prediction from protein sequence is proposed. RDPred combines information extracted from the sequence, PSI-BLAST scoring matrices, and secondary structure predicted with PSIPRED. Three-fold/ten-fold cross validation based tests performed on three independent, low-identity datasets show that the distance based depth (computed using MSMS) predicted by RDPred is characterized by 0.67/0.67, 0.66/0.67, and 0.64/0.65 correlation with the actual depth, by the mean absolute errors equal 0.56/0.56, 0.61/0.60, and 0.58/0.57, and by the mean relative errors equal 17.0%/16.9%, 18.2%/18.1%, and 17.7%/17.6%, respectively. The mean absolute and the mean relative errors are shown to be statistically significantly better when compared with a method recently proposed by Yuan and Wang [Proteins 2008; 70:509–516]. The results show that three-fold cross validation underestimates the variability of the prediction quality when compared with the results based on the ten-fold cross validation. We also show that the hydrophilic and flexible residues are predicted more accurately than hydrophobic and rigid residues. Similarly, the charged residues that include Lys, Glu, Asp, and Arg are the most accurately predicted. Our analysis reveals that evolutionary information encoded using PSSM is characterized by stronger correlation with the depth for hydrophilic amino acids (AAs) and aliphatic AAs when compared with hydrophobic AAs and aromatic AAs. Finally, we show that the secondary structure of coils and strands is useful in depth prediction, in contrast to helices that have relatively uniform distribution over the protein depth. Application of the predicted residue depth to prediction of buried/exposed residues shows consistent improvements in detection rates of both buried and exposed residues when compared with the competing method. Finally, we contrasted the prediction performance among distance based (MSMS and DPX) and volume based (SADIC) depth definitions. We found that the distance based indices are harder to predict due to the more complex nature of the corresponding depth profiles.

Conclusion

The proposed method, RDPred, provides statistically significantly better predictions of residue depth when compared with the competing method. The predicted depth can be used to provide improved prediction of both buried and exposed residues. The prediction of exposed residues has implications in characterization/prediction of interactions with ligands and other proteins, while the prediction of buried residues could be used in the context of folding predictions and simulations.

Background

Knowledge of the tertiary (3D) protein structure is vital when addressing the problems in protein folding and function. The commonly accepted hypothesis that protein sequence uniquely determines protein structure [1] enables development of methods for prediction of 3D structure from sequence. Such methods are of substantial value due to the large and exponentially growing sequence-structure gap. Currently, the sequence based 3D structure prediction is still a challenging task [2,3]. Therefore, a set of intermediate, more tractable predictions that target various structural aspects, such as solvent-accessible surface area (ASA), secondary structure (SS), contact number or order, etc., were researched and applied to predict protein structure and function.

The residues that constitute a protein could be divided into surface residues and the remaining residues that are buried in the protein's interior. Since surface residues are directly involved in the interaction with other biological molecules, they have been widely studied [4,5] and used for identifying protein function and stability [6,7] and to aid fold recognition [8,9]. The prediction of the relative solvent accessibility (RSA), which is defined as the ASA of each residue in the protein divided by that observed in an extended (Gly-X-Gly or Ala-X-Ala) conformation and which can be used to identify surface residues, was addressed by a number of methods [10-17]. At the same time, the buried residues, which were shown to have similar local packing arrangements irrespective of protein size [18] also play important roles including formation of a hydrophobic core that helps maintaining protein folding conformation [19] and maintaining of the structural integrity of the protein due to their high degree of conservation that is also shown to have impact on formation of enzyme active sites [20], among others. However, ASA values that can be accurately predicted from protein sequence, e.g. Wang and colleagues reported 0.66 correlation between the predicted and the actual RSA values [17], cannot provide sufficient information to characterize buried residues, i.e. the ASA values of the buried residues are zero or near zero.

As an alternative, the depth of an atom or residue in the protein has been proposed to characterize spatial arrangement of protein structures [21-23]. Several definitions of atom depth have been proposed, including those distance (the minimum distance between an atom and a dot of solvent accessible surface [22] or its closest solvent accessible neighbor [23,24]) or volume dependant [25]. The residue depth (RD) is the average atom depth of all atoms composing this residue. This descriptor has been shown to have higher correlation with residue conservation when compared with ASA. It was also found to be useful for analysis of amide hydrogen/deuterium exchange rates in nuclear magnetic resonance (NMR) experiments [21], for analysis of local packing arrangements in the protein core [18], for analysis and prediction of function sites, such as catalytic sites of enzyme [26] and phosphorylation sites [23,27], and for protein fold recognition [9,28]. Recently, it has been suggested that the most deeply buried residues in the native protein fold might be the first to fold [29], which signifies their importance with respect to folding predictions and simulations. Based on the above, an accurate methodology to predict residue depth from the sequence would provide a useful input for analysis and designing methods for the protein folding.

To date, only one method for prediction of the residue depth based on the protein sequence was developed [30]. This method, which utilizes information encoded in the PSI-BLAST scoring matrix and a support vector regression (SVR) predictor [31], was designed and tested using a large dataset of 923 chains (YW923). This method is characterized by the correlation coefficient between the predicted and the actual depth and the mean absolute error of the depth prediction equal 0.65 and 0.60, respectively. The authors considered the position-specific scoring matrix generated by PSI-BLAST and protein size as the only inputs, although other information could be used to further improve the predictions. In our work, we focus on adding additional inputs (features) that are based on the predicted secondary structure, position in sequence and information per position from PSI-BLAST to provide higher quality residue depth predictions. Our careful design of the proposed method, which is based on performing feature selection and parameterization of the SVR predictor, is also shown to contribute to the improvements. We show that the proposed method provides statistically significantly better predictions when compared with the competing method by Yuan and Wang [30]. We also analyze the selected features to discuss factors related to the residue depth, and we show that the application of the proposed method to prediction of surface/buried residues also shows improvements when compared with the competing method.

Methods

The sequence based prediction methods work in two steps: (1) a fixed-length feature vector is computed based on the sequence and sequence-derived information; (2) the vector is inputted into the prediction model to generate the outcome. The design of the prediction method usually requires a training dataset that is used to construct the model and parameterize the algorithm used to generate the model. In our case we choose SVR to construct the model due to its extensive prior use in bioinformatics application that perform real-valued prediction [12,32-35], including the existing sequence based depth prediction [30]. More specifically, given a sequence, the features were extracted from the sequence itself, and from the sequence-derived PSI-BLAST scoring matrix [36] and secondary structure predicted with PSIPRED [37,38], see Figure Figure11.

Figure 1
Proposed prediction system.

Datasets

We prepared four datasets to test and design the proposed method. The first is the original dataset, YW923, used to design and test method proposed by Yuan and Wang [30]. This dataset is composed of 923 protein chains including X-ray and NMR structures culled using PDB-PRERDB [39] with 25% sequence identity threshold. The included structures were solved by X-ray crystallography with resolution ≤ 2.0 Å and R-factor ≤ 0.2. All NMR structures for those datasets are selected from the first model in PDB files.

Following the test procedure performed in [30], we adopted three-fold cross-validation in our design and tests with YW923 dataset. Due to the large size of the dataset, which imposes time consuming parameterization of SVR, we created a subset of the original dataset that includes randomly chosen 50 sequences from each fold created from the YW923. This dataset, which is composed of 150 chains, is referred to as YW150. The YW150 is used to parameterize SVR and to perform feature selection (see "Prediction Method" Section).

We also prepared two new datasets from the sequences that are deposited in the Protein Data Bank (PDB) [40] between Jan 2007 and Aug 2007, which were filtered to have low identity with the sequences deposited before 2007. More specifically, the sequences deposited before 2007 were filtered using cd-hit program [41] with 90% identity threshold (this set is referred to as 90PDB). The sequences deposited between Jan 2007 and Aug 2007 were filtered with cd-hit with global 40% identity threshold (this set is referred to as 40PDB). Although cd-hit is a computationally efficient application, it is limited to the minimal threshold of 40%, and thus we used Needleman-Wunsch alignment algorithm [42] to filter out sequences deposited in 2007 that share above 25% identity to sequences from 90PDB. As a result, the first new dataset, called PDB491, includes 491 sequences that share at most 40% identity with each other, and at most 25% identity with sequences published in PDB before 2007. To reduce local sequence similarity that could be included when global alignment is used (i.e., when using CD-hit and Needleman-Wunsch algorithms), NCBI's BLASTCLUST program [34] was applied to the union set of 90PDB, YW923 and 40PDB, with the local identity threshold of 25% (-S 25) and default minimal length coverage of 90% (-L 0.9). The second new dataset was constructed by selecting one chain from each of the clusters that contained no sequences from 90PDB and YW923 datasets. This set, called PDB366, includes 366 sequences that, as a result, have local 25% identity with each other and also with both 90PDB and YW923. We note that both PDB491 and PDB366 share low identity (especially PDB366 dataset which includes sequences with low local similarity) with the YW923 dataset that was created before 2007, and also with the training set used by PSIPRED version 2.5 (which was updated in Apr 2006) that we applied to compute the predicted secondary structure. This allows us to perform tests on a dataset that is independent of the sequences used to design this method and other methods (such as PSIPRED) that were used to provide our inputs. The PDB ids of the sequences from both new datasets (PDB366 and PDB491) are included in the Additional file 1.

Calculation of residue depth

We computed the residue depths for all above datasets following the procedure that had been used in [30]. First, MSMS program [43] was executed with a probe radius of 1.4 Å to obtain a list of vertices that represent protein surface. The atom depth of an atom, which is defined as the distance between the atom and the nearest vertex [44], was calculated. Finally, the average depth of all atoms except the hydrogen atoms in an amino acid defines the residue depth. All residue depth values in abovementioned datasets were normalized using the same mean depth (X¯) and its standard deviation (σ) as follows

Xnorm=XX¯σ

where X¯ = 2.64 Å and σ = 1.41 Å were derived from YW923 dataset as shown in [30]. For the new datasets, the corresponding mean depths and standard deviations are X¯ = 2.73 Å and σ = 1.42 Å for PDB491 and X¯ = 2.65 Å and σ = 1.32 Å for PDB366, respectively, which are similar to those values of YW923 dataset. Only the former values (i.e. mean depth and standard deviation from YW923 dataset) were used to normalize the actual depths of all four datasets in order to assure consistency when performing independent (blind) tests on PDB491 and PDB366 datasets.

In [30], only the abovementioned MSMS-based depth index has been considered. In order to analyze differences in prediction performance between distance and volume dependant depth indices, we also computed two other depth indices, DPX [23,24] and SADIC [25], for the YW923 dataset. To calculate DPX values, first, NACCESS program [45] was applied to obtain the solvent-accessible surface areas (ASA) for all atoms. Then the atom depth was calculated as the distance between a given atom and the nearest solvent accessible atom that had positive ASA. Similarly to MSMS-based depth calculation, the DPX value of a residue is the average atom depth of all its atoms except the hydrogen atoms. To compute SADIC-based index, given an atom i of a molecule and a sampling radius r, a depth index Di, r is defined as Di, r = 2Vi, r/V0, r, where Vi, r is the exposed volume of a sphere of radius r centered on atom i and V0, r is the exposed volume of the same sphere when centered on an isolated atom. Following [25], we computed this index values for atoms as the residue depths with a sampling radius of 9 Å. Similarly as in the case of the MSMS-based depth, the residue depth values for two other indices in YW923 dataset were normalized according to their mean depths and standard deviations with X¯ = 0.94 Å and σ = 1.05 Å for DPX and with X¯ = 0.45 and σ = 0.33 for SADIC algorithm (the values are based on a ratio of two volumes and thus they have no unit) using the above formula.

Feature Vector

The feature vector used by the proposed method was encoded based on global and local information that was obtained from three sources: sequence (sequence-based features), multiple alignment (PSI-BLAST-based features), and predicted secondary structure (PSIPRED-based features).

Sequence-based Features

Earlier contributions [22,23] have shown that protein size is correlated with both maximum and average residue depths, and this relationship could be represented by a linear or nearly linear function. Yuan and Wang also showed the beneficial effect of the protein size on the accuracy of depth prediction [30]. Hence, our method also includes this feature. We normalized this features by dividing the sequence length by 1000.

Additionally, we observe that the residues at the termini (for both C-terminus and N-terminus) are usually on the surface or close to the surface. We define the position of the ith residue in the sequence as

position=|i(L+1)/2|L/2

where L is the sequence length. This value represents the sequence distance to the center of the chain. These two features (size and position) constitute our sequence-based features.

PSI-BLAST-based Features

Similarly as in PSIPRED [37], PSI-BLAST was used to perform multiple alignment of the input sequence with the E-value equal 10-3 and three-iterations against the NCBI nonredundant protein sequence database (nr database); this database was filtered to remove low-complexity regions, transmembrane regions, and coiled-coil segments. PSI-BLAST's output includes position-specific scoring matrix (PSSM) and information per position (IPP). The PSSM is a L × 20 matrix, where 20 is the number of amino acid types. The score values are first normalized by using standard logistic function

11+exp(x).

The information per position provides a quantitative measure of sequence conservation among the homologous sequences used to construct the PSSM for each position [46]. This value, which is stored in the second last column in PSI-BLAST profiles, is provided directly by PSI-BLAST.

Next, in our coding scheme, a sliding window of 15 neighboring residues was used to represent the evolutionary information of a sequence, where each position of the window had 21 possible values with 20 from PSSM and one from IPP. The selection of the window size is motivated by the size used in [30]. We denote the PSI-BLAST based features by PSSMαh and IPPh for each residue, where α represents a type of 20 amino acids and h = {-7, -6,.., +6, +7} represents a position in the sliding window (h = 0 corresponds to the central residue, h < 0 (> 0) corresponds to positions towards N-terminus (C-teminus) with distance of h from the central residue. As a result, there are 15 × 21 features generated from the PSI-BLAST's output.

PSIPRED-based Features

The secondary structure prediction was performed using PSIPRED due to the following: (1) PSIPRED was recently shown to provide superior accuracy when compared with other state-of-the-art secondary structure prediction methods[47]; (2) this method is frequently used to support a variety of other predictions tasks such as solvent accessibility [13], fold prediction [48], folding rate prediction [49], predictions of beta-turns [50], alpha-turns [51], contact order [34], to name just a few. The motivation to include secondary structure came from the differences in distributions of the residue depth values within to three secondary structures i.e. helix (H), strand (E), and coil (C) [30]. While Yuan and Wang considered the actual secondary structure to analyze the distributions [30], we apply the secondary structures predicted from sequences. We note that the PSIPRED predictions include the secondary structure state for each residue that is accompanied by the corresponding probability. Based on the insights provided in [52], we investigate whether these probabilities could be used to address residue depth prediction.

We designed several feature sets based on the outputs from the PSIPRED, which include local and global information. The local information is composed of 15 × 3 features that concern probabilities in a window of 15 neighboring residues, where the secondary structure of each residue is represented by a 3-dimensional probability vector, i.e., probability of coil, strand, and helix prediction. These secondary structure probability profiles (SSP) for each residue are denoted by SSPαh, h = {-7, -6,.., +6, +7} comprising 45 features. The global information is coded by the secondary structure content and the frequency of secondary structure segments as follows:

contentα=#α#H+#E+#Cfsegα=#segα#segH+#segE+#segC

where α = {H, E, C}, is the number of secondary structures of type α in the sequence, and #segα is the number of segments that only contain one type of consecutive secondary structures α. We note that since one or two consecutive predicted helical residues could not form a helix segment, they are replaced by coils when computing the frequency of secondary structure segments. Hence, we obtain 15 × 3 + 3 + 3 = 51 PSIPRED-based features.

Overall, we produced 368 features that serve as the input vector for the proposed prediction model, see Table Table1.1. In contrast, Yuan and Wang used 15 × 20 features based on the PSSM matrix and 1 feature based on the protein size (total of 301 features) [30]. For the sake of comparison with the results of Yuan and Wang's (YW) method [30], we combine the position and IPP features together (they correspond to information computed per position). This way, we define four sets of features that include PSSM (300 features computed from PSSM), SS (51 features that concern the probabilities of the secondary structure, the content, and the segment frequency), PS (protein size), and PI (position and information per position).

Table 1
Summary of the computed features.

Prediction Method

Support Vector Regression

SVR is a regression model based on the support vector machine (SVM) [53]. The motivation behind the choice of SVR comes from wide-spread applications of SVRs in real-value predictions concerning various bioinformatics problems, such as prediction of accessible surface areas [12,15], contact numbers [32], protein B-factors [54], gene expression levels [33], contact orders [34], and finally the application in the existing method for residue depth prediction [30].

SVR predictor maps feature vectors into multi-dimensional space by using kernel function K, ε-insensitive loss function and regulatory parameter C. In our case, we use Guassian kernel function K(xi, xj) = exp (-γ ||xi xj||2). The choice of the kernel function is motivated by its competitive performance for solving nonlinear problems when compared with other kernel functions [54] and prior use for the residue depth prediction [30]. Similarly as in [30] the error tube parameter ε is set to equal 0.001, while we optimize the kernel parameter γ and regulatory parameter C through a grid search on YW150 dataset (see "Parameterization of SVR" section). A detailed description of SVR could be found in [53].

Evaluation of prediction performance

The performance of the proposed method was evaluated based on n-fold cross validation performed on YW923, PDB491, and PDB366 datasets. The protein chains were randomly divided into n subsets to create cross validation folds. We performed three-fold cross validation (3 CV) to maintain consistency with results reported in [30] and ten-fold cross validation (10 CV). Furthermore, we also performed blind tests by training the prediction model on the YW923 dataset and testing on two new datasets, PDB491 and PDB366.

We adopted three indices to validate and compare quality of the proposed method: Pearson correlation coefficient (PCC), mean absolute error (MAE) and mean relative error (MRE) between predicted and observed depths, which are defined as

PCC=i=1N(xix¯)(yiy¯)[i=1N(xix¯)2][i=1N(yiy¯)2],MAE=1Ni=1N|xiyi|,MRE=1Ni=1N|xiyixi|,

where xi and yi are the observed and predicted depth values of the ith residue in sequence, respectively, and x¯ and y¯ are the corresponding mean values, respectively. The PCC is also used to rank individual features with respect to their relation with the depth values. We emphasize that the prediction quality was reported at the residue level, i.e. all residues in a given dataset were collected together and one PCC value across all residues was computed, while the MAE and MRE values are computed as the average over all residues. Based on our observations, both absolute errors and relative errors between the actual and the predicted depth values have skewed distributions (see Figure Figure2).2). Therefore, as suggested in [55], we report two outer centiles, i.e., the 10th and 90th centiles, to strengthen the analysis of the prediction performance. They show differences between the actual and the predicted depth values for errors with low and high magnitudes (this applies to both absolute errors and relative errors for each residue). Similarly as in [13] we also estimate the quality of the prediction at the fold level. The PCC, MAE, and MRE are computed for each test fold and next they are averaged over all folds. In this case we also report standard deviations to estimate the spread of the prediction performance.

Figure 2
The distributions of absolute errors and relative errors at the residue level for four prediction methods (using different feature sets) on YW923 dataset based on the three-fold cross validation. In panel (A) the bars show the counts of residues with ...

Parameterization of SVR

The parameterization of SVR was performed through a grid search over γ and C values based on three-fold cross-validation on YW150 dataset for the MSMS based depth. We considered γ and C values drawn from {0.01, 0.02, 0.03,..., 0.1} × {0.1, 0.3, 0.5,..., 1.9} grid. Two parameterizations were performed: (1) using the PSSM and PS features, which corresponds to the design of Yuan and Wang [30], we parameterized SVR used to perform feature selection (see "Feature Selection" section); and (2) using the features selected by the feature selection from the set of all 368 features considered in this study. The first parameterization resulted in γ = 0.02 and C = 1.5, while the second gave γ = 0.06 and C = 0.5. The latter set of parameters is applied to build the proposed prediction model.

Feature Selection

To address high dimensionality of the feature set, we processed it to remove irrelevant features. This may lead to more compact prediction model, ability to interpret the selected features, and potentially better prediction quality. We applied a correlation-based feature selection [56], which utilizes the Pearson correlation coefficient (PCC) values measured between each feature and the target values, to select best-performing subset of the original 368 features. In case when the correlation coefficient is close to zero, the corresponding feature is not correlated with the prediction outcome, and thus it could be considered irrelevant. More specifically, we computed the PCC between each feature and the target depth values in two steps. First, the PCC values were computed for each of the three folds in YW923 dataset. Second, the average PCCs over the three folds was calculated and the absolute values were used to rank the original set of 368 features. This cross-validation based selection allows for maintaining consistency with the experimental evaluation of the depth prediction quality. Next, we tested the quality of the depth prediction using SVR with γ = 0.02 and C = 1.5 based on three-fold cross-validation on YW150 dataset with top 50, 75, 100, 125,..., 368 features. The best results, i.e., PCC = 0.629, MAE = 0.610 Å, and MRE = 18.1%, were obtained with a set of 125 features, thus reducing the size of the original feature set by 66%.

Results and Discussion

Prediction performance for the MSMS based depth

The proposed prediction method was implemented using LIBSVM library [57]. The three-fold and ten-fold cross-validations were used to estimate the out-of-sample prediction quality on YW923, PDB491, and PDB366 datasets for MSMS based depth index (results for two other depth indices are shown in the next section). The proposed prediction method, referred to as RDPred, uses 125 features and Gaussian-kernel based SVR with γ = 0.06 and C = 0.5.

Table Table22 shows the comparison of predictive performance measured at the residue level between RDPred and Yuan and Wang's (YW) method [30], as well as when different feature sets were used. In particular, we include tests when the input sequences are represented using only PSSM features, PSSM and PS features, all 368 features considered in this study. The first two cases allow for comparison with [30] where the same features were used, but parameterization of the SVR was different. The third case allows evaluating the value added of the performed feature selection and the second SVR parameterization round.

Table 2
Comparison of prediction performance at the residue level on four datasets (YW923, YW150, PDB491 and PDB366) between the proposed RDPred method, the YW method (Yuan and Wang, 2008), and when applying different feature sets and test types (best results ...

For the three-fold cross validation the experiments show that RDPred consistently provides better predictions, i.e., it obtains the lowest MAE and MRE as well as the lowest 10th centile values for the absolute error and the lowest 10th and 90th centiles values for the relative error. For the YW923 dataset, when compared to YW method, RDPred improved the MAE to 0.558 (from 0.6), the PCC to 0.67 (from 0.65), and MRE to 17% (from 18%). Although the PCC has decreased and the 90th centile of the absolute error has increased after the feature selection for YW923 dataset (0.668 for RDPred vs. 0.681 when using all features), both MAE and MRE as well as the 10th centile of the absolute error and the 10th and 90th centiles of the relative error have improved justifying the need for the feature selection.

Most importantly, the same differences are observed for the two new datasets, PDB491 and PDB366. Table Table22 shows that RDPred is better than predictions based on PSSM and PS features (which correspond to the design of YW method), i.e., for PDB491 dataset, the PCC was improved from 0.659 to 0.664, MAE from 0.639 to 0.607, and MRE from 20% to 18.2%, and for PDB366 dataset, the PCC was improved from 0.634 to 0.639, MAE from 0.614 to 0.579, and MRE from 19.6% to 17.7%. This shows that the performed parameterization and feature selection did not overfit the YW923 dataset.

The (skewed) distributions of the absolute errors and the relative errors on YW923 dataset are shown in Figure Figure2.2. These distributions and the centile values from Table Table22 show that RDPred generates more predictions with low error values and fewer predictions with high error values when compared with the other three methods. The skewness of errors is due to the skewed depth distribution, which is given in Figure Figure33.

Figure 3
The distribution of counts of residues at different depth level on YW923 dataset. The depth values were binned to intervals of 0.5 size (x-axis), while the numbers above the bars shows the corresponding counts.

Table Table22 shows that the results based on the ten-fold cross validations for PSSM+PS and RDPred are consistent with corresponding results of the three-fold cross validation tests. Figure Figure44 compares the prediction performance at the fold level for RDPred and PSSM+PS using both three-fold and ten-fold cross validations for the three considered datasets. We observe that ten-fold cross validation results show larger error bars than the corresponding results obtained using three-fold cross-validation. This is due to a relatively large variability of the prediction quality for individual sequences. Overall, the Figure shows that although on average the PCC values are higher for the proposed RDPred method, the error bars show that the difference is not significant. On the other hand, the differences in the case of the MAE and MRE are more substantial. We performed the paired t-test at the 95% significance level for each type of the quality index, in which we compare the corresponding pairs of the ten-fold cross validation results on the three datasets. For datasets YW923, PDB491, and PDB366, the corresponding P-values for PCC equal 0.19, 0.22, and 0.21, respectively. The P-values for MAE and MRE were below 0.00000001 in the case of all three datasets. The t-test shows that the improvement with respect to PCC values is not significant; however, RDPred provides statistically significantly lower MAE and MRE values over all three datasets when compared with the predictions based on the PSSM+PS method.

Figure 4
The comparison of (A) PCC, (B) MAE and (C) MRE values at the fold level when using three-fold cross validation (3 CV) and ten-fold cross validation (10 CV) on the three datasets, i.e., YW923, PDB491 and PDB366. The x-axis shows the corresponding datasets ...

We also performed a detailed, i.e., based on the predictions derived using three-fold cross validation for individual sequences in YW923 dataset, comparison between RDPred and YW method. Since the individual prediction were not available for YW method, we simulated their prediction by using PSSM and PS features with our SVR model (they used these exact features and SVR to perform predictions). These results allow evaluation of the value added of performing feature selection, adding SS (features based on predicted secondary stricture) and PI (position and information per position) features, and performing the SVR parameterization. Figure Figure55 shows the relations of MAE and PCC values between the RDPred and the simulation of YW method. In case of MAE, see Figure Figure5A,5A, we observe that RDPred provides lower errors for majority of the predicted sequences, i.e., for 821 out of 923 proteins the RDPred predictions are below the diagonal which denotes points where both methods obtain equal errors. Similarly, for 646 out of 923 sequences, the RDPred gives higher PCC values; in this case the points are located above the diagonal, see Figure Figure5B.5B. Furthermore, a paired t-test was applied to investigate statistical significance of these differences. The paired t-test performed at 95% significance level, which compared pairs of MAE values (and pairs of PCC values) for the same sequences predicted by RDPred and the simulation of the YW method, shows that in both cases, i.e., MAE and PCC, the RDPred provided statistically significantly better predictions. The corresponding P-values were smaller than 0.0001 for both PCC and MAE and t-values were equal 12.7 for PCC and 34.1 for MAE.

Figure 5
The comparison between RDPred and the predictions based on PSSM and PS features (simulation of YW method). Each point denotes prediction for one sequence in YW923 dataset. Panel (A) compares MAE values, while panel (B) compares PCC values; x-axis shows ...

We also report and compare predictions of RDPred and the simulation of YW method that are binned with respect to the actual depth values, see Table Table3.3. RDPred obtained better results for residue depth RD < 2.25 Å and RD ≥ 5.0 Å, similar results for 2.25 Å ≤ RD < 3.0 Å and 4.0 Å ≤ RD < 5.0 Å, and slightly worse predictions for 3.0 Å = RD < 4.0 Å when compared with the method based on PSSM+PS features. We observe relatively large improvement for shallow residues characterized by depth of below 2.25 Å, which constitute 61% of all residues. Similar degree of improvement is also observed for the deepest residue, i.e. those with depth above 5.0 Å. The 10th centile values show that RDPred produces more predictions with smaller errors (the values are lower), while the 90th centile shows that the proposed method obtains fewer larger errors (the values are also lower).

Table 3
Comparison of prediction errors for different depth bins for the RDPred and the simulation of YW method on YW923 dataset.

The improvements are attributed to the use of PSIPRED based features and the PI features (position and information per position). We note that YW923, PDB491, and PDB366 datasets are characterized by similar Q3 (3-state per-residue prediction accuracy) values for secondary structures predicted with PSIPRED (when compared with DSSP [58]), which equal 79.8%, 79.3% and 78.3% respectively. This shows that the improvements are due to the use of the proposed features rather than differences in the quality of input data (quality of predicted secondary structure).

To further strengthen the evaluation, we performed blind tests by training both PSSM+PS feature (simulation of YW method) and RDPred with YW923 dataset and testing with PDB491 and PDB366 datasets. The corresponding results are listed in Table Table4.4. We observe an improvement due to the use of the proposed method, i.e., the MAE and MRE values together with the corresponding 10th centile values are lower for both datasets in the case of RDPred, which is consistent with the results obtained based on the three fold cross validations shown in Table Table22.

Table 4
Summary of the blind test results on PDB491 and PDB366 datasets

The paired t-test performed at 95% significance level, which compares pairs of MAE values (and pairs of PCC values) for the same sequences predicted by RDPred and the simulation of the YW method, for the predictions from both blind tests shows that the differences are significant. More specifically, for the PDB366 dataset, P-values for both PCC and MAE were below 0.0001 while t-values were equal 7.5 and 18.4 for PCC and MAE, respectively. Similarly, for PDB491, the P-values were again below 0.0001 and t-values were equal 7.4 for PCC and 21.7 for MAE.

When comparing the results between the two datasets (YW923 and PDB491), higher MAE obtained for the PDB491 dataset shows that this datasets is more difficult (although consistent differences in quality between individual methods on each dataset are observed). One potential reason is that the PDB491 dataset is characterized by larger mean depth than that of YW923 (2.74 Å vs. 2.64 Å). This is also supported by smaller values of MAE for PDB366 dataset when compared with results on PDB491 dataset (see Tables Tables22 and and4)4) because of the lower mean depth of the former dataset (2.65 Å vs. 2.74 Å). As shown in (Yuan and Wang, 2008), buried residues are more difficult to predict than the exposed residues. Furthermore, PDB491 includes 277 multimer chains and 214 monomers while YW923 includes 250 multimer chains and 673 monomers. This shows that PDB491 has higher ratio of multimer chains, while these chains include larger number of buried residues. The poorer results on the YW150 dataset are due to the small size of this dataset.

Figure Figure66 shows the observed depths and the depths predicted by RDPred for three representative protein chains, 1QFTA, 1ISPA and 1H0LA. The 1QFTA has MAE equal 0.555, which represents a prediction of average quality, see Figure Figure6A.6A. The MAE of 1ISPA equals 0.637 (Figure (Figure6B)6B) and MAE of 1H0LA equals 0.317 (Figure (Figure6C),6C), which represents predictions with above average and below average quality, respectively. We observe that for all three cases, the depths of shallow (exposed) residues are predicted relatively well, i.e., their depths are neither under- or over-predicted. The main difference between the three typical prediction cases is the degree to which the deeply buried residues are predicted. In case of average or below average prediction, we observe that many of the buried residues are identified, but their depths are under-predicted. At the same time, Figure Figure6B6B that shows above average prediction indicates that depths of some of the buried residues are predicted accurately.

Figure 6
The observed and predicted depths by RDPred for three protein chains: Panel (A) 1QFTA; Panel (B) 1ISPA; and Panel (C) 1H0LA.

Table Table55 lists the MAE for 20 amino acids (AAs), their mean depths and standard deviations of the depths in YW923 dataset, as well as several physicochemical properties including hydrophobic, charge, and flexibility indices that were obtained from the AA index database [59]. The rows are ordered in ascending order by the MAE values. We observe that predictions of RDPred result in smaller error for all amino acids types when compared with simulation of YW method (using PSSM and PS as the inputs); the only exception is Trp (W) in which case the same error value is obtained. This again shows consistency of the obtained improvement. The table also reveals that MAE obtained for each AA type is strongly correlated with its mean depth, standard deviation of the depth, hydrophobic scale values that quantify hydrophobic tendency of a given AA [60], and flexibility index [61]. The corresponding correlation coefficients for the RDPred's errors equal 0.98, 0.95, 0.89, and -0.90, respectively. We conclude the following: (a) AAs with smaller mean depths (and smaller standard deviations of the average depth) are easier (more accurate) to predict than those with the larger corresponding values, which implies that deeply buried residues are more difficult to correctly predict; (b) hydrophilic and flexible residues are more accurately predicted when compared with the hydrophobic and rigid residues; and (c) charged residues that include Lys (K), Glu (E), Asp (D), and Arg (R) are the easiest (the most accurate) to predict.

Table 5
The MAE, mean depth, standard deviation of the depth (stdev) in YW923 dataset for RDPred and simulation of YW method for the 20 amino acids (AAs).

Predictions for different depth definitions

We computed the residue depths with DPX and SADIC algorithms on YW923 dataset and their correlations with each other and the MSMS based depth values are shown in Table Table6.6. DPX is shown to be highly correlated with the MSMS-based values, while in the case of the SADIC algorithm, the correlation is lower but still relatively high.

Table 6
Correlation matrix for three depth definitions on dataset YW923.

We applied the same features and parameterization as in the original RDPred method (developed for MSMS based depth) and performed three-fold and ten-fold cross validations on the YW923 dataset using the other two depth indices. We tested two sets of features, PSSM+PS (which simulates the YW method) and RDPred's features. The prediction quality measured with PCC and MAE at the residue level is summarized in Table Table77 while the PCC and MAE values at the fold level are visualized in Figure Figure7.7. We did not compute the MRE values because the two other depth indices include values of zero. The MAE values and the corresponding centiles shown in the Table Table77 should not be compared across different depth indices due to large differences in the range of values for the three depth indices.

Figure 7
The comparison (A) PCC and (B) MAE values at the fold level using three-fold cross validations (3 CV) and ten-fold cross validations (10 CV) for the three depth indices, i.e., MSMS, DPX and SADIC, on the YW923 dataset. The x-axis shows the depth index ...
Table 7
Comparison of the prediction performance at the residue level between RDPred and simulation of YW method (using PSSM + PS features) when using three different depth indices.

In general, the results suggest that all considered depth indices can be accurately predicted from the sequence. The PCC values for the DPX index are similar to values obtained for the MSMS based depth, which is due to high correlation between these two depths values and the fact that both definitions are based on the distance. As shown in Figure Figure7,7, MSMS based depth has bigger error bars for both PCC and MAE values when compared with the other two depth indices. This is likely due to the fact that MSMS index is characterized by the largest standard deviation of the depth values, i.e., the standard deviation equals 1.41, 1.05, and 0.33 for MSMS, DPX, and SADIC indices, respectively. We performed the paired t-test for PCC and MAE values at the fold level for each depth index that compares PSSM+PS method and RDPred. These t-tests were based on ten-fold cross validations on the YW923 dataset. For the MSMS, DPX, and SADIC based depth definitions the corresponding P-values equal 0.19, 9.2E-7, and 2.6E-7 for PCC, and 1.8E-10, 2.5E-9, and 1.4E-8 for MAE, respectively. We observe that statistically significantly better PCC values were obtained for the DPX and SADIC indices, while the difference for the MSMS index is not significant. At the same time, using the proposed method to predict each of the three depth indices results in statistically significant improvements of the MAE values.

Following we analyze why the depth defined with SADIC algorithm yields higher quality predictions. The reason for the differences in the prediction performance between SADIC and the other two depth indices is due to the fact that SADIC is a volume based depth, while the other two are distance-based. The volume based depth is negatively correlated with the other two distance based depth indices. As shown in Figure Figure8,8, the maximal and mean distance based depth values (defined with MSMS or DPX) show larger variability with the increasing size of the protein chain, while the maximal and mean volume based depth values are independent of the chain size. The definitions of the three depth indices imply that the volume based depth has an upper bound of 2 while both distance based indices have no upper bound. The prediction of the indices that are characterized by larger variability and wider range of values is more challenging. The wider range of values implies that the corresponding MAE values (which are not normalized against the range) are higher. The reason for the improved PCC values in the case of the SADIC depth index is that these depth values along the protein sequence (referred to as the depth profile) are smoother. On the other hand, the other two indices are characterized by larger number of high spikes, see Figure Figure9,9, in which case it is harder to generate highly correlated values. To show that, we counted the number of spike points for each depth index for sequences from the YW923 dataset. Residue i is called an ε-spike point if its depth satisfies

Figure 8
Relation between protein size and (A) maximal depth and (B) mean depth for the three depth indices, i.e., MSMS, DPX, and SADIC.
Figure 9
The comparison of the observed depth values (the top plot) and the predicted depth values (the bottom plot) for 1QFTA protein chain. Blue, green, and red plots correspond to actual and predicted MSMS, DPX, and SADIC depth values.
(RDi-RDi+1 <ε and RDi-RDi-1 <ε) or (RDi-RDi+1 > ε and RDi-RDi-1 > ε)

where RDi is the distance or volume based depth of the ith residue in the sequence and ε measures the magnitude of the spike with respect to the adjacent residues.

Table Table88 shows the counts of spike points in the YW923 dataset for values of ε ranging between 0 and 1.0 with step of 0.1. For each given value of ε the volume based depth profiles have the smallest number of spikes. The number of spike points for SADIC based depth decreases sharply with the increase of the ε value and no ε-spikes are found for ε ≥ 0.5. At the same time, a large number of spikes with ε ≥ 1.0 can be found for both distance based depth profiles. We visualize the abovementioned differences using the actual and the predicted depth profiles for the 1QFTA protein (the same protein was used in Figure Figure6A),6A), see Figure Figure9.9. The predictions were performed with RDPred using three-fold cross validation test. The MAE values for MSMS, DPX, and SADIC based depth values are 0.56, 0.52, and 0.17, respectively, and they are close to the average prediction quality shown in Table Table7.7. Similarly, the corresponding PCC values equal 0.73, 0.71 and 0.82, respectively. The profiles of the two distance based depth indices are similar and they show a relatively large number of high magnitude spikes, which are under-predicted by RDPred. This is in contrast to the volume based depth profile that is smoother and which includes a smaller number of lower magnitude spikes.

Table 8
The number of spike points in the function of ε values for the three considered depth indices on the YW923 dataset.

Although we observe improvements for all three depth indices when comparing predictions of the proposed RDPred and when using PSSM+PS features, we emphasize that the results for the DPX and SADIC depth indices could be potentially further improved if a separate feature set and SVR parameterization would be performed (which is outside of the scope of this contribution). We also stress that this discussion should not be used to evaluate which of the indices is the best measure of the residue depth.

Analysis of sequence representation

In this and the next sections, the analysis focuses on the MSMS based depth index. Table Table22 shows that feature selection performed to design RDPred provided improvements with respect to the depth predictions. When comparing "All features" and RDPRed rows, we observe that the corresponding MAE and MRE values are lower when reduced feature set was used. At the same time, feature selection also allows analysis of the significant factors that influence prediction of the residue depth. Table Table99 shows the number of original features and the number of selected features (total of 125 features were selected) organized by feature types (see "Feature Vector" section).

Table 9
The number of selected features for different feature types.

We divide our discussion of the selected features into four parts: PSSM-based features, PS (protein size), SS features (probabilities of secondary structure prediction, content and frequency of secondary structure segments), and PI features (position and information per position). First, we investigate the values added of each of these sets by comparing prediction quality of RDPred on the YW923 dataset when using all features with removing one of the above four sets at the time, see Table Table1010.

Table 10
Comparison of residue depth prediction quality when removing individual sets of features used by RDPred.

As shown in Table Table10,10, the largest decrease by 0.15 for PCC and the largest increases by 0.1 and 1.9 for MAE and MRE, respectively, result from removing PSSM features. This suggests that the multiple alignments computed with PSI-BLAST that reflect evolutionary information provide the highest quality input for regression-based prediction of residue depth. On the other hand, the prediction quality remains relatively high when PSSM features are removed, which implies that the remaining features computed based on the predicted secondary structure and sequence also provide substantial amount of useful information. Moreover, comparable values of MAE and MRE are obtained in case of removing the PS and SS features. This shows that protein size and predicted secondary structure provide similar amounts of improvement. Large improvements related to adding the protein size to the PSSM features that were reported in [30] support the claim that our design constitutes a step towards providing an accurate sequence-based depth prediction method. Finally, the smallest improvements are associated with PI features.

The majority of RDPred's features (96 out of 125) correspond to PSSM values. At the same time, only 96 out of the total of 300 PSSM values were selected. Figure Figure1010 visualizes the distribution of the selected PSSM features with respect to their positions in the window. Each cell in the Figure corresponds to one PSSM based feature and the shades of gray represents the absolute average PCC values (the value used during feature selection), i.e., darker color corresponds to stronger correlation, while white color shows which features were not selected. We also computed the mean PCC values for each row and column in Figure Figure10.10. As expected, the distribution of PCC values is relatively symmetric with respect to the central position in the window, which implies that the residues at the N-termini and C-termini in the local window have similar impact on the prediction performed for the central residue. The central residue (denoted by position 0) has the largest mean PCC, while other positions are characterized by lower mean PCC values. In general, the mean PCC values decline with the increasing distance from the central position. One exception are positions -2 and 2 (two residues away from the central residue) in which case the mean PCC is smaller than that for positions +/- 1 and +/- 3. While it is obvious that the positions immediately adjacent to the predicted residue should have large impact on the prediction, we hypothesize that the low average PCC value for the +/- 2 positions is due to limited interactions between these residues and the central residue. For instance, in case of helical structure, the residues at +/- 3 or +/- 4 positions would form hydrogen bond with the central AAs, in contrast to the residues at +/- 2 position. The strongest PCC values for +/- 3 or +/- 4 positions are observed for Glu (E), Gln (Q), and Lys (K), and these residues were shown to be strongly associated with the formation of helices [62], which further substantiates our hypothesis.

Figure 10
Distribution of PSSM features ranked based on PCC values of the corresponding, selected features. The shading of the individual cells (features) corresponds to their absolute average (over 3 folds in YW923 dataset) PCC values: black for PCC ≥ ...

The features corresponding to Glu (E), Lys (K), Asp (D), and Ile (I) for the central residue have the largest PCC values. Moreover, the mean PCC values averaged over the window for different AAs show variations. As presented in Figure Figure10,10, Glu (E), Lys (K), and Asp (D) have the largest mean PCC. According to Table Table5,5, these three AAs are charged, hydrophilic, and the most flexible. We observe that in general, PSSM values of hydrophilic AAs are more strongly correlated with the residue depth than hydrophobic AAs, aliphatic amino acids (Val (V), Ile (I), and Leu (L)) have greater mean PCC values than aromatic AAs (Phe (F), Ser (S), Trp (W), and Tyr (Y)), and finally the tiny AAs (Gly (G), Ser (S), and Tyr (Y)) are also characterized by small mean PCC values.

Table Table1111 shows the PCC values (and the corresponding rank) of the remaining selected features, which include the predicted secondary structure based features, and PS and PI features. In case of the secondary structure probability profiles, we note that the features derived from helices were not included. This is due to relatively uniform distribution of helices with respect to their depths in the protein when compared with the distributions of strands and coils, which had been shown in [30]. Yuan and Wang show that strand residues are biased towards the interior of the protein, while coil residues have a bias to be exposed, and thus the corresponding features were found to be correlated with the residue depth. Furthermore, similarly as in case of the PSSM features, we observe that the magnitude of the PCC values for secondary structure based features declines with the increasing distance from the central residue. In case of the six features based on the global (sequence-wide) content and segment frequency of the predicted secondary structures, only the coil segment frequency was selected. We hypothesize that this could be due to a relatively more "loosely packed" conformations for proteins with larger number of coil segments, where as a result the corresponding proteins would have relatively wider distribution of the residue depth values. Finally, we observe that protein size (PS) is characterized by relatively large PCC value, which confirms results in [30], and that IPP of the central residue and at +4 position are selected. We hypothesize that the latter is likely due to the formation of hydrogen bonds in helices.

Table 11
Summary of the selected features, with exception of the PSSM features.

Prediction accuracy for buried and exposed residues

One of the applications of the predicted residue depth is to distinguish between buried and exposed residues. We used Receiver Operating Characteristic (ROC) [63] analysis to investigate and compare the accuracy of the two-state (buried vs. exposed residues) prediction computed based on predicted residue depth. We choose a series of depth thresholds to classify the residues into the two classes and we compare the quality of the two-state prediction between the RDPred and the simulation of YW method (based on the PSSM and PS features). Figure Figure1111 shows ROC plot of the TP rate (sensitivity) on y-axis against the FP rate (1-specificity) on the x-axis. The sensitivity is defined as the ratio of the number of correct predictions for buried residues to the total number of actual buried residues. Specificity is the ratio of the number of correctly predicted exposed residues to the total number of actual exposed residues. We observe that the RDPred provides on average better predictions when compared with the simulation of YW method. The improvements concern predictions with sensitivity of above 0.8 and specificity of below 0.7, i.e., the ROC curve for RDPred is above the ROC curve of the simulation of the YW method for these values.

Figure 11
ROC-based comparison of two-state prediction when using the RDPred and simulation of YW method to predict residue depth, which is next binarized with a use of threshold to obtain the two classes.

Both, the pioneering work in sequence-based prediction of residue depths of Yuan and Wang [30] and our analysis show that it is more difficult to predict buried residues than the exposed residues when using predicted residue depth as the input. The main reason is that most of the residues are exposed (or close to the protein surface), see Figure Figure3,3, and thus the prediction methods are biased to improve these predictions, in contrast to less frequently occurring depth values for buried residues. Yuan and Wang suggested using the relative depth rank in the entire sequence to interpret the depth values, since this would allow finding deeply buried residues, which in turn would help when modeling structure of novel proteins [30]. To this end, the MSMS based depth values of a protein sequence were sorted in ascending order; this was applied to both the predicted and the observed depth values. When selecting the top 10% buried residues in each chain in YW923 dataset using both observed and predicted values, the resulting overlap (sensitivity within this set of residues) for the predictions with RDPred equals 49.8%. This ratio is better than the ratio reported for the YW method, i.e., 47.8%. Table Table1212 shows the ratios for increasing values of the top percentages. The table shows that RDPred is characterized by improved sensitivity when compared with YW method and the simulation of the YW method. The improvements gradually decrease as the threshold values increase, which is due to inclusion of exposed residues for the larger thresholds. We repeated this analysis but when considering the sensitivity of predicting the most exposed residues, see Table Table13.13. We used a wider range of thresholds since majority of the residues are exposed, see Figure Figure3.3. The results again shows that the proposed RDPred method provide higher sensitivity of prediction of the exposed residues when compared with the simulation of the YW method. We conclude that the improvements in the residue depth prediction performed with RPPred result in improved ability to predict both the most buried and the most exposed residues.

Table 12
Sensitivity of the prediction of the top 10–35% of the most buried residues.
Table 13
Sensitivity of the prediction of the top 10–90% of the most exposed residues.

Conclusion

We propose an accurate method for sequence-based real-value prediction of residue depth. When compared with the recently proposed method by Yuan and Wang that utilized PSSM matrix and protein size as the input [30], the proposed RDPred method applies several new sources of information including predicted secondary structure, residue position, and information per position in the PSI-BLAST profile. We also perform feature selection that reduces the dimensionality of the input vector and allows for investigation into the relations between the input features and the predicted depth values. Our analysis shows that: (1) the most important new features, except the PSSM and protein size that have been studied in [30], are the features based on the predicted secondary structure; (2) hydrophilic and flexible residues are easier to predict than hydrophobic and rigid residues; (3) charged residues that include Lys, Glu, Asp, and Arg are the most accurately predicted; (4) the evolutionary information encoded using PSSM is characterized by stronger correlation with the depth for hydrophilic AAs and aliphatic AAs when compared with hydrophobic AAs and aromatic AAs; and (5) secondary structure of coils and strands is useful in depth prediction, in contrast to helices that are characterized by a more uniform distribution over their depth in the protein.

We investigated the quality of the prediction when considering two distance based, MSMS and DPX, and one volume based, SADIC, depth indices. The proposed RDPred method obtained 0.75/0.76 PCC at the residue level based on three-fold/ten-fold cross validation when predicting SADIC defined depth values, which is better than the correlations obtained for the other two depth indices, i.e., 0.67/0.67 and 0.64/0.65, respectively. This is likely due to the fact that the depth defined using a SADIC index is easier to predict since the corresponding depth profile along the protein chain is smother and it contains smaller number of spikes than the profiles of the other two indices. In general, our results suggest that all considered depth indices can be accurately predicted from the sequence.

The proposed method provides statistically significantly better predictions of MSMS based residue depth, i.e., the MRE and MAE values predicted by RDPred are significantly lower than the corresponding values predicted with the method by Yuan and Wang. Similar conclusions are drawn for the two other depth indices. We show that the predicted depth can be used to provide improved prediction of both buried and exposed residues when compared with the competing method. The prediction of exposed residues has implications in characterization/prediction of interactions with ligands and other proteins, while the prediction of buried residues could be used in the context of folding predictions and simulations. Both, the proposed and the competing method are characterized by higher quality of prediction for the exposed residues.

In conclusion, RDPred method constitutes a step towards providing an accurate sequence-based residue depth prediction method.

List of Abbreviations

YW method: Yuan and Wang method; RDPred: residue depth prediction method; PSSM: position-specific scoring matrix; IPP: information per position; SSP: secondary structure probability profiles; PS: protein size; PI: position and information per position; PCC: Pearson correlation coefficient; MAE: mean absolute error; MRE: mean relative error; CV: cross validation; RSA: relative solvent accessibility; SVR: Support Vector Regression; ROC: Receiver Operating Characteristic; PDB: Protein Data Bank.

Authors' contributions

HZ contributed to the conception and design of the prediction method, designed and computed the features, performed feature selection and experimental comparison, and helped with evaluation of the results. TZ contributed to the conception and design of the prediction method and helped with the evaluation of the results. KC helped with the preparation of the datasets and the experimental study. SS and JR contributed to the conception and design of the prediction method. LK contributed to the conception and design of the prediction method, helped with design of the experimental study and evaluation of the results, and coordinated the project. All authors have drafted, corrected and approved the manuscript.

Supplementary Material

Additional file 1:

Supplementary Table 1. List of PDB ids (including the chain identifier) of sequences from the PDB491 dataset

Acknowledgements

This research was funded in part by NSERC Canada and ASRIP (Alberta Science and Research Investments Program). HZ and TZ would like to acknowledge financial support provided by National Education Committee of China. SS and JR were supported by NSFC (grant no. 10671100), Liuhui Center for applied mathematics, and the joint program of Tianjin and Nankai Universities. We would like to extend our thanks to Dr. Kui Wang, Dr. Gang Hu, and Dr. Bing Xiang for help in performing experiments on the computer cluster at the Nankai University. We are grateful to the anonymous reviewers for their valuable comments and suggestions.

References

  • Anfinsen CB. Principles that govern the folding of protein chains. Science. 1973;181:223–230. doi: 10.1126/science.181.4096.223. [PubMed] [Cross Ref]
  • Bradley P, Chivian D, Meiler J, Misura K, Rohl C, Schief W, Wedemeyer W, Schueler-Furman O, Murphy P, Schonbrun J, Strauss C, Baker D. Rosetta predictions in CASP5: Successes, failures, and prospects for complete automation. Proteins. 2003;53:457–468. doi: 10.1002/prot.10552. [PubMed] [Cross Ref]
  • Moult J, Fidelis K, Kryshtafovych A, Rost B, Hubbard T, Tramontano A. Critical assessment of methods of protein structure prediction – Round VII. Proteins. 2007;69:3–9. doi: 10.1002/prot.21767. [PMC free article] [PubMed] [Cross Ref]
  • Lee B, Richards F. The interpretation of protein structures: estimation of static accessibility. J Mol Biol. 1971;55:379–400. doi: 10.1016/0022-2836(71)90324-X. [PubMed] [Cross Ref]
  • Connoly ML. Solvent accessibility surfaces of protein and nucleic acids. Science. 1983;221:709–713. doi: 10.1126/science.6879170. [PubMed] [Cross Ref]
  • Eisenberg D, McLachlan AD. Solvation energy in protein folding and binding. Nature. 1986;319:199–203. doi: 10.1038/319199a0. [PubMed] [Cross Ref]
  • Gromiha MM, Oobatake M, Kono H, Uedaira H, Sarai A. Role of structural and sequence information in the prediction of protein stability changes, comparison between buried and partially buried mutations. Protein Engineering. 1999;12:549–555. doi: 10.1093/protein/12.7.549. [PubMed] [Cross Ref]
  • Cheng J, Baldi P. A machine learning information retrieval approach to protein fold recognition. Bioinformatics. 2006;22:1456–63. doi: 10.1093/bioinformatics/btl102. [PubMed] [Cross Ref]
  • Liu S, Zhang C, Liang S, Zhou Y. Fold recognition by concurrent use of solvent accessibility and residue depth. Proteins. 2007;68:636–645. doi: 10.1002/prot.21459. [PubMed] [Cross Ref]
  • Rost B, Sander C. Conservation and prediction of solvent accessibility in protein families. Proteins. 1994;20:216–226. doi: 10.1002/prot.340200303. [PubMed] [Cross Ref]
  • Ahmad S, Gromiha MM, Sarai A. Real value prediction of solvent accessibility from amino acid sequence. Proteins. 2003;50:629–635. doi: 10.1002/prot.10328. [PubMed] [Cross Ref]
  • Yuan Z, Huang B. Prediction of protein accessible surface areas by support vector regression. Proteins. 2004;57:558–564. doi: 10.1002/prot.20234. [PubMed] [Cross Ref]
  • Garg A, Kaur H, Raghava GP. Real value prediction of solvent accessibility in proteins using multiple sequence alignment and secondary structure. Proteins. 2005;61:318–24. doi: 10.1002/prot.20630. [PubMed] [Cross Ref]
  • Wang JY, Lee HM, Ahmad S. Prediction and evolutionary information analysis of protein solvent accessibility using multiple linear regression. Proteins. 2005;61:481–491. doi: 10.1002/prot.20620. [PubMed] [Cross Ref]
  • Nguyen MN, Rajapakse JC. Two-stage support vector regression approach for predicting accessible surface areas of amino acids. Proteins. 2006;63:542–550. doi: 10.1002/prot.20883. [PubMed] [Cross Ref]
  • Yuan Z, Zhang F, Davis MJ, Boden M, Teasdale RD. Predicting the solvent accessibility of transmembrane residues from protein sequence. J Proteome Res. 2006;5:1063–1070. doi: 10.1021/pr050397b. [PubMed] [Cross Ref]
  • Wang JY, Lee HM, Ahmad S. SVM-Cabins: Prediction of Solvent Accessibility Using Accumulation Cutoff Set and Support Vector Machine. Proteins. 2007;68:82–91. doi: 10.1002/prot.21422. [PubMed] [Cross Ref]
  • Atilgan AR, Akan P, Baysal C. Small-World Communication of Residues and Significance for Protein Dynamics. Biophys J. 2004;86:85–91. [PMC free article] [PubMed]
  • Chan HS, Dill KA. Origins of structure in globular proteins. Proc Natl Acad Sci USA. 1990;87:6388–6392. doi: 10.1073/pnas.87.16.6388. [PMC free article] [PubMed] [Cross Ref]
  • Bartlett GJ, Porter CT, Borkakoti N, Thornton JM. Analysis of Catalytic Residues in Enzyme Active Sites. J Mol Bio. 2002;324:105–121. doi: 10.1016/S0022-2836(02)01036-7. [PubMed] [Cross Ref]
  • Pedersen TG, Sigurskjold BW, Andersen KV, Kjaer M, Poulsen FM, Dobson CM, Redfield C. A nuclear-magnetic-resonance study of the hydrogen-exchange behavior of lysozyme in crystals and solution. J Mol Biol. 1991;218:413–426. doi: 10.1016/0022-2836(91)90722-I. [PubMed] [Cross Ref]
  • Chakravarty S, Varadarajan R. Residue depth: a novel parameter for the analysis of protein structure and stability. Structure. 1999;7:723–732. doi: 10.1016/S0969-2126(99)80097-5. [PubMed] [Cross Ref]
  • Pintar A, Carugo O, Pongor S. Atom depth as a descriptor of the protein interior. Biophys J. 2003;84:2553–2561. [PMC free article] [PubMed]
  • Pintar A, Carugo O, Pongor S. DPX, for the analysis of the protein core. Bioinformatics. 2003;19:313–314. doi: 10.1093/bioinformatics/19.2.313. [PubMed] [Cross Ref]
  • Varrazzo D, Bernini A, Spiga O, Ciutti A, Chiellini SV, Bracci L, Niccolai N. Three-dimensional computation of atom depth in complex molecular structures. Bioinformatics. 2005;21:2856–2860. doi: 10.1093/bioinformatics/bti444. [PubMed] [Cross Ref]
  • Gutteridge A, Bartlett GJ, Thornton JM. Using a neural network and spatial clustering to predict the location of active sites in enzymes. J Mol Biol. 2003;330:719–734. doi: 10.1016/S0022-2836(03)00515-1. [PubMed] [Cross Ref]
  • Kitchen J, Saunders RE, Warwicker J. Charge environments around phosphorylation sites in proteins. BMC Struct Biol. 2008;8:19. doi: 10.1186/1472-6807-8-19. [PMC free article] [PubMed] [Cross Ref]
  • Zhou H, Zhou Y. Single-body residue-level knowledge-based energy score combined with sequence-profile and secondary structure information for fold recognition. Proteins. 2004;55:1005–1013. doi: 10.1002/prot.20007. [PubMed] [Cross Ref]
  • Pintar A, Pongor S. The "first in-last out" hypothesis on protein folding revisited. Proteins. 2005;60:584–590. doi: 10.1002/prot.20529. [PubMed] [Cross Ref]
  • Yuan Z, Wang ZX. Quantifying the relationship of protein burying depth and sequence. Proteins. 2008;70:509–516. doi: 10.1002/prot.21545. [PubMed] [Cross Ref]
  • Smola AJ, Schölkopf B. A tutorial on support vector regression. Statistics and Computing. 2004;14:199–222. doi: 10.1023/B:STCO.0000035301.49549.88. [Cross Ref]
  • Yuan Z. Better prediction of protein contact number using a support vector regression analysis of amino acid sequence. BMC Bioinformatics. 2005;6:248. doi: 10.1186/1471-2105-6-248. [PMC free article] [PubMed] [Cross Ref]
  • Raghava GP, Han JH. Correlation and prediction of gene expression level from amino acid and dipeptide composition of its protein. BMC Bioinformatics. 2005;6:59. doi: 10.1186/1471-2105-6-59. [PMC free article] [PubMed] [Cross Ref]
  • Song J, Burrage K. Predicting residue-wise contact orders in proteins by support vector regression. BMC Bioinformatics. 2006;7:425. doi: 10.1186/1471-2105-7-425. [PMC free article] [PubMed] [Cross Ref]
  • Liu W, Meng X, Xu Q, Flower DR, Li T. Quantitative prediction of mouse class I MHC peptide binding affinity using support vector machine regression (SVR) models. BMC Bioinformatics. 2006;7:182. doi: 10.1186/1471-2105-7-182. [PMC free article] [PubMed] [Cross Ref]
  • Altschul SF, Madden TL, Schäffer AA, Zhang J, Zhang Z, Miller W, Lipman DJ. Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res. 1997;25:3389–3402. doi: 10.1093/nar/25.17.3389. [PMC free article] [PubMed] [Cross Ref]
  • Jones DT. Protein secondary structure prediction based on position-specific scoring matrices. J Mol Biol. 1999;292:195–202. doi: 10.1006/jmbi.1999.3091. [PubMed] [Cross Ref]
  • Bryson K, McGuffin LJ, Marsden RL, Ward JJ, Sodhi JS, Jones DT. Protein structure prediction servers at University College London. Nucl Acids Res. 2005:W36–38. doi: 10.1093/nar/gki410. [PMC free article] [PubMed] [Cross Ref]
  • Noguchi T, Akiyama Y. PDB-REPRDB: a database of representative protein chains from the Protein Data Bank (PDB) in 2003. Nucleic Acids Res. 2003;31:492–493. doi: 10.1093/nar/gkg022. [PMC free article] [PubMed] [Cross Ref]
  • Berman HM, Westbrook J, Feng Z, Gilliland G, Bhat TN, Weissig H, Shindyalov IN, Bourne PE. The Protein Data Bank. Nucleic Acids Res. 2000;28:235–242. doi: 10.1093/nar/28.1.235. [PMC free article] [PubMed] [Cross Ref]
  • Li W, Godzik A. Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences. Bioinformatics. 2006;22:1658–9. doi: 10.1093/bioinformatics/btl158. [PubMed] [Cross Ref]
  • Needleman SB, Wunsch CD. A general method applicable to the search for similarities in the amino acid sequence of two proteins. J Mol Biol. 1970;48:443–453. doi: 10.1016/0022-2836(70)90057-4. [PubMed] [Cross Ref]
  • Sanner MF, Olson AJ, Spehner JC. Reduced surface: an efficient way to compute molecular surfaces. Biopolymers. 1996;38:305–320. doi: 10.1002/(SICI)1097-0282(199603)38:3<305::AID-BIP4>3.0.CO;2-Y. [PubMed] [Cross Ref]
  • Hamelryck T. An amino acid has two sides: a new 2D measure provides a different view of solvent exposure. Proteins. 2005;59:38–48. doi: 10.1002/prot.20379. [PubMed] [Cross Ref]
  • Hubbard SJ, Thornton JM. NACCESS. Department of Biochemistry and Molecular Biology, University College, London; 1993.
  • Karypis G. YASSPP: Better Kernels and Coding Schemes Lead to Improvements in Protein Secondary Structure Prediction. Proteins. 2006;64:575–586. doi: 10.1002/prot.21036. [PubMed] [Cross Ref]
  • Birzele F, Kramer S. A new representation for protein secondary structure prediction based on frequent patterns. Bioinformatics. 2006;22:2628–34. doi: 10.1093/bioinformatics/btl453. [PubMed] [Cross Ref]
  • Chen K, Kurgan L. PFRES: Protein Fold Classification by Using Evolutionary Information and Predicted Secondary Structure. Bioinformatics. 2007;23:2843–2850. doi: 10.1093/bioinformatics/btm475. [PubMed] [Cross Ref]
  • Ivankov DN, Finkelstein AV. Prediction of protein folding rates from the amino acid sequence-predicted secondary structure. Proc Nat Acad Sci USA. 2004;101:8942–4. doi: 10.1073/pnas.0402659101. [PMC free article] [PubMed] [Cross Ref]
  • Fuchs PF, Alix AJ. High accuracy prediction of beta-turns and their types using propensities and multiple alignments. Proteins. 2005;59:828–839. doi: 10.1002/prot.20461. [PubMed] [Cross Ref]
  • Wang Y, Xue Z, Xu J. Better prediction of the location of alpha-turns in proteins with support vector machine. Proteins. 2006;65:49–54. doi: 10.1002/prot.21062. [PubMed] [Cross Ref]
  • Andersen CAF, Palmer AG, Brunak S, Rost B. Continuum Secondary Structure Captures Protein Flexibility. Structure. 2002;10:175–184. doi: 10.1016/S0969-2126(02)00700-1. [PubMed] [Cross Ref]
  • Vapnik V. Statistical learning theory. New York: Wiley; 1998.
  • Yuan Z, Bailey TL, Teasdale RD. Prediction of protein B-factor profiles. Proteins. 2005;58:905–912. doi: 10.1002/prot.20375. [PubMed] [Cross Ref]
  • Altman DG, Bland JM. Quartiles, quintiles, centiles, and other quantiles. BMJ. 1994;309:996. [PMC free article] [PubMed]
  • Yu L, Liu H. Feature Selection for High-Dimensional Data: A Fast Correlation-Based Filter Solution. Proceedings of the 10th International Conference on Machine Learning. 2003. pp. 856–863.
  • Hsu CW, Lin CJ. A comparison on methods for multi-class support vector machines. IEEE Trans Neural Networks. 2002;13:415–425. doi: 10.1109/72.991427. [PubMed] [Cross Ref]
  • Kabsch W, Sander C. Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features. Biopolymers. 1983;22:2577–2637. doi: 10.1002/bip.360221211. [PubMed] [Cross Ref]
  • Kawashima S, Kanehisa M. AAindex: amino acid index database. Nucleic Acids Res. 2000;28:374. doi: 10.1093/nar/28.1.374. [PMC free article] [PubMed] [Cross Ref]
  • Sweet RM, Eisenberg D. Correlation of sequence hydrophobicities measures similarity in three dimensional protein structure. J Mol Biol. 1983;171:479–488. doi: 10.1016/0022-2836(83)90041-4. [PubMed] [Cross Ref]
  • Vihinen M, Torkkila E, Riikonen P. Accuracy of protein flexibility predictions. Proteins. 1994;19:141–149. doi: 10.1002/prot.340190207. [PubMed] [Cross Ref]
  • Chen K, Kurgan LA, Ruan J. Optimization of the Sliding Window Size for Protein Structure Prediction. Proceedings of the 2006 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology Toronto, Ontario, Canada. 2006. pp. 366–372.
  • Sonego P, Kocsor A, Pongor S. ROC analysis: applications to the classification of biological sequences and 3D structures. Briefings in Bioinformatics. 2008;9:198–209. doi: 10.1093/bib/bbm064. [PubMed] [Cross Ref]

Articles from BMC Bioinformatics are provided here courtesy of BioMed Central
PubReader format: click here to try

Formats:

Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...

Links

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...