Format

Send to

Choose Destination
Sci Rep. 2014 Oct 30;4:6837. doi: 10.1038/srep06837.

Massive fungal biodiversity data re-annotation with multi-level clustering.

Author information

1
Bioinformatics group, CBS-KNAW Fungal Biodiversity Centre, Utrecht, The Netherlands.
2
Computational Systems Biology, Max Planck Institute for Informatics, Saarbrücken, Germany.
3
Institute for Mathematics and Computer Science, University of Southern Denmark, Odense, Denmark.
4
University of Perugia, Perugia, Italy.
5
1] Computational Systems Biology, Max Planck Institute for Informatics, Saarbrücken, Germany [2] Institute for Mathematics and Computer Science, University of Southern Denmark, Odense, Denmark.

Abstract

With the availability of newer and cheaper sequencing methods, genomic data are being generated at an increasingly fast pace. In spite of the high degree of complexity of currently available search routines, the massive number of sequences available virtually prohibits quick and correct identification of large groups of sequences sharing common traits. Hence, there is a need for clustering tools for automatic knowledge extraction enabling the curation of large-scale databases. Current sophisticated approaches on sequence clustering are based on pairwise similarity matrices. This is impractical for databases of hundreds of thousands of sequences as such a similarity matrix alone would exceed the available memory. In this paper, a new approach called MultiLevel Clustering (MLC) is proposed which avoids a majority of sequence comparisons, and therefore, significantly reduces the total runtime for clustering. An implementation of the algorithm allowed clustering of all 344,239 ITS (Internal Transcribed Spacer) fungal sequences from GenBank utilizing only a normal desktop computer within 22 CPU-hours whereas the greedy clustering method took up to 242 CPU-hours.

PMID:
25355642
PMCID:
PMC4213798
DOI:
10.1038/srep06837
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for Nature Publishing Group Icon for PubMed Central
Loading ...
Support Center