Bioinformatics Advance Access published online on March 4, 2009
Bioinformatics, doi:10.1093/bioinformatics/btp123
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
A modified hyper plane clustering algorithm allows for efficient and accurate clustering of extremely large datasets.
1 Center for Biotechnology and Genomic Medicine, Medical College of Georgia, Augusta, GA USA
2 Department of Medicine, Medical College of Georgia, Augusta, GA USA
3 Department of Pathology, Medical College of Georgia, Augusta, GA USA
*To whom correspondence should be addressed. Dr. Richard McIndoe, E-mail: rmcindoe{at}mail.mcg.edu
| Abstract |
|---|
Motivation: As the number of publically available microarray experiments increases, the ability to analyze extremely large data sets across multiple experiments becomes critical. There is a requirement to develop algorithms which are fast and can cluster extremely large datasets without affecting the cluster quality. Clustering is an unsupervised exploratory technique applied to microarray data to find similar data structures or expression patterns. Because of the high I/O costs involved and large distance matrices calculated, most of the algomerative clustering algorithms fail on large datasets (30,000+ genes/200+ arrays).
In this paper we propose a new two-stage algorithm which partitions the high dimensional space associated with microarray data using hyper planes. The first stage is based on the BIRCH (Balanced Iterative Reducing and Clustering using Hierarchies) algorithm with the second stage being a conventional k-Means clustering technique. This algorithm has been implemented in a software tool (HPCluster) designed to cluster gene expression data.
We compared the clustering results using the two stage hyper plane algorithm with the conventional k-Means algorithm from other available programs. Because the first stage traverses the data in a single scan, the performance and speed increases substantially. The data reduction accomplished in the first stage of the algorithm reduces the memory requirements allowing us to cluster 44,460 genes without failure and significantly decreases the time to complete when compared to popular k-Means programs. The software was written in C# (.NET 1.1).
Availability: The program is freely available and can be downloaded from http://www.amdcc.org/bioinformatics.
Contact: rmcindoe{at}mail.mcg.edu
Associate Editor: Prof. David Rocke
Received on October 7, 2008; revised on January 27, 2009; accepted on February 28, 2009