Bioinformatics Advance Access published online on January 5, 2008
Bioinformatics, doi:10.1093/bioinformatics/btm579
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Hybrid Huberized Support Vector Machines for Microarray Classification and Gene Selection
aRoss School of Business, University of Michigan, Ann Arbor, MI 48109
bDepartment of Statistics, University of Michigan, Ann Arbor, MI 48109
cSchool of Statistics, University of Minnesota, Minneapolis, MN 55455
*To whom correspondence should be addressed. Prof. Ji Zhu, E-mail: jizhu{at}umich.edu
 |
Abstract |
|---|
Motivation: The standard L2-norm support vector machine (SVM) is a widely used tool for microarray classification. Previous studies have demonstrated its superior performance in terms of classification accuracy. However, a major limitation of the SVM is that it can not automatically select relevant genes for the classification. The L1- norm SVM is a variant of the standard L2-norm SVM, that constrains the L1-norm of the fitted coefficients. Due to the singularity of the L1- norm, the L1-norm SVM has the property of automatically selecting relevant genes. On the other hand, the L1-norm SVM has two drawbacks: (1) the number of selected genes is upper bounded by the size of the training data; (2) when there are several highly correlated genes, the L1-norm SVM tends to pick only a few of them, and remove the rest.
Results: We propose a hybrid huberized support vector machine (HHSVM). The HHSVM combines the huberized hinge loss function and the elastic-net penalty. By doing so, the HHSVM performs automatic gene selection in a way similar to the L1-norm SVM. In addition, the HHSVM encourages highly correlated genes to be selected (or removed) together. We also develop an efficient algorithm to compute the entire solution path of the HHSVM. Numerical results indicate that the HHSVM tends to provide better variable selection results than the L1-norm SVM, especially when variables are highly correlated.
Availability: R code are available at http://www.stat.lsa.umich.edu/~jizhu/code/hhsvm/.
Contact: jizhu{at}umich.edu
Associate Editor: Prof. David Rocke
Received on June 15, 2007; revised on October 9, 2007; accepted on November 18, 2007
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  S. Keerthikumar, S. Bhadra, K. Kandasamy, R. Raju, Y.L. Ramachandra, C. Bhattacharyya, K. Imai, O. Ohara, S. Mohan, and A. Pandey Prediction of Candidate Primary Immunodeficiency Disease Genes Using a Support Vector Machine Learning Approach DNA Res, December 1, 2009; 16(6): 345 - 351. [Abstract] [Full Text] [PDF]
|
|