A stochastic optimization approach for parameter tuning of support vector machines
Imbault, F.
Lebart, K.
ECE - Sch. of EPS, Heriot-Watt Univ., Edinburgh, UK;
This paper appears in: Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on
Publication Date: 23-26 Aug. 2004
Volume: 4,
On page(s): 597- 600 Vol.4
ISSN: 1051-4651
ISBN: 0-7695-2128-2
INSPEC Accession Number: 8244183
DOI: 10.1109/ICPR.2004.1333843
Posted online: 2004-09-20 10:59:53.0
Abstract
Support vector machines (SVMs) are both mathematically well-funded and efficient in a large number of real-world applications. However, the classification results highly depend on the parameters of the model: the scale of the kernel and the regularization parameter. Estimating these parameters is referred to as tuning. Tuning requires to estimate the generalization error and to find its minimum over the parameter space. Classical methods use a local minimization approach. After empirically showing that the tuning of parameters presents local minima, we investigate in this paper the use of global minimization techniques, namely genetic algorithms and simulated annealing. This latter approach is compared to the standard tuning frameworks and provides a more reliable tuning method.
Index Terms
Available to subscribers and IEEE members.
References
Available to subscribers and IEEE members.
Citing Documents
Available to subscribers and IEEE members.
