Similar articles

Abstract: Selecting the optimal parameters for support vector machine (SVM) has long been a hot research topic. Aiming for support vector classification/regression (SVC/SVR) with the radial basis function (RBF) kernel, we summarize the rough line rule of the penalty parameter and kernel width, and propose a novel linear search method to obtain these two optimal parameters. We use a direct-setting method with thresholds to set the epsilon parameter of SVR. The proposed method directly locates the right search field, which greatly saves computing time and achieves a stable, high accuracy. The method is more competitive for both SVC and SVR. It is easy to use and feasible for a new data set without any adjustments, since it requires no parameters to set.

[1]Ahn, J., 2010. A stable hyperparameter selection for the Gaussian RBF kernel for discrimination. Statist. Anal. Data Min., 3(3):142-148.

[2]Bengio, Y., 2000. Gradient-based optimization of hyperparameters. Neur. Comput., 12(8):1889-1900.

[3]Bi, J., Bennett, K.P., 2003. A geometric approach to support vector regression. Neurocomputing, 55(1-2):79-108.

[4]Chapelle, O., Vapnik, V., Bousquet, O., Mukherjee, S., 2002. Choosing multiple parameters for support vector machines. Mach. Learn., 46(1/3):131-159.

[5]Cherkassky, V., Ma, Y.Q., 2004. Practical selection of SVM parameters and noise estimation for SVM regression. Neur. Networks, 17(1):113-126.

[6]Cristianini, N., Kandola, J., Elisseeff, A., Shawe-Taylor, J., 2006. On kernel target alignment. Innov. Mach. Learn., 194:205-256.

[7]Deng, N.Y., Tian, Y.G., 2004. A New Method in Data Mining—Support Vector Machine. Science Press, Beijing, China (in Chinese).

[8]Duan, K., Keerthi, S.S., Poo, A.N., 2003. Evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing, 51:41-59.

[9]Gijsberts, A., Metta, G., Rothkrantz, L., 2010. Evolutionary optimization of least-squares support vector machines. Data Min., 8(4):277-297.

[10]Huang, C.L., Dun, J.F., 2008. A distributed PSO-SVM hybrid system with feature selection and parameter optimization. Appl. Soft Comput., 8(4):1381-1391.

[11]Huang, C.L., Wang, C.J., 2006. A GA-based feature selection and parameters optimization for support vector machines. Expert Syst. Appl., 31(2):231-240.

[12]Keerthi, S.S., Lin, C.J., 2003. Asymptotic behaviors of support vector machines with Gaussian kernel. Neur. Comput., 15(7):1667-1689.

[13]Kim, D., Song, J., Lee, J., Choi, B., 2007. Support vector machine learning for region-based image retrieval with relevance feedback. ETRI J., 29(5):700-702.

[14]Lau, K.W., Wu, Q.H., 2008. Local prediction of non-linear time series using support vector regression. Pattern Recogn., 41(5):1539-1547.

[15]Po, L.M., Ma, W.C., 2002. A novel four-step search algorithm for fast block motion estimation. IEEE Trans. Circ. Syst. Video Technol., 6(3):313-317.

[16]Roohi, M., Mirjalily, G., Sadeghi, M.T., 2007. Face Detection Using a Modified SVM-Based Classifier. 7th Int. Conf. on Computational Intelligence and Multimedia Applications, p.356-360.

[17]Sapankevych, N., Sankar, R., 2009. Time series prediction using support vector machines, a survey. IEEE Computat. Intell. Mag., 4(2):24-38.

[18]Scholkopf, B., Smola, A.J., 2002. Learning with Kernels. MIT Press, Cambridge.

[19]Suykens, J.A.K., Vandewalle, J., de Moor, B., 2001. Optimal control by least squares support vector machines. Neur. Networks, 14(1):23-35.

[20]Vapnik, V., Golowich, S.E., Smola, A., 1997. Support Vector Method for Function Approximation, Regression Estimation, and Signal Processing. Advances in Neural Information Processing Systems 9 – Proc. Conf. on Advances in Neural Information Processing Systems, p.281-287.

[21]Vladimir, N., Vapnik, V., 2000. The Nature of Statistical Learning Theory. Springer Verlag, New York.

[22]Wang, T.Y., Chiang, H.M., 2007. Fuzzy support vector machine for multi-class text categorization. Inform. Process. Manag., 43(4):914-929.

[23]Zhu, S., Ma, K.K., 1997. A New Diamond Search Algorithm for Fast Block Matching Motion Estimation. Proc. Int. Conf. on Information, Communications and Signal Processing, 1:292-296.