Copyright © 2006 The Institute of Electronics, Information and Communication Engineers
Special Section on Nonlinear Theory and its Applications -- Papers -- Control, Neural Networks and Learning |
An Efficient Method for Simplifying Decision Functions of Support Vector Machines
1 The authors are with the Department of Computer Science and Communication Engineering, Kyushu Univ., Fukuoka-shi, 812-8581 Japan. E-Mail: guojun{at}kairo.csce.kyushu-u.ac.jp, 2 The author is with the Faculty of Science and Engineering, Waseda Univ., Tokyo, 162-0072 Japan.
A novel method to simplify decision functions of support vector machines (SVMs) is proposed in this paper. In our method, a decision function is determined first in a usual way by using all training samples. Next those support vectors which contribute less to the decision function are excluded from the training samples. Finally a new decision function is obtained by using the remaining samples. Experimental results show that the proposed method can effectively simplify decision functions of SVMs without reducing the generalization capability.
Key Words: support vector machines, decision function, complexity, span
Manuscript received January 16, 2006. Manuscript revised May 17, 2006. Final manuscript received June 8, 2006.