Aplikasi Metode Cross Entropy untuk Support Vector Machines

Abstract

Support vector machines (SVM) is a robust method for  classification problem. In the original formulation, the dual form of SVM must be solved by a quadratic programming in order to get the optimal solution. The shortcoming of the standard version is as the classification problem is getting larger, the high computing time is needed. Cross entropy (CE) is a newly discovered optimization method with two main procedures: generating data samples by a chosen distribution, and updating the distribution parameters due to elite samples to generate a better sample in the next iteration. The CE method has been applied in many optimization problems with satisfying result. In this research, CE is applied to solve the optimization problem of Lagrangian SVM for faster  computational time. This method is tested in some real world datasets for classification problem. The results show that the application of CE in SVM is comparable to standard SVM in classifying two class data in terms of accuracy. In addition, this method can solve large datasets classification problem faster than standard SVM.