A novel algorithm for classification using a low rank approximation of kernel-based support vector machines with applications

O. Chatrabgoun, M. Esmaeilbeigi, A. Daneshkhah, A. Kamandi, N. Salimi

    Research output: Contribution to journalArticlepeer-review

    92 Downloads (Pure)

    Abstract

    Support vector machines (SVMs), as a powerful technique for classification, are becoming increasingly popular in a wide range of applications. This is simply due to their robustness against several types of model assumptions violations and outliers. The Kernel-based SVM are very useful to capture non-linear patterns in the data, and for classification. However, this kernel-based method could become computationally very challenging because it increases the required time to train data. This increase in computational time is mainly due to the appearance of the kernel in solving the quadratic optimization problem (QOP). In order to tackle this computational complexity, we propose a novel method based on the low-rank approximation, by adapting a truncated Mercer series to the kernels. The quadratic optimization problem in the structure of kernel-based SVM will then be replaced with a much simpler optimization problem. In the proposed approach, the required time for the vector computations and matrix decompositions will be much faster such that these changes lead to efficiently resolve the QOP and ultimately increase efficiency in classification. We finally present some numerical illustrations based on the ROC curves and other classification performance benchmarks considered in this paper to assess the performance of the proposed low-rank approximation to the kernel in SVM structure. The results suggest considerable efficiency improvement has been observed in classification with significant reduction in computational time required to train and forecast the stock market index (S&P 500 index) and promoter recognition in DNA sequences.
    Original languageEnglish
    Pages (from-to)(In-Press)
    Number of pages21
    JournalCommunications in Statistics - Simulation and Computation
    Volume(In-Press)
    Early online date28 Jul 2023
    DOIs
    Publication statusE-pub ahead of print - 28 Jul 2023

    Bibliographical note

    This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The terms on which this article has been published allow the posting of the Accepted Manuscript in a repository by the author(s) or with their consent.

    Keywords

    • Kernel-based SVMs
    • Machine learning
    • Promoter recognition
    • Quadratic optimization problem;
    • S&P 500 index
    • Truncated Mercer series

    Fingerprint

    Dive into the research topics of 'A novel algorithm for classification using a low rank approximation of kernel-based support vector machines with applications'. Together they form a unique fingerprint.

    Cite this