A dynamic linear model for heteroscedastic LDA under class imbalance

Sarfo Gyamfi, James Brusey, Andrew Hunt, Elena Gaura

Research output: Contribution to journalArticlepeer-review

12 Citations (Scopus)
100 Downloads (Pure)

Abstract

Linear Discriminant Analysis (LDA) yields the optimal Bayes classifier for binary classification for normally distributed classes with equal covariance. To improve the performance of LDA, heteroscedastic LDA (HLDA) that removes the equal covariance assumption has been developed. In this paper, we show using first and second-order optimality conditions that the existing approaches either have no principled computational procedure for optimal parameter selection, or underperform in terms of the accuracy of classification and the area under the receiver operating characteristics curve (AUC) under class imbalance. Using the same optimality conditions, we then derive a dynamic Bayes optimal linear classifier for heteroscedastic LDA that is optimised via an efficient iterative procedure, which is robust against class imbalance. Experimental work is conducted on two artificial and eight real-world datasets. Our results show that the proposed algorithm compares favourably with the existing heteroscedastic LDA procedures as well as the linear support vector machine (SVM) in terms of the error rate, but is superior to all the algorithms in terms of the AUC under class imbalance. The fast training time of the proposed algorithm also encourages its use for large-data applications that show high incidence of class imbalance, such as in human activity recognition.

Original languageEnglish
Pages (from-to)65-75
Number of pages11
JournalNeurocomputing
Volume343
Early online date4 Feb 2019
DOIs
Publication statusPublished - 28 May 2019

Keywords

  • AUC
  • Class imbalance
  • Heteroscedasticity
  • LDA

ASJC Scopus subject areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'A dynamic linear model for heteroscedastic LDA under class imbalance'. Together they form a unique fingerprint.

Cite this