An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics

Victoria López, Alberto Fernández, Salvador García, Vasile Palade, Francisco Herrera

Research output: Contribution to journalArticle

625 Citations (Scopus)

Abstract

Training classifiers with datasets which suffer of imbalanced class distributions is an important problem in data mining. This issue occurs when the number of examples representing the class of interest is much lower than the ones of the other classes. Its presence in many real-world applications has brought along a growth of attention from researchers. We shortly review the many issues in machine learning and applications of this problem, by introducing the characteristics of the imbalanced dataset scenario in classification, presenting the specific metrics for evaluating performance in class imbalanced learning and enumerating the proposed solutions. In particular, we will describe preprocessing, cost-sensitive learning and ensemble techniques, carrying out an experimental study to contrast these approaches in an intra and inter-family comparison. We will carry out a thorough discussion on the main issues related to using data intrinsic characteristics in this classification problem. This will help to improve the current models with respect to: the presence of small disjuncts, the lack of density in the training data, the overlapping between classes, the identification of noisy data, the significance of the borderline instances, and the dataset shift between the training and the test distributions. Finally, we introduce several approaches and recommendations to address these problems in conjunction with imbalanced data, and we will show some experimental examples on the behavior of the learning algorithms on data with such intrinsic characteristics.

Original languageEnglish
Pages (from-to)113-141
Number of pages29
JournalInformation Sciences
Volume250
DOIs
Publication statusPublished - 20 Nov 2013
Externally publishedYes

Keywords

  • Cost-sensitive learning
  • Dataset shift
  • Imbalanced dataset
  • Noisy data
  • Sampling
  • Small disjuncts

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Theoretical Computer Science
  • Software
  • Computer Science Applications
  • Information Systems and Management
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics'. Together they form a unique fingerprint.

  • Cite this