An investigation of the imputation techniques for missing values in ordinal data enhancing clustering and classification analysis validity

Shafiq Alam, Muhammad Sohaib Ayub, Sakshi Arora, Muhammad Asad Khan

Research output: Contribution to a Journal (Peer & Non Peer)Articlepeer-review

23 Citations (Scopus)

Abstract

Missing data can significantly impact dataset integrity and suitability, leading to unreliable statistical results, distortions, and poor decisions. The presence of missing values in data introduces inaccuracies in clustering and classification and compromises the reliability and validity of such analyses. This study investigates multiple imputation techniques specifically designed for handling missing values in ordinal data commonly encountered in surveys and questionnaires. Quantitative approaches are used to evaluate different imputation methods on various datasets with varying missing value percentages. By comparing the performance of imputation techniques using clustering metrics and algorithms (e.g., k-means, Partitioning Around Medoids), the study provides valuable insights for selecting appropriate imputation methods for accurate data analysis. Furthermore, the study examines the impact of imputed values on classification algorithms, including k-Nearest Neighbors (kNN), Naive Bayes (NB), and Multilayer Perceptron (MLP). Results demonstrate that the decision tree method is the most effective approach, closely aligning with the original data and achieving high accuracy. In contrast, random number imputation performs poorly, indicating limited reliability. This study advances the understanding of handling missing values and emphasizes the need to address this issue to enhance data analysis integrity and validity.

Original languageEnglish
Article number100341
JournalDecision Analytics Journal
Volume9
DOIs
Publication statusPublished - Dec 2023
Externally publishedYes

Keywords

  • Classification
  • Clustering
  • Imputation
  • Multilayer Perceptron
  • Ordinal data
  • Partitioning Around Medoids

Fingerprint

Dive into the research topics of 'An investigation of the imputation techniques for missing values in ordinal data enhancing clustering and classification analysis validity'. Together they form a unique fingerprint.

Cite this