Abstract:This paper investigates the use of k‐nearest neighbors imputation (KNNI) to deal with missing data in software development effort estimation (SDEE). KNNI, in its classical process, has low tolerance to imprecision and uncertainty especially when dealing with categorical features. We evaluate the use of an optimized fuzzy clustering‐based KNNI (FC‐KNNI) and compare it with classical KNN when dealing with mixed data in the context of SDEE. The results are promising in the sense that using an imputation technique designed for mixed data is better than reusing methods originally designed for numerical data. KNNI, in its classical process, has low tolerance to imprecision and uncertainty especially when dealing with categorical features. Context Software development effort estimation (SDEE) is one of the most challenging aspects in project management. The presence of missing data (MD) in software attributes makes SDEE even more complex. K‐nearest neighbors imputation (KNNI) has been widely used in SDEE to deal with the MD issue. However, KNNI, in its classical process, has low tolerance to imprecision and uncertainty especially when dealing with categorical features. When dealing with categorical attributes, KNNI uses a classical approach, employing mainly numbers or classical intervals to represent software attributes and similarity measures originally designed for numerical attributes. Objectives This paper evaluates the use of an optimized fuzzy clustering‐based KNNI (FC‐KNNI) and compares it with classical KNN when dealing with mixed data in the context of SDEE. Methods We investigate the effect of two imputation techniques (FC‐KNNI and KNNI) on five SDEE techniques: case‐based reasoning, fuzzy case‐based reasoning, support vector regression, multilayer perceptron, and reduced‐error pruning tree. The evaluation is carried out using six publicly available datasets for SDEE using two performance measures, standardized accuracy (SA), and Pred (0.25). The Wilcoxon statistical test is also performed to assess the significance of results. Results The results are promising in the sense that using an imputation technique designed for mixed data is better than reusing methods originally designed for numerical data. We found that FC‐KNNI significantly outperforms KNNI regardless of the SDEE technique and dataset used. Another important finding is that F‐CBR improved the analogy process compared to CBR. Conclusion The introduction of fuzzy sets and fuzzy clustering in the analogy process improves its performances in terms of SA and Pred (0.25).

An Empirical Study of Dynamic Incomplete-Case Nearest Neighbor Imputation in Software Quality Data.

Cross-validation based K nearest neighbor imputation for software quality datasets: An empirical study.

PCA-Based Missing Information Imputation for Real-Time Crash Likelihood Prediction under Imbalanced Data.

Relational Data Imputation with Quality Guarantee.

Application of missing data approaches in software testing research

Local Similarity Imputation Based on Fast Clustering for Incomplete Data in Cyber-Physical Systems

Software reliability prediction of incomplete data

Semi-parametric Optimization for Missing Data Imputation

A Benchmark for Data Imputation Methods

Comparison of Missing Data Imputation Methods in Time Series Forecasting

An Experimental Survey of Missing Data Imputation Algorithms

Application of A Statistical Methodology to Simplify Software Quality Metric Models Constructed Using Incomplete Data Samples

Handling missing values in software effort data based on na(i)ve Bayes and EM algorithm

Experimental Analysis Of Methods For Imputation Of Missing Values In Databases

Numerical Data Imputation for Multimodal Data Sets: A Probabilistic Nearest-Neighbor Kernel Density Approach

Missing data imputation by K nearest neighbours based on grey relational structure and mutual information

Estimation of missing values using a weighted k-nearest neighbors algorithm

Missing Data Imputation for Machine Learning.

Missing values imputation hypothesis: An experimental evaluation

On a Missing Data Imputation Algorithm Based on the Nested Sliding Window

Optimized fuzzy clustering‐based k‐nearest neighbors imputation for mixed missing data in software development effort estimation