Abstract:Context: The utility of prediction models in empirical software engineering (ESE) is heavily reliant on the quality of the data used in building those models. Several data quality challenges such as noise, incompleteness, outliers and duplicate data points may be relevant in this regard. Objective: We investigate the reporting of three potentially influential elements of data quality in ESE studies: data collection, data pre-processing, and the identification of data quality issues. This enables us to establish how researchers view the topic of data quality and the mechanisms that are being used to address it. Greater awareness of data quality should inform both the sound conduct of ESE research and the robust practice of ESE data collection and processing. Method: We performed a targeted literature review of empirical software engineering studies covering the period January 2007 to September 2012. A total of 221 relevant studies met our inclusion criteria and were characterized in terms of their consideration and treatment of data quality. Results: We obtained useful insights as to how the ESE community considers these three elements of data quality. Only 23 of these 221 studies reported on all three elements of data quality considered in this paper. Conclusion: The reporting of data collection procedures is not documented consistently in ESE studies. It will be useful if data collection challenges are reported in order to improve our understanding of why there are problems with software engineering data sets and the models developed from them. More generally, data quality should be given far greater attention by the community. The improvement of data sets through enhanced data collection, pre-processing and quality assessment should lead to more reliable prediction models, thus improving the practice of software engineering.

Empirical Study on Selection of Team Members for Software Projects - Data Mining Approach

Prediction of Human Performance Capability during Software Development using Classification

Data Mining for Prediction of Human Performance Capability in the Software-Industry

Enhancing Human Aspect of Software Engineering using Bayesian Classifier

Creation and Evaluation of Software Teams - A Social Approach

Data Mining for Software Engineering

Mining Software Engineering Data

Survey Research in Software Engineering: Problems and Strategies

A survey study of success factors in data science projects

Characterizing the Experience of Subjects in Software Engineering Studies

Data Quality in Empirical Software Engineering: A Targeted Review

A Parametric Analysis of Project Management Performance to Enhance Software Development Process

Impact Analysis of Allocation of Resources by Project Manager on Success of Software Projects

An Empirical Study on the Procedure to Derive Software Quality Estimation Models

Significance of Quality Metrics in Software Development Process

Towards a Methodology for Participant Selection in Software Engineering Experiments. A Vision of the Future

An Analytical Approach for Project Managers in Effective Defect Management in Software Process

An Empirical Study of the Impact of Project Factors on Software Economics

Analytical Network Process for Software Selection in Product Development: A Case Study

An Integrated Approach for Identifying Relevant Factors Influencing Software Development Productivity

Female Leadership in Software Projects: A Preliminary Result on Leadership Style and Project Context Factors