Abstract:Quality improvement (QI) projects often employ statistical process control (SPC) charts to monitor process or outcome measures as part of ongoing feedback, to inform successive Plan-Do-Study-Act cycles and refine the intervention (formative evaluation). SPC charts can also be used to draw inferences on effectiveness and generalisability of improvement efforts (summative evaluation), but only if appropriately designed and meeting specific methodological requirements for generalisability. Inadequate design decreases the validity of results, which not only reduces the chance of publication but could also result in patient harm and wasted resources if incorrect conclusions are drawn. This paper aims to bring together much of what has been written in various tutorials, to suggest a process for using SPC in QI projects. We highlight four critical decision points that are often missed, how these are inter-related and how they affect the inferences that can be drawn regarding effectiveness of the intervention: (1) the need for a stable baseline to enable drawing inferences on effectiveness; (2) choice of outcome measures to assess effectiveness, safety and intervention fidelity; (3) design features to improve the quality of QI projects; (4) choice of SPC analysis aligned with the type of outcome, and reporting on the potential influence of other interventions or secular trends. These decision points should be explicitly reported for readers to interpret and judge the results, and can be seen as supplementing the Standards for Quality Improvement Reporting Excellence guidelines. Thinking in advance about both formative and summative evaluation will inform more deliberate choices and strengthen the evidence produced by QI projects.

Goal-oriented Data Visualization with Software Project Control Centers

Visualization of Software and Systems as Support Mechanism for Integrated Software Project Control

Implementing Software Project Control Centers: An Architectural View

Goal-Oriented Setup and Usage of Custom-Tailored Software Cockpits

Process monitoring and fault detection based on multivariate statistical projection analysis

Using Cluster Curves to Control Software Development Projects

Targeting High Quality For Complex Internet Based Information Integration Through Xp Extensions

Tool Support for Continuous Quality Control

Software Process Management Based on Statistical Process Control

Integrated Process And Controller Design Software Tool - Procacd

ProCACD: A computer-aided versatile tool for process control

Linking Software Development and Business Strategy Through Measurement

Object-oriented process information system: GS-CAPP

Software Design for Quality-oriented Statistical Tolerance and SPC

Grand rounds in methodology: four critical decision points in statistical process control evaluations of quality improvement initiatives

An application system of intelligent SPC based on the web

A conceptual framework for SPI evaluation

From Pragmatic to Systematic Software Process Improvement: An Evaluated Approach

Towards Using Data to Inform Decisions in Agile Software Development: Views of Available Data

IntelliSPC: a hybrid intelligent tool for on-line economical statistical process control

Strategic Issues on Implementing a Software Process Improvement Program