Abstract:Background The Paediatric early warning system Utilisation and Morbidity Avoidance (PUMA) study was commissioned to develop, implement and evaluate a paediatric track-and-trigger tool for widespread adoption. Following findings from three systematic reviews, revised aims focused on implementation of a whole-systems improvement programme. Objectives (1) Identify, through systematic review, the following: evidence for core components of effective paediatric track-and-trigger tools and paediatric early warning systems, and contextual factors consequential for paediatric track-and-trigger tool and early warning system effectiveness. (2) Develop and implement an evidence-based paediatric early warning system improvement programme (i.e. the PUMA programme). (3) Evaluate the effectiveness of the PUMA programme by examining clinical practice and core outcomes trends. (4) Identify ingredients of successful implementation of the PUMA programme. Review methods The quantitative reviews addressed the following two questions: how well validated are existing paediatric track-and-trigger tools and their component parts for predicting inpatient deterioration? How effective are paediatric early warning systems (with or without a tool) at reducing mortality and critical events? The qualitative review addressed the following question: what sociomaterial and contextual factors are associated with successful or unsuccessful paediatric early warning systems (with or without tools)? Design Interrupted time series and ethnographic case studies were used to evaluate the PUMA programme. Qualitative methods were deployed in a process evaluation. Setting The study was set in two district general and two tertiary children’s hospitals. Intervention The PUMA programme is a paediatric early warning system improvement programme designed to harness local expertise to implement contextually appropriate interventions. Main outcome measures The primary outcome was a composite metric, representing children who experienced one of the following in 1 month: mortality, cardiac arrest, respiratory arrest, unplanned admission to a paediatric intensive care unit or unplanned admission to a high-dependency unit. Paediatric early warning system changes were assessed through ethnographic ward case studies. Results The reviews showed limited effectiveness of paediatric track-and-trigger tools in isolation, and multiple failure points in paediatric early warning systems. All sites made paediatric early warning system changes; some of the clearer quantitative findings appeared to relate to qualitative observations. Systems changed in response to wider contextual factors. Limitations Low event rates made quantitative outcome measures challenging. Implementation was not a one-shot event, creating challenges for the interrupted time series in conceptualising ‘implementation’ and ‘post-intervention’ periods. Conclusions Detecting and acting on deterioration in the acute hospital setting requires a whole-systems approach. The PUMA programme offers a framework to support ongoing system-improvement work; the approach could be used more widely. Organisational-level system change can affect clinical outcomes positively. Alternative outcome measures are required for research and quality improvement. Future work The following further research is recommended: a consensus study to identify upstream indicators of paediatric early warning system performance; an evaluation of OUTCOME approach in other clinical areas; an evaluation of supernumerary nurse co-ordinator role; and an evaluation of mandated system improvement. Study registration This study is registered as PROSPERO CRD42015015326. Funding This project was funded by the National Institute for Health Research (NIHR) Health and Social Care Delivery Research programme and will be published in full in Health and Social Care Delivery Research ; Vol. 10, No. 1. See the NIHR Journals Library website for further project information.

A mixed-methods investigation of health professionals’ perceptions of a physiological track and trigger system

Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence

A theoretical framework for identifying sociocultural factors that influence nurses' compliance with early warning systems for acute clinical deterioration: A cross-sectional survey

Type of Track and Trigger system and incidence of in-hospital cardiac arrest: an observational registry-based study

Patient experience and barriers of using a mHealth exercise app in musculoskeletal (MSK) Physiotherapy

Using psychological theory to inform methods to optimize the implementation of a hand hygiene intervention

Facilitation Or Hindrance: Physicians' Perception On Best Practice Alerts (Bpa) Usage In An Electronic Health Record System

A mixed-methods survey to explore views of staff and patients from mental health wards prior to introduction of a digital early warning system for physical deterioration

Developing a primary care patient measure of safety (PC PMOS): a modified Delphi process and face validity testing

Development of the perceptions of preventable adverse events assessment tool (PPAEAT): measurement properties and patients' mental health status

The Impact of an Electronic Patient Bedside Observation and Handover System on Clinical Practice: Mixed-Methods Evaluation

'The Score Matters': wide variations in predictive performance of 18 paediatric track and trigger systems

Translating staff experience into organisational improvement: the HEADS-UP stepped wedge, cluster controlled, non-randomised trial

Development, implementation and evaluation of an early warning system improvement programme for children in hospital: the PUMA mixed-methods study

A tool to evaluate proportionality and necessity in the use of restrictive practices in forensic mental health settings: the DRILL tool (Dundrum restriction, intrusion and liberty ladders)

Passive resistance to health information technology implementation: the case of electronic medication management system

Investigating the use of an electronic hand hygiene monitoring and prompt device: influence and acceptability

Physiotherapy students' and officers' knowledge, attitudes, and perceptions of mental health

Multidisciplinary user experience of a newly implemented electronic patient record in Ireland: An exploratory qualitative study

What stops hospital clinical staff from following protocols? An analysis of the incidence and factors behind the failure of bedside clinical staff to activate the rapid response system in a multi-campus Australian metropolitan healthcare service

Healthcare Professionals' Application and Integration of Physical Activity in Routine Practice with Older Adults: A Qualitative Study