Abstract:Background: Improving shared decision-making (SDM) for patients has become a health policy priority in many countries. Achieving high-quality SDM is particularly important for approximately 313 million surgical treatment decisions patients make globally every year. Large-scale monitoring of surgical patients' experience of SDM in real time is needed to identify the failings of SDM before surgery is performed. We developed a novel approach to automating real-time data collection using an electronic measurement system to address this. Examining usability will facilitate its optimization and wider implementation to inform interventions aimed at improving SDM. Objective: This study examined the usability of an electronic real-time measurement system to monitor surgical patients' experience of SDM. We aimed to evaluate the metrics and indicators relevant to system effectiveness, system efficiency, and user satisfaction. Methods: We performed a mixed methods usability evaluation using multiple participant cohorts. The measurement system was implemented in a large UK hospital to measure patients' experience of SDM electronically before surgery using 2 validated measures (CollaboRATE and SDM-Q-9). Quantitative data (collected between April 1 and December 31, 2021) provided measurement system metrics to assess system effectiveness and efficiency. We included adult patients booked for urgent and elective surgery across 7 specialties and excluded patients without the capacity to consent for medical procedures, those without access to an internet-enabled device, and those undergoing emergency or endoscopic procedures. Additional groups of service users (group 1: public members who had not engaged with the system; group 2: a subset of patients who completed the measurement system) completed user-testing sessions and semistructured interviews to assess system effectiveness and user satisfaction. We conducted quantitative data analysis using descriptive statistics and calculated the task completion rate and survey response rate (system effectiveness) as well as the task completion time, task efficiency, and relative efficiency (system efficiency). Qualitative thematic analysis identified indicators of and barriers to good usability (user satisfaction). Results: A total of 2254 completed surveys were returned to the measurement system. A total of 25 service users (group 1: n=9; group 2: n=16) participated in user-testing sessions and interviews. The task completion rate was high (169/171, 98.8%) and the survey response rate was good (2254/5794, 38.9%). The median task completion time was 3 (IQR 2-13) minutes, suggesting good system efficiency and effectiveness. The qualitative findings emphasized good user satisfaction. The identified themes suggested that the measurement system is acceptable, easy to use, and easy to access. Service users identified potential barriers and solutions to acceptability and ease of access. Conclusions: A mixed methods evaluation of an electronic measurement system for automated, real-time monitoring of patients' experience of SDM showed that usability among patients was high. Future pilot work will optimize the system for wider implementation to ultimately inform intervention development to improve SDM. International registered report identifier (irrid): RR2-10.1136/bmjopen-2023-079155.

Real-time monitoring and feedback to improve shared decision-making for surgery (the ALPACA Study): protocol for a mixed-methods study to inform co-development of an inclusive intervention

Usability of an Automated System for Real-Time Monitoring of Shared Decision-Making for Surgery: Mixed Methods Evaluation

Evaluation of a shared decision-making strategy with online decision aids in surgical and orthopaedic practice: study protocol for the E-valuAID, a multicentre study with a stepped-wedge design

Evaluating the Impact of a Shared Decision-making Intervention for Patients with Renal Cell Carcinoma: The SDM-RCC Study Protocol

Digital wound monitoring with artificial intelligence to prioritise surgical wounds in cardiac surgery patients for priority or standard review: protocol for a randomised feasibility trial (WISDOM)

Evaluating the feasibility of a decision aid to promote shared decision making among young adults with first-episode psychosis: protocol for a pilot study

Prospectively investigating the impact of AI onshared decision-making in post kidney transplant care (PRIMA-AI): protocol for a longitudinal qualitative study among patients, their support persons and treating physicians at a tertiary care centre

A shared decision-making intervention for individuals living with chronic obstructive pulmonary disease who are considering the menu of pulmonary rehabilitation treatment options; a feasibility study

Which instruments are used to measure shared, supported and assisted healthcare decision-making between patients who have limited, impaired or fluctuating capacity, their family carers and healthcare professionals? A systematic review protocol

Study protocol for the Anesthesiology Control Tower-Feedback Alerts to Supplement Treatments (ACTFAST-3) trial: a pilot randomized controlled trial in intraoperative telemedicine

Beyond pros and cons - developing a patient decision aid to cultivate dialog to build relationships: insights from a qualitative study and decision aid development

Improving quality and patient safety in surgical care through standardisation and harmonisation of perioperative care (SAFEST project): A research protocol for a mixed methods study

Shared Learning Utilizing Digital Methods in Surgery to Enhance Transparency in Surgical Innovation: Protocol for a Scoping Review

The TELEhealth Shared decision-making COaching and navigation in Primary carE (TELESCOPE) intervention: a study protocol for delivering shared decision-making for lung cancer screening by patient navigators

Factors Influencing the Participation of Shared Decision Making in Stable Coronary Artery Disease Patient: Protocol of a Mixed Methods Study

Evaluation of remote digital postoperative wound monitoring in routine surgical practice

Perioperative mental health intervention for depression and anxiety symptoms in older adults study protocol: design and methods for three linked randomised controlled trials

Artificial-Intelligence Cloud-Based Platform to Support Shared Decision-Making in the Locoregional Treatment of Breast Cancer: Protocol for a Multidimensional Evaluation Embedded in the CINDERELLA Clinical Trial

Remote Patient Monitoring and Teleconsultation to Improve Health Outcomes and Reduce Health Care Utilization of Pediatric Asthma (ALPACA Study): Protocol for a Randomized Controlled Effectiveness Trial

A Scalable Service to Improve Health Care Quality Through Precision Audit and Feedback: Proposal for a Randomized Controlled Trial

Implementing Shared Decision-Making for Lung Cancer Screening across a Veterans Health Administration Hospital Network: A Hybrid Effectiveness-Implementation Study Protocol