Online patient feedback as a safety valve: An automated language analysis of unnoticed and unresolved safety incidents

Alex Gillespie,Tom W. Reader
DOI: https://doi.org/10.1111/risa.14002
2022-08-15
Risk Analysis
Abstract:Safety reporting systems are widely used in healthcare to identify risks to patient safety. But, their effectiveness is undermined if staff do not notice or report incidents. Patients, however, might observe and report these overlooked incidents because they experience the consequences, are highly motivated, and independent of the organization. Online patient feedback may be especially valuable because it is a channel of reporting that allows patients to report without fear of consequence (e.g., anonymously). Harnessing this potential is challenging because online feedback is unstructured and lacks demonstrable validity and added value. Accordingly, we developed an automated language analysis method for measuring the likelihood of patient‐reported safety incidents in online patient feedback. Feedback from patients and families (n = 146,685, words = 22,191,427, years = 2013–2019) about acute NHS trusts (hospital conglomerates; n = 134) in England were analyzed. The automated measure had good precision (0.69) and excellent recall (0.98) in identifying incidents; was independent of staff‐reported incidents (r = −0.04 to 0.19); and was associated with hospital‐level mortality rates (z = 3.87; p
public, environmental & occupational health,mathematics, interdisciplinary applications,social sciences, mathematical methods
What problem does this paper attempt to address?