Abstract:Accessible Summary What is known on the subject The Health of the Nation Outcome Scales (HoNOS) is a widely used clinical measure designed to rate and monitor the outcomes of service users accessing specialist mental healthcare. Since its development (in 1996), numerous research studies have confirmed the HoNOS captures the aspects of care that it purports to (validity), and that clinicians' ratings are consistent both over time, and between different raters (reliability). What the paper adds to existing knowledge In 2018, the HoNOS was reviewed with updates made to some terminology and other revisions intended to remove ambiguity in the guidance for raters. However, although the new version (HoNOS 2018) was accompanied by a recommendation that its validity and reliability be re‐tested this was not undertaken. To our knowledge, this is the first study to re‐assess the updated tool's reliability by measuring the level of agreement between different raters. Our findings confirm that there is an acceptable level of consistency between student mental health nurses that have been trained to use the (new) HoNOS 2018. What are the implications for practice The HoNOS is nationally mandated for use by all specialist mental healthcare providers in the UK. Our findings provide some assurance that, with appropriate update training and monitoring of organisational‐level data sets, the original HoNOS glossary can safely be replaced with the HoNOS 2018 to ensure more contemporary routine outcome measurement can occur. Introduction The Health of the Nation Outcome Scales (HoNOS) is a well‐established clinician rated outcome measure for use in mental health services. Following an international review, an updated version (HoNOS 2018) was published with a recommendation that its psychometric properties be re‐tested prior to widespread implementation. To date, only one such study has been published. Aims To test the inter‐rater agreement levels for HoNOS 2018. Method Third‐year student mental health nurses received training to complete the HoNOS 2018. Following this timetabled session, they were each invited to independently rate two, randomly selected, videos of (simulated) patient interviews. The resulting data were then analysed to calculate the tool's internal consistency and inter‐rater agreement levels. Results The 55 participants provided 106 ratings from four vignettes. Cronbach's alphas and McDonalds omegas confirmed the revised tool's internal consistency was acceptable. Average measure intraclass correlation coefficients for the four patient vignettes indicated excellent reliability. Implications for practice This study provides initial assurance that the HoNOS 2018 is a reliable clinician rated outcome measure suitable for use in routine clinical practice by relatively inexperienced mental health practitioners with limited training.

The value of HoNOS in assessing mental health symptom severity and social functioning in forensic outpatients

Measuring Outcomes in Mental Health Services for Older People: An evaluation of the Health of the Nation Outcome Scales for elderly people (HoNOS65+)

Reliability testing of the Health of the Nation Outcome Scales 2018

Psychometric properties of the Spanish version of the Health of Nation Outcome Scales for schizophrenia patients

Inventory of Problems–29 (IOP-29) and Inventory of Problems–Memory (IOP-M) failure rates in patients with severe psychosis with and without criminal convictions

The predictive validity and temporal characteristics of the HCR-20v3 for inpatient violence in forensic inpatient settings. An international study

A novel tool showing that perceptions of adverse social relationships in childhood were linked with mental health problems and suicidal experiences: Validation of the English version of the History of Social Punishment (HoSP) scale

A comparison of patient ratings and staff ratings of disability using the World Health Organisation Disability Assessment Schedule in individuals with psychotic spectrum disorders who are forensic psychiatric inpatients

Psychometric Analysis of the Hip Disability and Osteoarthritis Outcome Score (HOOS)

CANFOR Portuguese version: validation study

Clinical validity of the 12-item WHODAS-2.0 in a naturalistic sample of outpatients with psychotic disorders

Assessing change in dynamic risk factors in forensic psychiatric inpatients: relationship with psychopathy and recidivism

RELATIONSHIPS AMONG RISK, AND COMMUNICATION AND SOCIAL SKILLS IN A HIGH SECURITY FORENSIC SETTING

Violence risk assessment instruments in forensic psychiatric populations: a systematic review and meta-analysis

Identifying studies examining the validity of instruments for use as outcome measures in child and adolescent forensic mental health services: a systematic review

Gender Comparisons in a Forensic Sample: Patient Profiles and HCR-20:V2 Reliability and Item Utility

Staff supported community outings among forensic mental health patients: patient characteristics, rehabilitative goals, and (the absence of) adverse outcomes

Pitfalls in the Assessment, Analysis, and Interpretation of Routine Outcome Monitoring (ROM) Data: Results from an Outpatient Clinic for Integrative Mental Health

Psychometric properties and criterion related validity of the Norwegian version of hospital survey on patient safety culture 2.0

Validity and reliability of the Violence Risk Scale-Sexual Offense version in a community sexual offense outpatient setting

Older forensic mental healthcare patients in England: demographics, physical health, mental wellbeing, cognitive ability and quality of life