Abstract:Introduction: The British Thyroid Association Ultrasound-classification is a risk stratification model which grades thyroid nodules in U2–5 based on their sonographic appearance. Existence of variability between the ultrasound operators when U-scoring is reported in the literature with some evidence found in the author’s department. The aim of this study was to investigate whether there is significant disagreement in the department and identify potential reasons for variability. Methods: Eight operators, radiologists and sonographers, were recruited to grade 33 TNs and answer a tick box questionnaire using the British Thyroid Association lexicon. The inter-operator variability for the U-categories, indication for fine-needle aspiration biopsy and ultrasound features was assessed using Fleiss’ kappa and Gwet-AC1. The operators’ accuracy was measured against the most experienced operator in the department using Cohen’s kappa and percentage agreement. Results: Fair agreement (Fleiss’ K = 0.21) was obtained between the participants when U-scoring (U2–5). Fair-to-moderate agreement was noted between sonographers ( K = 0.40). Significant variability was demonstrated between radiologists ( p > 0.05). Indication for fine-needle aspiration biopsy reached fair to almost substantial agreement (radiologists’ AC1 = 0.34, sonographers’ AC1 = 0.58, overall AC1 = 0.41). No significant variability measured for echogenicity ( K = 0.29), composition ( K = 0.33), shape ( K = 0.58), margin ( K = 0.45), halo ( K = 0.34) and vascularity ( K = 0.44). Accuracy reached fair agreement (mean Cohen’s K = 0.29) and moderate agreement (mean AC1 = 0.53) for the U-categories and fine-needle aspiration biopsy, respectively. Radiologists demonstrated lower accuracy. Conclusion: No significant inter-rater variability in U-scoring or recommending fine-needle aspiration biopsy was demonstrated between all the operators in the department. Radiologists showed significant variability in U-scoring and lower accuracy. Reliability and accuracy could be improved by addressing those problematic categories and features identified with this study.

Interobserver variability in thyroid ultrasound

[Exploration on an Ultrasonographic Imaging Reporting and Data System in Malignancy Grading of Thyroid Nodules].

Variability in the interpretation of grey-scale ultrasound features in assessing thyroid nodules: A systematic review and meta-analysis

The Role of CEUS in the Evaluation of Thyroid Cancer: from Diagnosis to Local Staging

Diagnostic Performance of Ultrasound Strain Elastography in Transverse and Longitudinal Views in Predicting Malignant Thyroid Nodules

Interobserver variability in thyroid imaging reporting and data system description of sonographic features of thyroid nodules

Ultrasonic Scores of Conventional Ultrasound and Ultrasound Elastography in the Diagnosis of Thyroid Nodular Lesions

Evaluation of the departmental inter-rater reliability when scoring thyroid nodules according to the British Thyroid Association Ultrasound-classification model: Is there significant disagreement?

Thyroid Nodule Detection and Region Estimation in Ultrasound Images: A Comparison between Physicians and an Automated Decision Support System Approach

Thyroid Imaging Reporting and Data System(TI-RADS):Interobserver Variability and Positive Predictive Value for Assessment of Thyroid Nodules

Reproducibility of Ablated Volume Measurement Is Higher with Contrast-Enhanced Ultrasound than with B-Mode Ultrasound after Benign Thyroid Nodule Radiofrequency Ablation—A Preliminary Study

Variation in the Quality of Thyroid Nodule Evaluations Before Surgical Referral

Application of Fine Needle Aspiration, Ultrasonic Elastography, and Contrast-enhanced Ultrasound in Differentiating Solid Thyroid Nodules

Evaluation of inter-observers consistencyin differentiating diagnosis of thyroid nodules based on calculation of the strain ratio on thyroid sonoelastography

Integrated Diagnostics of Thyroid Nodules

Evaluating diagnostic accuracy and agreement of TI-RADS scoring in thyroid nodules: A comparative analysis between sonographers and radiologists

Use of 3D ultrasound to characterise temporal changes in thyroid nodules: an in vitro study

Interobserver Agreement in Ultrasound Risk Stratification Systems for Thyroid Nodules on Static Images Versus Cine-Loop Video Sequences

Echogenicity as a standalone nodule characteristic is not inferior to the TIRADS systems in the 10-20 mm nodule diameter range in patient selection for fine needle aspiration: a pilot study

Tracked 3D ultrasound and deep neural network-based thyroid segmentation reduce interobserver variability in thyroid volumetry.

Ultrasound imaging in thyroid nodule diagnosis, therapy, and follow‐up: Current status and future trends