Abstract:AI is becoming more prevalent in healthcare and is predicted to be further integrated into workflows to ease the pressure on an already stretched service. The National Health Service in the UK has prioritised AI and Digital health as part of its Long-Term Plan. Few studies have examined the human interaction with such systems in healthcare, despite reports of biases being present with the use of AI in other technologically advanced fields, such as finance and aviation. Understanding is needed of how certain user characteristics may impact how radiographers engage with AI systems in use in the clinical setting to mitigate against problems before they arise. The aim of this study is to determine correlations of skills, confidence in AI and perceived knowledge amongst student and qualified radiographers in the UK healthcare system. A machine learning based AI model was built to predict if the interpreter was either a student (n = 67) or a qualified radiographer (n = 39) in advance, using important variables from a feature selection technique named Boruta. A survey, which required the participant to interpret a series of plain radiographic examinations with and without AI assistance, was created on the Qualtrics survey platform and promoted via social media (Twitter/LinkedIn), therefore adopting convenience, snowball sampling This survey was open to all UK radiographers, including students and retired radiographers. Pearson's correlation analysis revealed that males who were proficient in their profession were more likely than females to trust AI. Trust in AI was negatively correlated with age and with level of experience. A machine learning model was built, the best model predicted the image interpreter to be qualified radiographers with 0.93 area under curve and a prediction accuracy of 93%. Further testing in prospective validation cohorts using a larger sample size is required to determine the clinical utility of the proposed machine learning model. Artificial Intelligence (AI) is becoming increasingly integrated into healthcare systems. Radiology, as a technologically advanced profession, is one area where AI has proved useful for myriad tasks. Developments in computer vision have allowed for applications in computer aided diagnosis using radiographic images. The integration and development of AI has been supported by healthcare providers and government agencies, such as the NHS in the UK. With the introduction of these systems in the clinical setting it is imperative to understand the nuances of the interaction between the clinicians using the technology and the system. Trust has been cited as a potentially significant issue in the effective integration of AI in radiology. Our research pinpoints the factors which have an impact on trust in radiographers and clarifies the strength of these associations. The means of analysis (Boruta) used provides an assessment of any correlations, allowing for intervention to be made. We found that females were less likely to trust AI that males and that trust in AI was negatively correlated with age and level of experience, indicating areas were further investigation and intervention are needed to ensure balanced trust and effective integration of AI in clinical radiography.

Investigation of Demographic Implicit Discrimination and Disparate Impact in Chest Radiography Image-Based AI for COVID-19 Severity Prediction.

The Limits of Fair Medical Imaging AI In The Wild

Algorithmic encoding of protected characteristics in image-based models for disease detection

Acquisition parameters influence AI recognition of race in chest x-rays and mitigating these factors reduces underdiagnosis bias

Drop the shortcuts: image augmentation improves fairness and decreases AI detection of race and other demographics from medical images

Risk of Bias in Chest Radiography Deep Learning Foundation Models

A Prospective Observational Study to Investigate Performance of a Chest X-ray Artificial Intelligence Diagnostic Support Tool Across 12 U.S. Hospitals

Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations

Deep Learning Discovery of Demographic Biomarkers in Echocardiography

Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging

Fairness in Cardiac Magnetic Resonance Imaging: Assessing Sex and Racial Bias in Deep Learning-Based Segmentation

Sociodemographic biases in a commercial AI model for intracranial hemorrhage detection

An investigation into the impact of deep learning model choice on sex and race bias in cardiac MR segmentation

An experimental machine learning study investigating the decision-making process of students and qualified radiographers when interpreting radiographic images

Discovering mechanisms underlying medical AI prediction of protected attributes

Demographic Reporting in Publicly Available Chest Radiograph Data Sets: Opportunities for Mitigating Sex and Racial Disparities in Deep Learning Models

An Investigation into Race Bias in Random Forest Models Based on Breast DCE-MRI Derived Radiomics Features

Improving Fairness of Automated Chest Radiograph Diagnosis by Contrastive Learning

An automated COVID-19 triage pipeline using artificial intelligence based on chest radiographs and clinical data

Risk of Training Diagnostic Algorithms on Data with Demographic Bias

An investigation into the causes of race bias in AI-based cine CMR segmentation