Abstract:Background While artificial intelligence (AI) offers possibilities of advanced clinical prediction and decision-making in healthcare, models trained on relatively homogeneous datasets, and populations poorly-representative of underlying diversity, limits generalisability and risks biased AI-based decisions. Here, we describe the landscape of AI in clinical medicine to delineate population and data-source disparities. Methods We performed a scoping review of clinical papers published in PubMed in 2019 using AI techniques. We assessed differences in dataset country source, clinical specialty, and author nationality, sex, and expertise. A manually tagged subsample of PubMed articles was used to train a model, leveraging transfer-learning techniques (building upon an existing BioBERT model) to predict eligibility for inclusion (original, human, clinical AI literature). Of all eligible articles, database country source and clinical specialty were manually labelled. A BioBERT-based model predicted first/last author expertise. Author nationality was determined using corresponding affiliated institution information using Entrez Direct. And first/last author sex was evaluated using the Gendarize.io API. Results Our search yielded 30,576 articles, of which 7,314 (23.9%) were eligible for further analysis. Most databases came from the US (40.8%) and China (13.7%). Radiology was the most represented clinical specialty (40.4%), followed by pathology (9.1%). Authors were primarily from either China (24.0%) or the US (18.4%). First and last authors were predominately data experts (i.e., statisticians) (59.6% and 53.9% respectively) rather than clinicians. And the majority of first/last authors were male (74.1%). Interpretation U.S. and Chinese datasets and authors were disproportionately overrepresented in clinical AI, and almost all of the top 10 databases and author nationalities were from high income countries (HICs). AI techniques were most commonly employed for image-rich specialties, and authors were predominantly male, with non-clinical backgrounds. Development of technological infrastructure in data-poor regions, and diligence in external validation and model re-calibration prior to clinical implementation in the short-term, are crucial in ensuring clinical AI is meaningful for broader populations, and to avoid perpetuating global health inequity.

Optical coherence tomography findings in niacin maculopathy.

Artificial Intelligence Portrayals in Orthopaedic Surgery

The Face of a Surgeon: An Analysis of Demographic Representation in Three Leading Artificial Intelligence Text-to-Image Generators

[Extra-pancreatic lesions of autoimmune pancreatitis and diagnostic procedures].

Patterns of photoassimilate translocation to reproductive shoots from adjacent shoots in Camelliasasanqua by manipulation of sink-source balance between the shoots

Gender bias in generative artificial intelligence text-to-image depiction of medical students

Gender and ethnicity bias in generative artificial intelligence text-to-image depiction of pharmacists

Sources of bias in artificial intelligence that perpetuate healthcare disparities—A global review

Effect of 1,25-dihydroxyvitamin D deficiency on the metabolic clearance rate of 1,25-dihydroxyvitamin D3: studies using pigs with vitamin D-dependent rickets type 1.

Bias in Generative AI

AI depictions of psychiatric diagnoses: a preliminary study of generative image outputs in Midjourney V.6 and DALL-E 3

The Limits of Fair Medical Imaging AI In The Wild

AI-generated faces influence gender stereotypes and racial homogenization

Relationship between glial organization and the establishment of nerve tracts in rat spinal cord.

Fairness in AI-Driven Oncology: Investigating Racial and Gender Biases in Large Language Models

Medical imaging data science competitions should report dataset demographics and evaluate for bias

Bias and Non-Diversity of Big Data in Artificial Intelligence: Focus on Retinal Diseases

Analyzing Racial Differences in Imaging Joint Replacement Registries Using Generative Artificial Intelligence: Advancing Orthopaedic Data Equity

Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging

Disparities in Dermatology AI Performance on a Diverse, Curated Clinical Image Set

Using Generative Artificial Intelligence Tools in Cosmetic Surgery: A Study on Rhinoplasty, Facelifts, and Blepharoplasty Procedures