Abstract:Abstract Objective To examine the accuracy of artificial intelligence (AI) for the detection of breast cancer in mammography screening practice. Design Systematic review of test accuracy studies. Data sources Medline, Embase, Web of Science, and Cochrane Database of Systematic Reviews from 1 January 2010 to 17 May 2021. Eligibility criteria Studies reporting test accuracy of AI algorithms, alone or in combination with radiologists, to detect cancer in women’s digital mammograms in screening practice, or in test sets. Reference standard was biopsy with histology or follow-up (for screen negative women). Outcomes included test accuracy and cancer type detected. Study selection and synthesis Two reviewers independently assessed articles for inclusion and assessed the methodological quality of included studies using the QUality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool. A single reviewer extracted data, which were checked by a second reviewer. Narrative data synthesis was performed. Results Twelve studies totalling 131 822 screened women were included. No prospective studies measuring test accuracy of AI in screening practice were found. Studies were of poor methodological quality. Three retrospective studies compared AI systems with the clinical decisions of the original radiologist, including 79 910 women, of whom 1878 had screen detected cancer or interval cancer within 12 months of screening. Thirty four (94%) of 36 AI systems evaluated in these studies were less accurate than a single radiologist, and all were less accurate than consensus of two or more radiologists. Five smaller studies (1086 women, 520 cancers) at high risk of bias and low generalisability to the clinical context reported that all five evaluated AI systems (as standalone to replace radiologist or as a reader aid) were more accurate than a single radiologist reading a test set in the laboratory. In three studies, AI used for triage screened out 53%, 45%, and 50% of women at low risk but also 10%, 4%, and 0% of cancers detected by radiologists. Conclusions Current evidence for AI does not yet allow judgement of its accuracy in breast cancer screening programmes, and it is unclear where on the clinical pathway AI might be of most benefit. AI systems are not sufficiently specific to replace radiologist double reading in screening programmes. Promising results in smaller studies are not replicated in larger studies. Prospective studies are required to measure the effect of AI in clinical practice. Such studies will require clear stopping rules to ensure that AI does not reduce programme specificity. Study registration Protocol registered as PROSPERO CRD42020213590.

AI and imaging-based cancer screening: getting ready for prime time

Enhancing early detection of pancreatic cancer by integrating AI with advanced imaging techniques

Artificial Intelligence in the Diagnosis and Treatment of Pancreatic Cystic Lesions and Adenocarcinoma

Artificial Intelligence in Colorectal Cancer: From Patient Screening over Tailoring Treatment Decisions to Identification of Novel Biomarkers

Potential of artificial intelligence in the risk stratification for and early detection of pancreatic cancer

Advancements in Pancreatic Cancer Detection: Integrating Biomarkers, Imaging Technologies, and Machine Learning for Early Diagnosis

Artificial intelligence-based image analysis in clinical testing: lessons from cervical cancer screening

International evaluation of an AI system for breast cancer screening

Artificial Intelligence-assisted colonoscopy and colorectal cancer screening: Where are we going?

Artificial intelligence in cancer imaging: Clinical challenges and applications

Computer-Aided Detection for Pancreatic Cancer Diagnosis: Radiological Challenges and Future Directions

Artificial Intelligence in Colorectal Cancer Screening, Diagnosis and Treatment. A New Era

Artificial intelligence for breast cancer screening: Opportunity or hype?

Imaging Techniques and Biochemical Biomarkers: New Insights into Diagnosis of Pancreatic Cancer

An Artificial Intelligence Outlook for Colorectal Cancer Screening

Artificial Intelligence in Pancreatic Image Analysis: A Review

Early gastric cancer and Artificial Intelligence: Is it time for population screening?

Early Detection of Pancreatic Cancer: Opportunities Provided by Cancer-induced Paraneoplastic Phenomena and Artificial Intelligence

From Machine Learning to Patient Outcomes: A Comprehensive Review of AI in Pancreatic Cancer

Artificial Intelligence in Lung Cancer Screening: The Future Is Now

Use of artificial intelligence for image analysis in breast cancer screening programmes: systematic review of test accuracy