Abstract:Background & AimsLiver biopsy is the reference standard for staging and grading non-alcoholic fatty liver disease (NAFLD), but histologic scoring systems are semi-quantitative with marked inter- and intra-observer variation. We used machine learning to develop fully automated software for quantification of steatosis, inflammation, ballooning, and fibrosis in biopsies from patients with NAFLD and validated the technology in a separate group of patients.MethodsWe collected data from 246 consecutive patients with biopsy-proven NAFLD and followed in London, the United Kingdom, from January 2010 through December 2016. Biopsies from the first 100 patients were used to derive the algorithm and biopsies from the following 146 were used to validate it. Biopsies were independently scored by pathologists using the nonalcoholic steatohepatitis clinical research network criteria and digitalized. Areas of steatosis, inflammation, ballooning, and fibrosis were annotated on biopsies by 2 hepatobiliary histopathologists to facilitate machine learning. Images of biopsies from the derivation and validation sets were then analyzed by the algorithm to compute percentages of fat, inflammation, ballooning, and fibrosis, as well as collagen proportionate area (CPA), and compared with findings from pathologists' manual annotations and conventional scoring systems.ResultsIn the derivation group, results from manual annotation and the software had an inter-class correlation coefficient (ICC) of 0.97 for steatosis (95%CI, 0.95–0.99; P<.001); ICC, 0.96 for inflammation (95%CI, 0.9–0.98; P<.001); ICC, 0.94 for ballooning (95%CI, 0.87–0.98; P<.001); and ICC, 0.92 for fibrosis (95%CI, 0.88–0.96; P=.001). Percentages of fat, inflammation, ballooning, and CPA from the derivation group were confirmed in the validation cohort. The software identified histological features of NAFLD with levels of inter- and intra-observer agreement ranging from 0.95 to 0.99; this value was higher than that of semi-quantitative scoring systems which ranged 0.58 to 0.88. In a subgroup of paired liver biopsies, quantitative analysis was more sensitive in detecting differences compared to the nonalcoholic steatohepatitis Clinical Research Network scoring system.ConclusionsWe used machine learning to develop software to rapidly and objectively analyse liver biopsies for histologic features of NAFLD. The results from the software correlate with those from histopathologists, with high levels of inter- and intra-observer agreement. Findings were validated in a separate group of patients. This tool might be used for objective assessment of response to therapy for NAFLD in practice and clinical trials.

Deep Learning-Based Image Analysis of Liver Steatosis in Mouse Models

Deep Learning Radiomics for Focal Liver Lesions Diagnosis on Long-Range Contrast-Enhanced Ultrasound and Clinical Factors

A Deep Learning Method Enables Quantitative and Automatic Measurement of Rat Liver Histology in NAFLD

Deep Learning With Ultrasound Images Enhance the Diagnosis of Nonalcoholic Fatty Liver

Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

Deep learning for image-based liver analysis - A comprehensive review focusing on malignant lesions

Deep Learning-based Assessment of Hepatic Steatosis on chest CT

Accurate and generalizable quantitative scoring of liver steatosis from ultrasound images via scalable deep learning

High-Throughput, Machine Learning–Based Quantification of Steatosis, Inflammation, Ballooning, and Fibrosis in Biopsies From Patients With Nonalcoholic Fatty Liver Disease

Liver Steatosis Segmentation with Deep Learning Methods

Noninvasive Monitoring of Steatotic Liver Disease in Western Diet‐Fed Obese Mice Using Automated Ultrasound and Shear Wave Elastography

Steatosis Quantification on Ultrasound Images by a Deep Learning Algorithm on Patients Undergoing Weight Changes

Deep learning for noninvasive liver fibrosis classification: A systematic review

Enhanced Artificial Intelligence Methods for Liver Steatosis Assessment Using Machine Learning and Color Image Processing: Liver Color Project

Application of Deep Learning in Quantitative Analysis of 2‐Dimensional Ultrasound Imaging of Nonalcoholic Fatty Liver Disease

Ultrasound‐Based Machine Learning Approach for Detection of Nonalcoholic Fatty Liver Disease

Fully Automated Deep Learning-enabled Detection for Hepatic Steatosis on Computed Tomography: A Multicenter International Validation Study

Automated image analysis method for detecting and quantifying macrovesicular steatosis in hematoxylin and eosin-stained histology images of human livers

Liver-Quant: Feature-Based Image Analysis Toolkit for Automatic Quantification of Metabolic Dysfunction-Associated Steatotic Liver Disease

Deep Learning Based Shear Wave Detection and Segmentation Tool for Use in Point-of-Care for Chronic Liver Disease Assessments

Incorporating artificial intelligence in portable infrared thermal imaging for the diagnosis and staging of nonalcoholic fatty liver disease