Abstract:Background: Variability in the bony morphology of pathologic hips/knees is a challenge in automating preoperative computed tomography (CT) scan measurements. With the increasing prevalence of CT for advanced preoperative planning, processing this data represents a critical bottleneck in presurgical planning, research, and development. The purpose of this study was to demonstrate a reproducible and scalable methodology for analyzing CT-based anatomy to process hip and knee anatomy for perioperative planning and execution. Methods: One hundred patients with preoperative CT scans undergoing total knee arthroplasty for osteoarthritis were processed. A two-step deep learning pipeline of classification and segmentation models was developed that identifies landmark images and then generates contour representations. We utilized an open-source computer vision library to compute measurements. Classification models were assessed by accuracy, precision, and recall. Segmentation models were evaluated using dice and mean Intersection over Union (IOU) metrics. Contour measurements were compared against manual measurements to validate posterior condylar axis angle, sulcus angle, trochlear groove-tibial tuberosity distance, acetabular anteversion, and femoral version. Results: Classifiers identified landmark images with accuracy of 0.91 and 0.88 for hip and knee models, respectively. Segmentation models demonstrated mean IOU scores above 0.95 with the highest dice coefficient of 0.957 [0.954-0.961] (UNet3+) and the highest mean IOU of 0.965 [0.961-0.969] (Attention U-Net). There were no statistically significant differences for the measurements taken automatically vs manually (P > 0.05). Average time for the pipeline to preprocess (48.65 +/- 4.41 sec), classify/retrieve landmark images (8.36 +/- 3.40 sec), segment images (<1 sec), and obtain measurements was 2.58 (+/- 1.92) minutes. Conclusions: A fully automated three-stage deep learning and computer vision-based pipeline of classification and segmentation models accurately localized, segmented, and measured landmark hip and knee images for patients undergoing total knee arthroplasty. Incorporation of clinical parameters, like patient-reported outcome measures and instability risk, will be important considerations alongside anatomic parameters.

Fully Automated Analysis of the Anatomic and Mechanical Axes From Pediatric Standing Lower Limb Radiographs Using Convolutional Neural Networks

Fully automated measurement on coronal alignment of lower limbs using deep convolutional neural networks on radiographic images

Automated analysis of knee joint alignment using detailed angular values in long leg radiographs based on deep learning

Automatic measurement of lower limb alignment in portable devices based on deep learning for knee osteoarthritis

Radiological Approach to Assessment of Lower-Limb Alignment—Coronal and Transverse Plane Analysis

An automated framework for pediatric hip surveillance and severity assessment using radiographs

Multicentric development and validation of a multi-scale and multi-task deep learning model for comprehensive lower extremity alignment analysis

Automated patellar height assessment on high-resolution radiographs with a novel deep learning-based approach

High accuracy in lower limb alignment analysis using convolutional neural networks, with improvements needed for joint‐level metrics

Automating Linear and Angular Measurements for the Hip and Knee After Computed Tomography: Validation of a Three-Stage Deep Learning and Computer Vision-Based Pipeline for Pathoanatomic Assessment

Developing a Computer Vision Model to Automate Quantitative Measurement of Hip-Knee-Ankle Angle in Total Hip and Knee Arthroplasty Patients

Computer-assisted contralateral side comparison of the ankle joint using flat panel technology

Scan-Free and Fully Automatic Tracking of Native Knee Anatomy from Dynamic Stereo-Radiography with Statistical Shape and Intensity Models

Automated Measurements of Long Leg Radiographs in Pediatric Patients: A Pilot Study to Evaluate an Artificial Intelligence-Based Algorithm

Improved Automated Quality Control of Skeletal Wrist Radiographs Using Deep Multitask Learning

Automated diagnosis of flatfoot using cascaded convolutional neural network for angle measurements in weight-bearing lateral radiographs

Automated Morphometric Analysis of the Hip Joint on MRI from the German National Cohort Study

Give me a knee radiograph, I will tell you where the knee joint area is: a deep convolutional neural network adventure

Lower Extremity Growth according to AI Automated Femorotibial Length Measurement on Slot-Scanning Radiographs in Pediatric Patients

Automated Analysis of Femoral Artery Calcification Using Machine Learning Techniques

Automatic Knee Osteoarthritis Diagnosis from Plain Radiographs: A Deep Learning-Based Approach