Abstract:Background: Variability in the bony morphology of pathologic hips/knees is a challenge in automating preoperative computed tomography (CT) scan measurements. With the increasing prevalence of CT for advanced preoperative planning, processing this data represents a critical bottleneck in presurgical planning, research, and development. The purpose of this study was to demonstrate a reproducible and scalable methodology for analyzing CT-based anatomy to process hip and knee anatomy for perioperative planning and execution. Methods: One hundred patients with preoperative CT scans undergoing total knee arthroplasty for osteoarthritis were processed. A two-step deep learning pipeline of classification and segmentation models was developed that identifies landmark images and then generates contour representations. We utilized an open-source computer vision library to compute measurements. Classification models were assessed by accuracy, precision, and recall. Segmentation models were evaluated using dice and mean Intersection over Union (IOU) metrics. Contour measurements were compared against manual measurements to validate posterior condylar axis angle, sulcus angle, trochlear groove-tibial tuberosity distance, acetabular anteversion, and femoral version. Results: Classifiers identified landmark images with accuracy of 0.91 and 0.88 for hip and knee models, respectively. Segmentation models demonstrated mean IOU scores above 0.95 with the highest dice coefficient of 0.957 [0.954-0.961] (UNet3+) and the highest mean IOU of 0.965 [0.961-0.969] (Attention U-Net). There were no statistically significant differences for the measurements taken automatically vs manually (P > 0.05). Average time for the pipeline to preprocess (48.65 +/- 4.41 sec), classify/retrieve landmark images (8.36 +/- 3.40 sec), segment images (<1 sec), and obtain measurements was 2.58 (+/- 1.92) minutes. Conclusions: A fully automated three-stage deep learning and computer vision-based pipeline of classification and segmentation models accurately localized, segmented, and measured landmark hip and knee images for patients undergoing total knee arthroplasty. Incorporation of clinical parameters, like patient-reported outcome measures and instability risk, will be important considerations alongside anatomic parameters.

An Effective Satin Bowerbird Optimization Based Modified Elman Recurrent Neural Network for Thigh Muscle Segmentation and Quantification in Patients Undergoing Total Knee Replacement (TKR)

Deep Learning-based Thigh Muscle Investigation Using MRI For Prosthetic Development for Patients Undergoing Total Knee Replacement (TKR)

Enhanced Knee Kinematics: Leveraging Deep Learning and Morphing Algorithms for 3D Implant Modeling

Automating Linear and Angular Measurements for the Hip and Knee After Computed Tomography: Validation of a Three-Stage Deep Learning and Computer Vision-Based Pipeline for Pathoanatomic Assessment

Combining enhanced spectral resolution of EMG and a deep learning approach for knee pathology diagnosis

Deep Learning for Automatic Knee Osteoarthritis Severity Grading and Classification

Dual output feature fusion networks for femoral segmentation and quantitative analysis of the knee joint

Deep Learning Predicts Total Knee Replacement from Magnetic Resonance Images

An Efficient Neural Network for Segmenting Multiple Joint Tissues From Knee MRI With Hyperparameter Optimization: Data From the Osteoarthritis Initiative

Bridging Theory and Practice: A Comprehensive Algorithm for Imageless Total Knee Arthroplasty

Auto-segmentation of the tibia and femur from knee MR images via deep learning and its application to cartilage strain and recovery

Prediction of Knee Prosthesis Using Patient Gender and BMI With Non-marked X-Ray by Deep Learning

THA-Net: A Deep Learning Solution for Next-Generation Templating and Patient-specific Surgical Execution

Deep Neural Network-based Knee Osteoarthritis Grading Using X-Rays

Deep learning-based automatic pipeline for quantitative assessment of thigh muscle morphology and fatty infiltration

Combined Edge Loss UNet for Optimized Segmentation in Total Knee Arthroplasty Preoperative Planning

An Automated Real-Time Approach for Image Processing and Segmentation of Fluoroscopic Images and Videos Using a Single Deep Learning Network

Bio-Measurements Estimation and Support in Knee Recovery through Machine Learning

A novel deep learning approach for automated grading of knee osteoarthritis severity

Developing a Computer Vision Model to Automate Quantitative Measurement of Hip-Knee-Ankle Angle in Total Hip and Knee Arthroplasty Patients

Automatic Knee Osteoarthritis Diagnosis from Plain Radiographs: A Deep Learning-Based Approach