Abstract:Background: Variability in the bony morphology of pathologic hips/knees is a challenge in automating preoperative computed tomography (CT) scan measurements. With the increasing prevalence of CT for advanced preoperative planning, processing this data represents a critical bottleneck in presurgical planning, research, and development. The purpose of this study was to demonstrate a reproducible and scalable methodology for analyzing CT-based anatomy to process hip and knee anatomy for perioperative planning and execution. Methods: One hundred patients with preoperative CT scans undergoing total knee arthroplasty for osteoarthritis were processed. A two-step deep learning pipeline of classification and segmentation models was developed that identifies landmark images and then generates contour representations. We utilized an open-source computer vision library to compute measurements. Classification models were assessed by accuracy, precision, and recall. Segmentation models were evaluated using dice and mean Intersection over Union (IOU) metrics. Contour measurements were compared against manual measurements to validate posterior condylar axis angle, sulcus angle, trochlear groove-tibial tuberosity distance, acetabular anteversion, and femoral version. Results: Classifiers identified landmark images with accuracy of 0.91 and 0.88 for hip and knee models, respectively. Segmentation models demonstrated mean IOU scores above 0.95 with the highest dice coefficient of 0.957 [0.954-0.961] (UNet3+) and the highest mean IOU of 0.965 [0.961-0.969] (Attention U-Net). There were no statistically significant differences for the measurements taken automatically vs manually (P > 0.05). Average time for the pipeline to preprocess (48.65 +/- 4.41 sec), classify/retrieve landmark images (8.36 +/- 3.40 sec), segment images (<1 sec), and obtain measurements was 2.58 (+/- 1.92) minutes. Conclusions: A fully automated three-stage deep learning and computer vision-based pipeline of classification and segmentation models accurately localized, segmented, and measured landmark hip and knee images for patients undergoing total knee arthroplasty. Incorporation of clinical parameters, like patient-reported outcome measures and instability risk, will be important considerations alongside anatomic parameters.

Segmenting the Femoral Head and Acetabulum in the Hip Joint Automatically Using a Multi-Step Scheme

Automatic Segmentation Technique for Acetabulum and Femoral Head in CT Images

An automatic segmentation system of acetabulum in sequential CT images for the personalized artificial femoral head design

Automatic outer surface extraction of femoral head in CT images

Fully Automatic Segmentation of Hip CT Images

Segmentation of the Hip Joint in Ct Volumes Using Adaptive Thresholding Classification and Normal Direction Correction

Fully Automatic Ct Segmentation For Computer-Assisted Pre-Operative Planning Of Hip Arthroscopy

FACTS: Fully Automatic CT Segmentation of a Hip Joint

Graph Cuts and Shape Constraint Based Automatic Femoral Head Segmentation in CT Images

A method framework of semi-automatic knee bone segmentation and reconstruction from computed tomography (CT) images

Accurate Pelvis and Femur Segmentation in Hip CT with a Novel Patch-Based Refinement.

Fully Automatic Segmentation of Hip CT Images Via Random Forest Regression-Based Atlas Selection and Optimal Graph Search-Based Surface Detection

Segmentation of Multiple Knee Bones from Ct for Orthopedic Knee Surgery Planning

A Deep Learning-Based Approach to Extracting Periosteal and Endosteal Contours of Proximal Femur in Quantitative CT Images

Automatic segmentation method for hip joint based on Bayesian Decision Theory

Three-Dimensional Feature-Enhanced Network for Automatic Femur Segmentation

Statistical model-based segmentation of the proximal femur in digital antero-posterior (AP) pelvic radiographs

A New Accurate and Precise 3-D Segmentation Method for Skeletal Structures in Volumetric Ct Data

Automating Linear and Angular Measurements for the Hip and Knee After Computed Tomography: Validation of a Three-Stage Deep Learning and Computer Vision-Based Pipeline for Pathoanatomic Assessment

Development and validation of a semi-automated and unsupervised method for femur segmentation from CT

Automatic segmentation of knee CT images of tibial plateau fractures based on three-dimensional U-Net: Assisting junior physicians with Schatzker classification