Abstract:In recent years the healthcare industry has had increased difficulty seeing all low-risk patients, including but not limited to suspected osteoarthritis (OA) patients. To help address the increased waiting lists and shortages of staff, we propose a novel method of automated biomarker identification and quantification for the monitoring of treatment or disease progression through the analysis of clinical motion data captured from a standard RGB video camera. The proposed method allows for the measurement of biomechanics information and analysis of their clinical significance, in both a cheap and sensitive alternative to the traditional motion capture techniques. These methods and results validate the capabilities of standard RGB cameras in clinical environments to capture clinically relevant motion data. Our method focuses on generating 3D human shape and pose from 2D video data via adversarial training in a deep neural network with a self-attention mechanism to encode both spatial and temporal information. Biomarker identification using Principal Component Analysis (PCA) allows the production of representative features from motion data and uses these to generate a clinical report automatically. These new biomarkers can then be used to assess the success of treatment and track the progress of rehabilitation or to monitor the progression of the disease. These methods have been validated with a small clinical study, by administering a local anaesthetic to a small population with knee pain, this allows these new representative biomarkers to be validated as statistically significant ( p -value < 0.05 ). These significant biomarkers include the cumulative acceleration of elbow flexion/extension in a sit-to-stand, as well as the smoothness of the knee and elbow flexion/extension in both a squat and sit-to-stand.

A Neural Template Matching Method to Detect Knee Joint Areas

A Parts Based Registration Loss for Detecting Knee Joint Areas

A novel method for automatic localization of joint area on knee plain radiographs

Scan-Free and Fully Automatic Tracking of Native Knee Anatomy from Dynamic Stereo-Radiography with Statistical Shape and Intensity Models

Give me a knee radiograph, I will tell you where the knee joint area is: a deep convolutional neural network adventure

Optimising Knee Injury Detection with Spatial Attention and Validating Localisation Ability

Automatic Detection of Knee Joints and Quantification of Knee Osteoarthritis Severity using Convolutional Neural Networks

Automatic 3d Mr Image Registration And Its Evaluation For Precise Monitoring Of Knee Joint Disease

An Efficient Neural Network for Segmenting Multiple Joint Tissues From Knee MRI With Hyperparameter Optimization: Data From the Osteoarthritis Initiative

A marker-less human motion analysis system for motion-based biomarker identification and quantification in knee disorders

KneeXNeT: An Ensemble-Based Approach for Knee Radiographic Evaluation

A Method for a Posteriori Identification of Knee Points Based on Solution Density

Automated Detection Model Based on Deep Learning for Knee Joint Motion Injury due to Martial Arts

Accurate Bone Registration in Knee Mr Images

Automated Segmentation for Knee Joint MRI Images Using Hybrid UNet+Attention

Learning Correspondences in Knee MR Images from the Osteoarthritis Initiative

Automated analysis of knee joint alignment using detailed angular values in long leg radiographs based on deep learning

Quantifying Knee Cartilage Shape and Lesion: From Image to Metrics

Accurate Three-Dimensional Registration of Magnetic Resonance Images for Detecting Local Changes in Cartilage Thickness.

Bridging Theory and Practice: A Comprehensive Algorithm for Imageless Total Knee Arthroplasty

X-ray image analysis for automated knee osteoarthritis detection