Abstract:Background: Convolutional neural networks (CNNs) have been used to classify medical images; few studies use smartphone photographs that are scalable at point of care. We previously showed proof of principle that CNNs could detect inflammatory arthritis in three hand joints. We now studied a screening CNN to differentiate from controls. Methods: We studied consecutive patients with early inflammatory arthritis and healthy controls, all examined by a rheumatologist (15% by two). Standardized photographs of the hands were taken using a studio box, anonymized, and cropped around joints. We fine-tuned pre-trained CNN models on our dataset (80% training; 20% test set). We used an Inception-ResNet-v2 backbone CNN modified for two class outputs (Patient vs Control) on uncropped photos. Inception-ResNet-v2 CNNs were trained on cropped photos of Middle finger Proximal Interphalangeal (MFPIP), Index finger PIP (IFPIP) and wrist. We report representative values of accuracy, sensitivity, specificity. Results: We studied 800 hands from 200 controls (mean age 37.8 years) and 200 patients (mean age 49.6 years; 134 with rheumatoid arthritis amongst other diagnoses). Two rheumatologists had a concordance of 0.89 in 404 joints. The wrist was commonly involved (173/400) followed by the MFPIP (134) and IFPIP (128). The screening CNN achieved excellent accuracy (98%), sensitivity (98%) and specificity (98%) in predicting a patient compared to controls. Joint-specific CNN accuracy, sensitivity and specificity were highest for the wrist (80% , 88% , 72%) followed by the IFPIP (79%, 89% ,73%) and MFPIP (76%, 91%, 70%). Conclusion Computer vision without feature engineering can distinguish between patients and controls based on smartphone photographs with good accuracy, showing promise as a screening tool prior to joint-specific CNNs. Future research includes validating findings in diverse populations, refining models to improve specificity in joints and integrating this technology into clinical workflows.

In vitro microbiological characterization of novel macrolide CP-163,505 for animal health specific use.

Ethane-1,2-diyl bis(pyridine-3-carboxylate)

Enhancing Convolutional Neural Network Scheme for Rheumatoid Arthritis Grading with Limited Clinical Data

Radiograph-based rheumatoid arthritis diagnosis via convolutional neural network

DeepRA: Predicting Joint Damage From Radiographs Using CNN with Attention

Pre-trained convolutional neural network with transfer learning by artificial illustrated images classify power Doppler ultrasound images of rheumatoid arthritis joints

Grading of Rheumatoid Arthritis on Ultrasound Images with Deep Convolutional Neural Network

Identification of rheumatoid arthritis using bone image features with radial basis function neural networks

Deep Learning Enables Automatic Detection of Joint Damage Progression in Rheumatoid Arthritis—Model Development and External Validation

Diagnosing the Severity of Knee Osteoarthritis Using Regression Scores From Artificial Intelligence Convolution Neural Networks

Deep Neural Network-based Knee Osteoarthritis Grading Using X-Rays

Improving speech recognizer by broader acoustic-phonetic group classification

Deep Learning Models to Automate the Scoring of Hand Radiographs for Rheumatoid Arthritis

Deep learning for accurately recognizing common causes of shoulder pain on radiographs

Automatic Grading of Individual Knee Osteoarthritis Features in Plain Radiographs Using Deep Convolutional Neural Networks

Fully automatic knee osteoarthritis severity grading using deep neural networks with a novel ordinal loss

Incorporating computer vision on smart phone photographs into screening for inflammatory arthritis: results from an Indian patient cohort

Rheumatoid Arthritis: Automated Scoring of Radiographic Joint Damage

Automated Coronary Artery Calcium Scoring Using Convolutional Neural Networks: Enhancing Cardiovascular Risk Assessment in Chest CT Scans

Improving knee osteoarthritis classification using multimodal intermediate fusion of X-ray, MRI, and clinical information