Temporal Evolution of Knee Osteoarthritis: A Diffusion-based Morphing Model for X-ray Medical Image Synthesis

Zhe Wang,Aladine Chetouani,Rachid Jennane,Yuhua Ru,Wasim Issa,Mohamed Jarraya

2024-08-02

Abstract:Knee Osteoarthritis (KOA) is a common musculoskeletal disorder that significantly affects the mobility of older adults. In the medical domain, images containing temporal data are frequently utilized to study temporal dynamics and statistically monitor disease progression. While deep learning-based generative models for natural images have been widely researched, there are comparatively few methods available for synthesizing temporal knee X-rays. In this work, we introduce a novel deep-learning model designed to synthesize intermediate X-ray images between a specific patient's healthy knee and severe KOA stages. During the testing phase, based on a healthy knee X-ray, the proposed model can produce a continuous and effective sequence of KOA X-ray images with varying degrees of severity. Specifically, we introduce a Diffusion-based Morphing Model by modifying the Denoising Diffusion Probabilistic Model. Our approach integrates diffusion and morphing modules, enabling the model to capture spatial morphing details between source and target knee X-ray images and synthesize intermediate frames along a geodesic path. A hybrid loss consisting of diffusion loss, morphing loss, and supervision loss was employed. We demonstrate that our proposed approach achieves the highest temporal frame synthesis performance, effectively augmenting data for classification models and simulating the progression of KOA.

Image and Video Processing,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

This paper aims to address the issue of simulating the continuous evolution of knee osteoarthritis (KOA) in medical imaging. Specifically, the research objectives include:

1. **Generating Intermediate Stage X-ray Images**: By introducing a Diffusion-based Morphing Model (DMM), this model can synthesize a series of intermediate stage images with varying degrees of severity between a specific patient's healthy knee X-ray image and the severe KOA stage.

2. **Simulating Disease Progression**: By synthesizing these intermediate stage X-ray images, researchers can more intuitively observe the development process of KOA, and this data augmentation technique helps simulate the progression of the disease.

3. **Improving Data Quality**: The proposed model not only generates high-quality intermediate frame images but also ensures that these images correspond to actual KOA grades, thereby enhancing the data quality for classification models.

4. **Validating Model Effectiveness**: The generalization ability of the proposed method is demonstrated through various validation methods, and experimental results from the OsteoArthritis Initiative (OAI) database support this conclusion.

In summary, the core objective of this paper is to effectively generate continuous sequences of knee X-ray images through deep learning techniques, particularly by combining diffusion models and morphing modules, to assist in medical diagnosis and treatment planning.