CycleGAN Models for MRI Image Translation

Cassandra Czobit,Reza Samavi
2024-01-05
Abstract:Image-to-image translation has gained popularity in the medical field to transform images from one domain to another. Medical image synthesis via domain transformation is advantageous in its ability to augment an image dataset where images for a given class is limited. From the learning perspective, this process contributes to data-oriented robustness of the model by inherently broadening the model's exposure to more diverse visual data and enabling it to learn more generalized features. In the case of generating additional neuroimages, it is advantageous to obtain unidentifiable medical data and augment smaller annotated datasets. This study proposes the development of a CycleGAN model for translating neuroimages from one field strength to another (e.g., 3 Tesla to 1.5). This model was compared to a model based on DCGAN architecture. CycleGAN was able to generate the synthetic and reconstructed images with reasonable accuracy. The mapping function from the source (3 Tesla) to target domain (1.5 Tesla) performed optimally with an average PSNR value of 25.69 $\pm$ 2.49 dB and an MAE value of 2106.27 $\pm$ 1218.37.
Image and Video Processing,Machine Learning
What problem does this paper attempt to address?
The main problem this paper attempts to address is the development of a method to use the CycleGAN model for image translation between different field strengths within the MRI image domain. Specifically, the research aims to convert neuroimaging from one field strength (e.g., 3 Tesla) to another field strength (e.g., 1.5 Tesla) to enhance datasets and improve the generalization ability of models. Additionally, by generating synthetic images, the study aims to augment smaller annotated datasets, thereby protecting patient privacy. ### Main Issues: 1. **Dataset Augmentation**: Increase the number of images in specific categories by generating synthetic images, especially in cases where certain category images are scarce. 2. **Model Generalization Ability**: Enhance the data-driven robustness of the model through domain translation, allowing the model to encounter more diverse visual data and thus learn more general features. 3. **Privacy Protection**: Generate unidentifiable medical data to reduce the direct use of personal medical data. ### Research Methods: - **CycleGAN Model**: Used to convert 3 Tesla MRI images to 1.5 Tesla MRI images and evaluate its performance. - **DCGAN Model**: Used as a comparison model to generate synthetic images under the same field strength. ### Evaluation Metrics: - **Peak Signal-to-Noise Ratio (PSNR)**: A metric to measure image quality, with higher values indicating better image quality. - **Mean Absolute Error (MAE)**: A metric to measure image differences, with lower values indicating images closer to the real images. - **Mean Squared Error (MSE)**: A metric to measure image differences, with lower values indicating images closer to the real images. ### Main Findings: - **CycleGAN Model**: Performed well in converting images from 3 Tesla to 1.5 Tesla, with a PSNR value of 25.69 ± 2.49 dB and an MAE value of 2106.27 ± 1218.37. - **DCGAN Model**: Performed poorly in generating synthetic images, especially in generating 1.5 Tesla images, with a PSNR value of only 6.20 ± 0.11 dB and an MAE value of 31907.44 ± 415.85. ### Conclusion: - The **CycleGAN Model** excels in MRI image translation between different field strengths, capable of generating high-quality synthetic images, aiding in dataset augmentation and model generalization. - The **DCGAN Model** has limitations in generating synthetic images, producing lower quality images that do not reach the level of CycleGAN. ### Future Work: - Increase the size of the dataset to further validate the model's performance. - Develop classification models to evaluate the quality and classification accuracy of the generated images.