Abstract:Abstract Providing a simultaneous segmentation and diagnosis of the spinal structures on axial magnetic resonance imaging (MRI) images has significant value for subsequent pathological analyses and clinical treatments. However, this task remains challenging, owing to the significant structural diversity, subtle differences between normal and abnormal structures, implicit borders, and insufficient training data. In this study, we propose an innovative network framework called ‘Axial-SpineGAN’ comprising a generator, discriminator, and diagnostor, aiming to address the above challenges, and to achieve simultaneous segmentation and disease diagnosis for discs, neural foramens, thecal sacs, and posterior arches on axial MRI images. The generator employs an enhancing feature fusion module to generate discriminative features, i.e. to address the challenges regarding the significant structural diversity and subtle differences between normal and abnormal structures. An enhancing border alignment module is employed to obtain an accurate pixel classification of the implicit borders. The discriminator employs an adversarial learning module to effectively strengthen the higher-order spatial consistency, and to avoid overfitting owing to insufficient training data. The diagnostor employs an automated diagnosis module to provide automated recognition of spinal diseases. Extensive experiments demonstrate that these modules have positive effects on improving the segmentation and diagnosis accuracies. Additionally, the results indicate that Axial-SpineGAN has the highest Dice similarity coefficient (94.9% ± 1.8%) in terms of the segmentation accuracy and highest accuracy rate (93.9% ± 2.6%) in terms of the diagnosis accuracy, thereby outperforming existing state-of-the-art methods. Therefore, our proposed Axial-SpineGAN is effective and potential as a clinical tool for providing an automated segmentation and disease diagnosis for multiple spinal structures on MRI images.

ResAttenGAN: Simultaneous segmentation of multiple spinal structures on axial lumbar MRI image using residual attention and adversarial learning

Segmentation of Paraspinal Muscles at Varied Lumbar Spinal Levels by Explicit Saliency-Aware Learning

Axial-SpineGAN: simultaneous segmentation and diagnosis of multiple spinal structures on axial magnetic resonance imaging images

Multi-Scale Hybrid Attention Convolutional Neural Network for Automatic Segmentation of Lumbar Vertebrae From MRI

WGAN-based multi-structure segmentation of vertebral cross-section MRI using ResU-Net and clustered transformer

Spine-GFlow: A Hybrid Learning Framework for Robust Multi-Tissue Segmentation in Lumbar MRI Without Manual Annotation.

Multi-modality Hierarchical Fusion Network for Lumbar Spine Segmentation with Magnetic Resonance Images

Residual-atrous attention network for lumbosacral plexus segmentation with MR image

Accurate Segmentation of Lumbar Spine Magnetic Resonance Imaging by Deep Neural Network with Size-Adaptive Loss.

RAU-Net: U-Net network based on residual multi-scale fusion and attention skip layer for overall spine segmentation

Enhancing Spinal MRI Segmentation with an Asymmetric U-Net Architecture

A sequential geometry-reconstruction-based deep learning approach to improve accuracy and consistence of lumbar spine MRI image segmentation

Craniomaxillofacial Bony Structures Segmentation from MRI with Deep-Supervision Adversarial Learning

Semi-supervised Semantic Segmentation of Multiple Lumbosacral Structures on CT

Multi-level Glioma Segmentation Using 3D U-Net Combined Attention Mechanism with Atrous Convolution.

Spinal MRI image segmentation based on improved U-Net

LPM-GAN: Lumbar Paraspinal Muscle Segmentation Using a Generative Adversarial Network

Adaptive Group Fusion Module for Improving Feature Fusion of Multi-modality Lumbar Spine MRI

DMCA-GAN: Dual Multilevel Constrained Attention GAN for MRI-Based Hippocampus Segmentation

SpineMamba: Enhancing 3D Spinal Segmentation in Clinical Imaging through Residual Visual Mamba Layers and Shape Priors

Machine-agnostic Automated Lumbar MRI Segmentation using a Cascaded Model Based on Generative Neurons