Abstract:Background: Artificial intelligence is gaining traction in automated medical imaging analysis. Development of more accurate magnetic resonance imaging (MRI) predictors of successful clinical outcomes is necessary to better define indications for surgery, improve clinical outcomes with targeted minimally invasive and endoscopic procedures, and realize cost savings by avoiding more invasive spine care. Objective: To demonstrate the ability for deep learning neural network models to identify features in MRI DICOM datasets that represent varying intensities or severities of common spinal pathologies and injuries and to demonstrate the feasibility of generating automated verbal MRI reports comparable to those produced by reading radiologists. Methods: A 3-dimensional (3D) anatomical model of the lumbar spine was fitted to each of the patient's MRIs by a team of technicians. MRI T1, T2, sagittal, axial, and transverse reconstruction image series were used to train segmentation models by the intersection of the 3D model through these image sequences. Class definitions were extracted from the radiologist report for the central canal: (0) no disc bulge/protrusion/canal stenosis, (1) disc bulge without canal stenosis, (2) disc bulge resulting in canal stenosis, and (3) disc herniation/protrusion/extrusion resulting in canal stenosis. Both the left and right neural foramina were assessed with either (0) neural foraminal stenosis absent, or (1) neural foramina stenosis present. Reporting criteria for the pathologies at each disc level and, when available, the grading of severity were extracted, and a natural language processing model was used to generate a verbal and written report. These data were then used to train a set of very deep convolutional neural network models, optimizing for minimal binary cross-entropy for each classification. Results: The initial prediction validation of the implemented deep learning algorithm was done on 20% of the dataset, which was not used for artificial intelligence training. Of the 17,800 total disc locations for which MRI images and radiology reports were available, 14,720 were used to train the model, and 3560 were used to validate against. The convergence of validation accuracy achieved with the deep learning algorithm for the foraminal stenosis detector was 81% (sensitivity = 72.4.4%, specificity = 83.1%) after 25 complete iterations through the entire training dataset (epoch). The accuracy was 86.2% (sensitivity = 91.1%, specificity = 82.5%) for the central stenosis detector and 85.2% (sensitivity = 81.8%, specificity = 87.4%) for the disc herniation detector. Conclusions: Deep learning algorithms may be used for routine reporting in spine MRI. There was a minimal disparity among accuracy, sensitivity, and specificity, indicating that the data were not overfitted to the training set. We concluded that variability in the training data tends to reduce overfitting and overtraining as the deep neural network models learn to focus on the common pathologies. Future studies should demonstrate the accuracy of deep neural network models and the predictive value of favorable clinical outcomes with intervention and surgery. Level of evidence: 3. Clinical relevance: Feasibility, clinical teaching, and evaluation study.

Imaging evaluation of a proposed 3D generative model for MRI to CT translation in the lumbar spine

TomoRay: Generating synthetic computed tomography of the spine from biplanar radiographs

MRI-based synthetic CT of the lumbar spine: Geometric measurements for surgery planning in comparison with CT

Deep-learning reconstructed lumbar spine 3D MRI for surgical planning: pedicle screw placement and geometric measurements compared to CT

Three-dimensional Segmentation of the Scoliotic Spine from MRI using Unsupervised Volume-based MR-CT Synthesis

Evaluation of a Deep Learning-Based Pelvic Synthetic CT Generation Technique for MRI-based Prostate Proton Treatment Planning

MRI-only brain radiotherapy: Assessing the dosimetric accuracy of synthetic CT images generated using a deep learning approach

Resolution-dependent MRI-to-CT translation for orthotopic breast cancer models using deep learning

Generation and Applications of Synthetic Computed Tomography Images for Neurosurgical Planning.

Generative Adversarial Network (GAN) for Automatic Reconstruction of the 3D Spine Structure by Using Simulated Bi-Planar X-ray Images

SYNTHETIC CT GENERATION FROM T1-WEIGHTED KNEE MRIs USING A UNET

Mitigating Misalignment in MRI-to-CT Synthesis for Improved Synthetic CT Generation: an Iterative Refinement and Knowledge Distillation Approach.

Synthetic CT generation for pelvic cases based on deep learning in multi-center datasets

Deformable registration of preoperative MR and intraoperative long-length tomosynthesis images for guidance of spine surgery via image synthesis

MRI-based Synthetic CT Generation Using Deep Convolutional Neural Network

MRI-only Based Synthetic CT Generation Using Dense Cycle Consistent Generative Adversarial Networks.

Evaluation of CT Image Synthesis Methods:From Atlas-based Registration to Deep Learning

MRI-based Treatment Planning for Liver Stereotactic Body Radiotherapy: Validation of a Deep Learning-Based Synthetic CT Generation Method

Region of interest focused MRI to synthetic CT translation using regression and segmentation multi-task network

Magnetic Resonance-Based Synthetic Computed Tomography Using Generative Adversarial Networks for Intracranial Tumor Radiotherapy Treatment Planning

Feasibility of Deep Learning Algorithms for Reporting in Routine Spine Magnetic Resonance Imaging