Abstract:Grasping good understanding of the weight-bearing spatial structure of the spine of a human subject in a standing position is critical for the treatment of spinal disorders. Such disorders are commonly diagnosed via 2D X-ray imaging of the human subject in a standing position. However, 3D reconstruction techniques based on bi-planar X-ray imaging can enable better exploration and analysis of the spinal structure. In particular, compared to earlier deformable modeling approaches, the recently-developed deep-learning-based 3D reconstruction methods exhibit higher efficiency and generalizability. But these methods usually employ simple architectures with 2D encoders and 3D decoders. Thus, these methods have several drawbacks, namely, the existence of a semantic gap between dimensionally-inconsistent feature maps, the difficulty of jointly handling multi-view inputs, and the information source limitations for the decoding process. In order to better assist clinicians and tackle these problems, we propose a novel convolutional neural network framework, which we call BX2S-Net, to effectively achieve 3D spine reconstruction based on bi-planar X-ray images. In particular, a dimensionally-consistent encoder-decoder architecture is designed in conjunction with a dimensionality enhancement method in order to reduce the semantic gap between feature maps and achieve information fusion for multi-view inputs. A feature-guided progressive decoding process is developed on the decoder side, where a full-scale feature attention guidance (FFAG) module is introduced to efficiently aggregate image features and guide the decoding process at each level. In addition, a class augmentation method and a spatially-weighted cross-entropy loss function are used for network training with improved reconstruction quality for the vertebral edge region. The experimental results demonstrate the effectiveness of our model in reconstructing high-quality 3D spinal structures from bi-planar X-ray images. The code is available at https://github.com/NBU-CVMI/bx2s-net.

3D dendrite reconstruction and spine identification.

3D Neuron Dendritic Spine Detection and Dendrite Reconstruction

A New Algorithm For 3d Dendritic Spine Detection

A Neurocomputational Method for Fully Automated 3D Dendritic Spine Detection and Segmentation of Medium-Sized Spiny Neurons

Dendritic spine detection using curvilinear structure detector and LDA classifier

A Novel Algorithm For Automatic Dendritic Spine Detection In Microscope Images

Detection of Dendritic Spines Using Wavelet-Based Conditional Symmetric Analysis and Regularized Morphological Shared-Weight Neural Networks

Morphological Reconstruction of Detached Dendritic Spines via Geodesic Path Prediction

Automatic Spinal Ultrasound Image Segmentation and Deployment for Real-time Spine Volumetric Reconstruction

Semi-Automatic Neuron Tracing in Electron Microscope Images: Preliminary Results

Automatic dendritic spine segmentation in widefield fluorescence images reveal synaptic nanostructures distribution with super-resolution imaging

RESPAN: an accurate, unbiased and automated pipeline for analysis of dendritic morphology and dendritic spine mapping

Dendrite Tracking and Dentritic Spine Detection in Microscope Images

Detection of Dendritic Spines Using Wavelet Packet Entropy and Fuzzy Support Vector Machine.

ELECTRON MICROSCOPIC 3D-RECONSTRUCTION OF MOUSE HIPPOCAMPAL PYRAMIDAL DENDRITIC SPINES

Topological Skeletonization and Tree-Summarization of Neurons Using Discrete Morse Theory

Neuron Image Segmentation via Learning Deep Features and Enhancing Weak Neuronal Structures

PointNeuron: 3D Neuron Reconstruction via Geometry and Topology Learning of Point Clouds

Frenet-Serret Frame-based Decomposition for Part Segmentation of 3D Curvilinear Structures

A Novel, Open-Source Virtual Reality Platform for Dendritic Spine Analysis

BX2S-Net: Learning to reconstruct 3D spinal structures from bi-planar X-ray images