Abstract:High-resolution three-dimensional brain image reconstruction is crucial for understanding the brain. Light sheet microscopy combined with tissue clearing imaging plays a pivotal role in analyzing the micro-level structure of mammalian brains. However, the complex multi-level stitching process poses challenges such as non-overlapping areas, surface deformation, and tissue loss, resulting in incomplete or discontinuous tissue structures at the junctions. These issues not only impact the precision of the atlas but also complicate subsequent analyses like cell counting and neuron tracing. To address these issues, we propose a rapid deep learning-based image inpainting approach for accurate neuron reconstruction and analysis. Our approach involves initially employing conventional registration algorithms to preliminarily stitch brain sections together, followed by utilizing a neural network to predict and restore missing tissue with a thickness exceeding 10 µm. This process enhances the structural continuity and integrity between adjacent brain slices. Compared to the original 3D U-Net and ResNet models, our approach performs better and has a processing speed that is five times faster than the original 3D U-Net. Moreover, our method enables more accurate cell counting by repairing incomplete cell bodies, leading to an average improvement of 37.37% in the number of cell bodies accurately counted near the slice junction. By integrating this novel 3D image inpainting network into brain reconstruction processes, our research opens new avenues for a more detailed and accurate investigation of neural circuitry and neurological disorders.

Slicenet: Slice-Wise 3D Shapes Reconstruction from Single Image

SliceNet: A Proficient Model for Real-Time 3D Shape-Based Recognition

Fast and Lightweight Network Improves Serial Brain Section Stitching

Slice3D: Multi-Slice, Occlusion-Revealing, Single View 3D Reconstruction

Conquering Data Variations in Resolution: A Slice-Aware Multi-Branch Decoder Network.

Three-Dimensional-Slice-Super-Resolution-Net: A Fast Few Shooting Learning Model for 3D Super-Resolution Using Slice-Up and Slice-Reconstruction

DeformNet: Free-Form Deformation Network for 3D Shape Reconstruction from a Single Image

Disentangling Deep Network for Reconstructing 3D Object Shapes from Single 2D Images

DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstruction

I³Net: Inter-Intra-Slice Interpolation Network for Medical Slice Synthesis

Learning To Reconstruct High-Quality 3d Shapes With Cascaded Fully Convolutional Networks

I3Net: Inter-Intra-slice Interpolation Network for Medical Slice Synthesis

I$^3$Net: Inter-Intra-slice Interpolation Network for Medical Slice Synthesis

Slicer Networks

SDF-SRN: Learning Signed Distance 3D Object Reconstruction from Static Images

High-Quality Textured 3D Shape Reconstruction with Cascaded Fully Convolutional Networks

Deep 3D Shape Reconstruction from Single-View Sketch Image

Shape Reconstruction of Object-Level Building From Single Image Based on Implicit Representation Network

One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization

DV-Net: Dual-view Network for 3D Reconstruction by Fusing Multiple Sets of Gated Control Point Clouds

3DFaceNet: Real-time Dense Face Reconstruction via Synthesizing Photo-realistic Face Images