GCTransNet: 3D mitochondrial instance segmentation based on Global Context Vision Transformers

Chaoyi Chen,Yidan Yan,Jingpeng Wu,Wen-Biao Gan
DOI: https://doi.org/10.1101/2024.11.06.622389
2024-11-08
Abstract:Mitochondria are a double membrane-bound organelles essential for generating energy in eukaryotic cells. Mitochondria can be readily visualized in 3D using volume Electron Microscopy (vEM), and accurate image segmentation is vital for quantitative analysis of mitochondrial morphology and function. To address the challenge of segmenting small mitochondrial compartments in vEM images, we propose an automated mitochondrial segmentation method called GCTransNet. This method employs grayscale migration technology to preprocess images, effectively reducing intensity distribution differences across EM images. By utilizing 3D Global Context Vision Transformers (GC-ViT) combined with global context self-attention modules and local self-attention modules, GCTransNet precisely models long-range and short-range spatial interactions. The 3D U-Net network's encoder is replaced with 3D GC-ViT, leveraging shifted window calculations for self-attention. In the MitoEM mitochondrial segmentation challenge, GCTransNet achieved state-of-the-art results, significantly outperforming existing methods, demonstrating its superiority in automated mitochondrial segmentation. The code and its documentation are publicly available at https://github.com/GanLab123/GCTransNet.
Cell Biology
What problem does this paper attempt to address?