Abstract:Background: Automatic segmentation of corneal stromal cells can assist ophthalmologists to detect abnormal morphology in confocal microscopy images, thereby assessing the virus infection or conical mutation of corneas, and avoiding irreversible pathological damage. However, the corneal stromal cells often suffer from uneven illumination and disordered vascular occlusion, resulting in inaccurate segmentation. Methods: In response to these challenges, this study proposes a novel approach: a nnUNet and nested Transformer-based network integrated with dual high-order channel attention, named U-NTCA. Unlike nnUNet, this architecture allows for the recursive transmission of crucial contextual features and direct interaction of features across layers to improve the accuracy of cell recognition in low-quality regions. The proposed methodology involves multiple steps. Firstly, three underlying features with the same channel number are sent into an attention channel named g n Conv to facilitate higher-order interaction of local context. Secondly, we leverage different layers in U-Net to integrate Transformer nested with g n Conv , and concatenate multiple Transformers to transmit multi-scale features in a bottom-up manner. We encode the downsampling features, corresponding upsampling features, and low-level feature information transmitted from lower layers to model potential correlations between features of varying sizes and resolutions. These multi-scale features play a pivotal role in refining the position information and morphological details of the current layer through recursive transmission. Results: Experimental results on a clinical dataset including 136 images show that the proposed method achieves competitive performance with a Dice score of 82.72% and an AUC (Area Under Curve) of 90.92%, which are higher than the performance of nnUNet. Conclusion: The experimental results indicate that our model provides a cost-effective and high-precision segmentation solution for corneal stromal cells, particularly in challenging image scenarios.

Unsupervised corneal contour extraction algorithm with shared model for dynamic deformation videos: improving accuracy and noise resistance

Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full and Annotations

Real-time segmentation and tracking of excised corneal contour by deep neural networks for DALK surgical navigation

Artificial Intelligence–Based Diagnostic Model for Detecting Keratoconus Using Videos of Corneal Force Deformation

Cascade spatial and channel-wise multifusion network with criss cross augmentation for corneal segmentation and reconstruction

Neighborhood Aided Implicit Active Contours

Learning an Occlusion-Aware Network for Video Deblurring

Deep contour attention learning for scleral deformation from OCT images

Localized Corneal Biomechanical Alteration Detected In Early Keratoconus Based on Corneal Deformation Using Artificial Intelligence

DefCor-Net: Physics-Aware Ultrasound Deformation Correction

Self-Supervised Cyclic Diffeomorphic Mapping for Soft Tissue Deformation Recovery in Robotic Surgery Scenes

Clean visual field reconstruction in robot-assisted laparoscopic surgery based on dynamic prediction

Deep learning for identifying corneal diseases from ocular surface slit-lamp photographs

Multiview Volume and Temporal Difference Network for Angle-Closure Glaucoma Screening from AS-OCT Videos

Postoperative facial prediction for mandibular defect based on surface mesh deformation

Learning spatial-temporal deformable networks for unconstrained face alignment and tracking in videos

A deep transfer learning framework for the automated assessment of corneal inflammation on in vivo confocal microscopy images

U-NTCA: nnUNet and nested transformer with channel attention for corneal cell segmentation

Convolutional Neural Network-Based Speckle Tracking for Ultrasound Strain Elastography: an Unsupervised Learning Approach.

Towards Better Surgical Instrument Segmentation in Endoscopic Vision: Multi-Angle Feature Aggregation and Contour Supervision

Centerline extraction by neighborhood-statistics thinning for quantitative analysis of corneal nerve fibers