Abstract:Objective: Corneal disease is one of the main causes of blindness for humans globally nowadays, and deep anterior lamellar keratoplasty (DALK) is a widely applied technique for corneal transplantation. However, the position of stitch points highly influences the success rate of such surgery, which would require accurate control and manipulation of surgical instruments. Methods: In this paper, we present a deep learning framework for augmented reality (AR) based surgery navigation to guide the suturing in DALK. It can robustly track the excised corneal contour by semantic segmentation and the reconstruction of occlusion. We propose a novel optical flow inpainting network to recover the missing motion caused by occlusion. The occluded regions are detected by weakly supervised segmentation of surgical instruments and reconstructed by key frame warping along the completed optical flow. Then we introduce two types of loss function to adapt the inpainting network in the optical flow space. Results: Our techniques are tested and evaluated by a number of real surgery videos from Shandong Eye Hospital in China. We compare our approaches with other typical methods in the corneal contour segmentation, optical flow inpainting and occlusion regions reconstruction. The tracking accuracy reachs 99.2% in average and PSNR reaches 25.52 for the reconstruction of the occluded frames. Conclusion: From the experimental evaluations and user study, both the qualitative and quantitative results indicate that our techniques can achieve accurate detection and tracking of corneal contour under complex disturbance in real-time surgical scenes. Our prototype AR navigation system would be highly useful in clinical practice.

A Novel Edge Tracking Approach for Cornea in Optical Coherence Tomography Anterior Chamber Images

Anterior chamber OCT images edge detection and extraction of feature corner points

Improved Sparse Representation Algorithm for Optical Coherence Tomography Images

Automatic Measurement of Central Cornea Thickness of Eye Anterior Segment Optical Coherence Tomography Image

A Fast Algorithm for Automatic Detection of Anterior Chamber Angle Points and Measurement of Central Corneal Thickness for Anterior Chamber OCT Images

AUTOMATED EXTRACTION OF THE INNER CONTOUR OF THE ANTERIOR CHAMBER USING OPTICAL COHERENCE TOMOGRAPHY IMAGES

Multi-Scale Morphologic Weak Edge Detection In Anterior Chamber Oct Images Based On Information Entropy Fusion

Real-time segmentation and tracking of excised corneal contour by deep neural networks for DALK surgical navigation

Three-Dimensional In Vivo Imaging Of Human Anterior Eye Segment With Optical Coherence Tomography

A Dynamic Wavelet Filtering for Anterior Chamber Optical Coherence Tomographic Images

Automatic phase-based edge detection of corneal Sheimpflug images

A dynamic threshold segmentation algorithm for anterior chamber OCT images based on wavelet transform

Reconstruction and Quantification of 3D Iris Surface for Angle-Closure Glaucoma Detection in Anterior Segment OCT

A Dynamic Threshold Edge-Preserving Smoothing Segmentation Algorithm for Anterior Chamber OCT Images Based on Modified Histogram

Automatic Anterior Chamber Angle Classification Using Deep Learning System and Anterior Segment Optical Coherence Tomography Images

Deep Learning Algorithms to Isolate and Quantify the Structures of the Anterior Segment in Optical Coherence Tomography Images

Inpainting Saturation Artifact in Anterior Segment Optical Coherence Tomography

Morphologic weak edge detection by multi-structure and multi-scale in anterior chamber OCT images

A compound segmentation algorithm for anterior chamber angle in OCT image

New algorithm for corneal densitometry assessment based on anterior segment optical coherence tomography

A sampling-based subband adaptive algorithm for speckle noise reduction of Optical Coherence Tomographic anterior chamber of eyeball images