Abstract:Purpose: Pupillary instability is a known risk factor for complications in cataract surgery. This study aims to develop and validate an innovative and reliable computational framework for the automated assessment of pupil morphologic changes during the various phases of cataract surgery. Design: Retrospective surgical video analysis. Subjects: Two hundred forty complete surgical video recordings, among which 190 surgeries were conducted without the use of pupil expansion devices (PEDs) and 50 were performed with the use of a PED. Methods: The proposed framework consists of 3 stages: feature extraction, deep learning (DL)-based anatomy recognition, and obstruction (OB) detection/compensation. In the first stage, surgical video frames undergo noise reduction using a tensor-based wavelet feature extraction method. In the second stage, DL-based segmentation models are trained and employed to segment the pupil, limbus, and palpebral fissure. In the third stage, obstructed visualization of the pupil is detected and compensated for using a DL-based algorithm. A dataset of 5700 intraoperative video frames across 190 cataract surgeries in the BigCat database was collected for validating algorithm performance. Main outcome measures: The pupil analysis framework was assessed on the basis of segmentation performance for both obstructed and unobstructed pupils. Classification performance of models utilizing the segmented pupil time series to predict surgeon use of a PED was also assessed. Results: An architecture based on the Feature Pyramid Network model with Visual Geometry Group 16 backbone integrated with the adaptive wavelet tensor feature extraction feature extraction method demonstrated the highest performance in anatomy segmentation, with Dice coefficient of 96.52%. Incorporation of an OB compensation algorithm improved performance further (Dice 96.82%). Downstream analysis of framework output enabled the development of a Support Vector Machine-based classifier that could predict surgeon usage of a PED prior to its placement with 96.67% accuracy and area under the curve of 99.44%. Conclusions: The experimental results demonstrate that the proposed framework (1) provides high accuracy in pupil analysis compared with human-annotated ground truth, (2) substantially outperforms isolated use of a DL segmentation model, and (3) can enable downstream analytics with clinically valuable predictive capacity. Financial disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Automatic Tracking of Pupillary Dynamics from in Vivo Functional Optical Coherence Tomography Images

Pupil Tracking for Real-Time Motion Corrected Anterior Segment Optical Coherence Tomography

Optical phase modulation by natural eye movements: application to time-domain FF-OCT image retrieval

Non-Invasive Eye Tracking Technology Based on Corneal Reflex

Assessment of Full-Eye Response to Osmotic Stress in Mouse Model in Vivo Using Optical Coherence Tomography

Depth-resolved Transverse-Plane Motion Tracking with Configurable Measurement Features Via Optical Coherence Tomography.

Improvements to strip-based digital image registration for robust eye-tracking and to minimize distortions in images from scanned ophthalmic imaging systems

Characterization and Analysis of Retinal Axial Motion at High Spatiotemporal Resolution and Its Implication for Real-Time Correction in Human Retinal Imaging

Pulsatile Retinal Nerve Fiber Layer Imaging with Functional Optical Coherence Tomography

High dynamic range 3D motion tracking based on circular scan with optical coherence tomography

Tracking features in retinal images of adaptive optics confocal scanning laser ophthalmoscope using KLT-SIFT algorithm

Curved-Full-Field OCT for high-resolution imaging of living human retina over a large field-of-view

High-resolution in-vivo human retinal imaging using full-field OCT with optical stabilization of axial motion

Touchless short-wave infrared imaging for dynamic rapid pupillometry and gaze estimation in closed eyes

Adaptive contour-tracking to aid wide-field swept-source optical coherence tomography imaging of large objects with uneven surface topology

Noise-compensated Homotopic Non-Local Regularized Reconstruction for Rapid Retinal Optical Coherence Tomography Image Acquisitions

Automatic focus method using interference fringes magnitudes in retinal optical coherence tomography

A Computational Framework for Intraoperative Pupil Analysis in Cataract Surgery

Automatic biometry of the anterior segment during accommodation imaged by optical coherence tomography

Phase-Restoring Subpixel Image Registration: Enhancing Motion Detection Performance in Fourier-domain Optical Coherence Tomography

In vivo high resolution human retinal imaging with wavefront correctionless full-field OCT