Abstract:Background: Nystagmus identification and interpretation is challenging for non-experts who lack specific training in neuro-ophthalmology or neuro-otology. This challenge is magnified when the task is performed via telemedicine. Deep learning models have not been heavily studied in video-based eye movement detection. Methods: We developed, trained, and validated a deep-learning system (aEYE) to classify video recordings as normal or bearing at least two consecutive beats of nystagmus. The videos were retrospectively collected from a subset of the monocular (right eye) video-oculography (VOG) recording used in the Acute Video-oculography for Vertigo in Emergency Rooms for Rapid Triage (AVERT) clinical trial (#NCT02483429). Our model was derived from a preliminary dataset representing about 10% of the total AVERT videos ( n = 435). The videos were trimmed into 10-sec clips sampled at 60 Hz with a resolution of 240 × 320 pixels. We then created 8 variations of the videos by altering the sampling rates (i.e., 30 Hz and 15 Hz) and image resolution (i.e., 60 × 80 pixels and 15 × 20 pixels). The dataset was labeled as "nystagmus" or "no nystagmus" by one expert provider. We then used a filtered image-based motion classification approach to develop aEYE. The model's performance at detecting nystagmus was calculated by using the area under the receiver-operating characteristic curve (AUROC), sensitivity, specificity, and accuracy. Results: An ensemble between the ResNet-soft voting and the VGG-hard voting models had the best performing metrics. The AUROC, sensitivity, specificity, and accuracy were 0.86, 88.4, 74.2, and 82.7%, respectively. Our validated folds had an average AUROC, sensitivity, specificity, and accuracy of 0.86, 80.3, 80.9, and 80.4%, respectively. Models created from the compressed videos decreased in accuracy as image sampling rate decreased from 60 Hz to 15 Hz. There was only minimal change in the accuracy of nystagmus detection when decreasing image resolution and keeping sampling rate constant. Conclusion: Deep learning is useful in detecting nystagmus in 60 Hz video recordings as well as videos with lower image resolutions and sampling rates, making it a potentially useful tool to aid future automated eye-movement enabled neurologic diagnosis.

Nystagmus patterns classification framework based on deep learning and optical flow

Deep learning based torsional nystagmus detection for dizziness and vertigo diagnosis

Torsional nystagmus recognition based on deep learning for vertigo diagnosis

A nystagmus extraction system using artificial intelligence for video-nystagmography

Deep Learning-Based Nystagmus Detection for BPPV Diagnosis

Sparse classification of discriminant nystagmus features using combined video-oculography tests and pupil tracking for common vestibular disorder recognition

Nystagmus Signal Feature Extraction and Tracking for Diagnosis of the Vestibular System

A Deep-Learning Model for 3d Nystagmus Detection and its Primary Application

A Deep Learning Model for Three-Dimensional Nystagmus Detection and Its Preliminary Application

Vertical Nystagmus Recognition Based on Deep Learning

Gram-based Attentive Neural Ordinary Differential Equations Network for Video Nystagmography Classification

1D Convolutional Neural Networks for Detecting Nystagmus

Multimodal deep learning-based diagnostic model for BPPV

[Video Head Impulse Test for Evaluation of Vestibular Function in Patients with Vestibular Neuritis and Benign Paroxysmal Positional Vertigo].

aEYE: A deep learning system for video nystagmus detection

DBN-DNN: discrimination and classification of VNG sequence using deep neural network framework in the EMD domain

Developing a Diagnostic Decision Support System for Benign Paroxysmal Positional Vertigo Using a Deep-Learning Model

Diagnosing the benign paroxysmal positional vertigo via 1D and deep-learning composite model

Hybrid clustering system using Nystagmus parameters discrimination for vestibular disorder diagnosis.

Automatic Classification of the Vestibulo-Ocular Reflex Nystagmus: Integration of Data Clustering and System Identification