Abstract:Background: Multivariable analyses (MVA) and machine learning (ML) applied on large datasets may have a high potential to provide clinical decision support in neuro-otology and reveal further avenues for vestibular research. To this end, we build base-ml, a comprehensive MVA/ML software tool, and applied it to three increasingly difficult clinical objectives in differentiation of common vestibular disorders, using data from a large prospective clinical patient registry (DizzyReg). Methods: Base-ml features a full MVA/ML pipeline for classification of multimodal patient data, comprising tools for data loading and pre-processing; a stringent scheme for nested and stratified cross-validation including hyper-parameter optimization; a set of 11 classifiers, ranging from commonly used algorithms like logistic regression and random forests, to artificial neural network models, including a graph-based deep learning model which we recently proposed; a multi-faceted evaluation of classification metrics; tools from the domain of "Explainable AI" that illustrate the input distribution and a statistical analysis of the most important features identified by multiple classifiers. Results: In the first clinical task, classification of the bilateral vestibular failure (N = 66) vs. functional dizziness (N = 346) was possible with a classification accuracy ranging up to 92.5% (Random Forest). In the second task, primary functional dizziness (N = 151) vs. secondary functional dizziness (following an organic vestibular syndrome) (N = 204), was classifiable with an accuracy ranging from 56.5 to 64.2% (k-nearest neighbors/logistic regression). The third task compared four episodic disorders, benign paroxysmal positional vertigo (N = 134), vestibular paroxysmia (N = 49), Menière disease (N = 142) and vestibular migraine (N = 215). Classification accuracy ranged between 25.9 and 50.4% (Naïve Bayes/Support Vector Machine). Recent (graph-) deep learning models classified well in all three tasks, but not significantly better than more traditional ML methods. Classifiers reliably identified clinically relevant features as most important toward classification. Conclusion: The three clinical tasks yielded classification results that correlate with the clinical intuition regarding the difficulty of diagnosis. It is favorable to apply an array of MVA/ML algorithms rather than a single one, to avoid under-estimation of classification accuracy. Base-ml provides a systematic benchmarking of classifiers, with a standardized output of MVA/ML performance on clinical tasks. To alleviate re-implementation efforts, we provide base-ml as an open-source tool for the community.

Hybrid clustering system using Nystagmus parameters discrimination for vestibular disorder diagnosis.

Sparse classification of discriminant nystagmus features using combined video-oculography tests and pupil tracking for common vestibular disorder recognition

DBN-DNN: discrimination and classification of VNG sequence using deep neural network framework in the EMD domain

Nystagmus Signal Feature Extraction and Tracking for Diagnosis of the Vestibular System

Deep learning based torsional nystagmus detection for dizziness and vertigo diagnosis

Automatic Classification of the Vestibulo-Ocular Reflex Nystagmus: Integration of Data Clustering and System Identification

Machine learning method intervention: Determine proper screening tests for vestibular disorders

Digital biomarkers from gaze tests for classification of central and peripheral lesions in acute vestibular syndrome

Nystagmus patterns classification framework based on deep learning and optical flow

A nystagmus extraction system using artificial intelligence for video-nystagmography

Torsional nystagmus recognition based on deep learning for vertigo diagnosis

Vertical Nystagmus Recognition Based on Deep Learning

Automatic nystagmus detection and quantification in long-term continuous eye-movement data

Developing a Diagnostic Decision Support System for Benign Paroxysmal Positional Vertigo Using a Deep-Learning Model

Simultaneous Identification of Oculomotor Subsystems Using a Hybrid System Approach: Introducing Hybrid Extended Least Squares

Discrimination of vestibular function based on inertial sensors

Using Base-ml to Learn Classification of Common Vestibular Disorders on DizzyReg Registry Data

1D Convolutional Neural Networks for Detecting Nystagmus

Modern machine-learning can support diagnostic differentiation of central and peripheral acute vestibular disorders

Automated nystagmus detection: Accuracy of slow-phase and quick-phase algorithms to determine the presence of nystagmus

Machine learning models help differentiate between causes of recurrent spontaneous vertigo