Abstract:Visual fatigue evaluation plays an important role in applications such as virtual reality since the visual fatigue symptoms always affect the user experience seriously. Existing visual evaluation methods require hand-crafted features for classification, and conduct feature extraction and classification in a separated manner. In this paper, we conduct a designed experiment to collect electroencephalogram (EEG) signals of various visual fatigue levels, and present a multi-scale convolutional neural network (CNN) architecture named MorletInceptionNet to detect visual fatigue using EEG as input, which exploits the spatial-temporal structure of multichannel EEG signals. Our MorletInceptionNet adopts a joint space-time-frequency features extraction scheme in which Morlet wavelet-like kernels are used for time-frequency raw feature extraction and inception architecture are further used to extract multi-scale temporal features. Then, the multi-scale temporal features are concatenated and fed to the fully connected layer for visual fatigue evaluation using classification. In experiment evaluation, we compare our method with five state-of-the-art methods, and the results demonstrate that our model achieve overally the best performance better performance for two widely used evaluation metrics, i.e., classification accuracy and kappa value. Furthermore, we use input-perturbation network-prediction correlation maps to conduct in-depth analysis into the reason why the proposed method outperforms other methods. The results suggest that our model is sensitive to the perturbation of β (14–30 Hz) and γ (30–40 Hz) bands. Furthermore, their spatial patterns are of high correlation with that of the corresponding power spectral densities which are used as evaluation features traditionally. This finding provides evidence of the hypothesis that the proposed model can learn the joint time-frequency-space features to distinguish fatigue levels automatically.

Assessment visual fatigue of watching 3DTV using EEG power spectral parameters.

Electrocardiograph Based Comparative Evaluation of Visual Fatigue on 3d Real Objects Versus Stereoscopic Tv

Evaluation of Visual Fatigue Caused by 3D Display

EEG-Based Assessment of Stereoscopic 3D Visual Fatigue Caused by Vergence-Accommodation Conflict

Visual Fatigue Evaluation of Stereoscopic Display Based on Heart Rate Asymmetry and Ordinal Pattern Statistics

Study of Objective Parameters of 3D Visual Fatigue Based on Analysis of Salient Area.

Visual Fatigue Measurement of Display Mode Based on ECG and Eye Movement Signal

Investigate the 3D Visual Fatigue Using Modified Depth-Related Visual Evoked Potential Paradigm.

Investigating the neural activity of various 3D visual fatigue degrees using depth‐related visual evoked potentials

Eye Fatigue Assessment Method for Naked Eye 3D Display Based on Multiple Eye Movements

Study of Electroencephalography-Based Objective Stereoscopic Visual Fatigue Evaluation

Subjective and Objective Evaluation of Visual Fatigue on Viewing 3d Display Continuously

Evaluating 3D Visual Fatigue Induced by VR Headset Using EEG and Self-attention CNN

Investigation of Visual Fatigue Caused by 2D/3D Display under Different Illuminations

Characteristic Analysis of Malaise Caused by Viewing 3D Videos Based on EEG Power Spectrum

Visual Fatigue Evaluation Based on Depth in 3d Videos

Study of objective evaluation indicators of 3D visual fatigue based on RDS related tasks

11.4: Study on the Saccadic Eye Movement Metric of Visual Fatigue Induced By 3D Displays

Objective Evaluation of 3d Visual Fatigue Based on Rds Related Tasks

Using Electroencephalogram Spectral Components to Assess Visual Fatigue Caused by Sustained Prism-Induced Diplopia.

EEG-Based 3D Visual Fatigue Evaluation Using CNN