Display-Based Visual Stimulus Design for Eliciting Steady-State Visual Evoked Potentials and Its Applications
Masaki Nakanishi,Yijun Wang,Yu-Te Wang,Tzyy-Ping Jung
2017-01-01
Abstract:Steady-state visual evoked potentials (SSVEPs) are brain’s electrical responses to repetitive visual stimulation. An efficient display-based visual stimulus design plays an important role to encode flexible information in the brain, leading to various applications based on SSVEPs. This paper shows recent advances in stimulus design for eliciting SSVEPs and its applications. INTRODUCTION Visual evoked potentials (VEPs) are time-locked electroencephalogram (EEG) responses to visual stimuli such as flashing light or sudden changes in image patterns [1]. They consist of positive and negative potential deflections in EEG signals observed in the occipital scalp area over or near the primary visual cortex. The VEPs elicited by transient stimuli are called transient VEPs (t-VEPs). In addition, continuous VEPs, which are called steady-state VEPs, can also be produced by using sinusoidally modulated repetitive visual stimulation. An SSVEP is known as photic driving responses characterized by a sinusoidal-like waveform at the stimulus frequency and its harmonics [2]. Since the frequency components in SSVEPs are nearly stationary in amplitude and phase over a long time period, the stimulus frequency can be reliably identified by observing the elicited SSVEPs in the frequency domain. Due to its robust characteristics, SSVEPs have been widely used in the field of visual neuroscience, ophthalmology, and neural engineering [1]. The visual stimulator plays an important role in the studies using SSVEPs [3]. Visual stimuli can be presented using flashing light-emitting diodes (LEDs) or flickers on a computer display. Since the stimulation parameters (e.g., the amount, color, pattern, size, and position of visual stimuli) can be flexibly configured, the display-based stimulation has attracted increasing attention. However, the number of frequencies that can be presented is always limited by the refresh rate of a display. In a conventional constant-period approach, the number of frames in a flickering period must be constant for each stimulating frequency. For example, a flicker at 10 Hz under 60 Hz refresh rate can be realized by 6 frames per period. On the other hand, a flicker at 11 Hz cannot be presented on a display with 60 Hz refresh rate since it requires 5.45 frames per period. In this way, it is impossible to realize the frequencies by which the refresh rate is not dividable. The approach proposed by Wang et al. (2010) can realize such flickering frequencies by approximating a frequency with a variable number of frames in a stimulating period [4]. For instance, an 11 Hz flicker can be realized by interleaving five and six frames in a period. Ideally, any frequencies up to half of the refresh rate can be presented on a display by this approach. The advances in display-based stimulus presentation opened the possibility of many new applications of SSVEPs. This paper first describes the details of the display-based stimulus presentation method and SSVEP analysis, and then introduces two applications developed in our previous study. One is a brain-computer interface (BCI) speller, which makes it possible to spell English letters without using normal output pathways [5, 6, 7]. The other is a portable BCI platform for assessing visual impairment in glaucoma patients [8]. Furthermore, future directions of SSVEP-based applications will be discussed. Methodology Display-Based Stimulus Presentation In conventional SSVEP-based BCIs using a computer display, a stimulating period of a visual flicker consists of a constant number of frames. For instance, the 10 Hz visual flicker under a 60 Hz refresh rate can be produced by reversing the stimulus pattern between white and black every three frames as ‘111000111000111000...’, where ‘1’ and ‘0’ represent white and black respectively. In this way, it is impossible to realize the frequencies by which the refresh rate is not dividable (e.g., an 11 Hz flicker under a 60 Hz refresh rate) because the white/black reversal should occur every 2.73 frames. The approach proposed by Wang et al. can realize such flickering frequencies by approximating a frequency with a variable number of frames in a stimulating period [4]. For instance, an 11 Hz flicker can be realized by interleaving five and six frames in a period as ‘1110001110011100011100111...’. In other words, an 11 Hz flicker can be approximated by mixing stimulating period of 10 Hz and 12 Hz, QBC reliably detected. The phase of SSVEPs φ f can be calculated by obtaining the angle of the complex values obtained by DFT: