Abstract:Multi-modal bio-sensing has recently been used as effective research tools in affective computing, autism, clinical disorders, and virtual reality among other areas. However, none of the existing bio-sensing systems support multi-modality in a wearable manner outside well-controlled laboratory environments with research-grade measurements. This paper attempts to bridge this gap by developing a wearable multi-modal bio-sensing system capable of collecting, synchronizing, recording, and transmitting data from multiple bio-sensors: PPG, EEG, eye-gaze headset, body motion capture, GSR, etc., while also providing task modulation features including visual-stimulus tagging. This study describes the development and integration of various components of our system. We evaluate the developed sensors by comparing their measurements to those obtained by a standard research-grade bio-sensors. We first evaluate different sensor modalities of our headset, namely, earlobe-based PPG module with motion-noise canceling for ECG during heart-beat calculation. We also compare the steady-state visually evoked potentials measured by our shielded dry EEG sensors with the potentials obtained by commercially available dry EEG sensors. We also investigate the effect of head movements on the accuracy and precision of our wearable eye-gaze system. Furthermore, we carry out two practical tasks to demonstrate the applications of using multiple sensor modalities for exploring previously unanswerable questions in bio-sensing. Specifically, utilizing bio-sensing, we show which strategy works best for playing "Where is Waldo?" visual-search game, changes in EEG corresponding to true vs. false target fixations in this game, and predicting the loss/draw/win states through bio-sensing modalities while learning their limitations in a "Rock-Paper-Scissors" game.

Soft, wireless periocular wearable electronics for real-time detection of eye vergence in a virtual reality toward mobile eye therapies

An Intelligent Triboelectric Sensing System for Monitoring and Early Warning of Dry Eye Syndrome

Simple Wearable Eye Tracker With Mini-Infrared Point Sensors

Advances in Materials, Sensors, and Integrated Systems for Monitoring Eye Movements

Eye-Tracking Monitoring Based on PMUT Arrays

A Flexible Wearable Electrooculogram System With Motion Artifacts Sensing and Reduction

Automated Non‐Supervised Eye Disorder Screening System Using Virtual Reality

A Wearable Wireless Magnetic Eye-Tracker, in-vitro and in-vivo Tests

Interpreting the Visual Acuity of the Human Eye with Wearable EEG Device and SSVEP

Tracking Eye Movement Using a Composite Magnet

Multi-functional, conformal systems with ultrathin crystalline-silicon-based bioelectronics for characterization of intraocular pressure and ocular surface temperature

A Wearable Multi-Modal Bio-Sensing System Towards Real-World Applications

Eye-Tracking Aided VR System for Amblyopic Pediatric Treatment Difficulty Adjustment

3D Printed, Customizable, and Multifunctional Smart Electronic Eyeglasses for Wearable Healthcare Systems and Human-Machine Interfaces

Neuroergonomic Solutions in AR and VR Applications

Development of a Magnetoresistive-Based Wearable Eye-Tracking System for Oculomotor Assessment in Neurological and Otoneurological Research—Preliminary In Vivo Tests

Slim and robust eye tracker on eyeglass temples with NIR patterned mirrors

Strain‐Isolating Materials and Interfacial Physics for Soft Wearable Bioelectronics and Wireless, Motion Artifact‐Controlled Health Monitoring

Eye tracking and eye expression decoding based on transparent, flexible and ultra-persistent electrostatic interface

Wireless Soft Scalp Electronics and Virtual Reality System for Motor Imagery-Based Brain-Machine Interfaces

Primate eye tracking with carbon-nanotube-paper-composite based capacitive sensors and machine learning algorithms