Abstract:Since sleep plays an important role in people's daily lives, sleep monitoring has attracted the attention of many researchers. Physical and physiological activities occurring in sleep exhibit unique patterns in different sleep stages. It indicates that recognizing a wide range of sleep activities (events) can provide more fine-grained information for sleep stage detection. However, most of the prior works are designed to capture limited sleep events and coarse-grained information, which cannot meet the needs of fine-grained sleep monitoring. In our work, we leverage ubiquitous in-ear microphones on sleep earbuds to design a sleep monitoring system, named EarSleep1, which interprets in-ear body sounds induced by various representative sleep events into sleep stages. Based on differences among physical occurrence mechanisms of sleep activities, EarSleep extracts unique acoustic response patterns from in-ear body sounds to recognize a wide range of sleep events, including body movements, sound activities, heartbeat, and respiration. With the help of sleep medicine knowledge, interpretable acoustic features are derived from these representative sleep activities. EarSleep leverages a carefully designed deep learning model to establish the complex correlation between acoustic features and sleep stages. We conduct extensive experiments with 48 nights of 18 participants over three months to validate the performance of our system. The experimental results show that our system can accurately detect a rich set of sleep activities. Furthermore, in terms of sleep stage detection, EarSleep outperforms state-of-the-art solutions by 7.12% and 9.32% in average precision and average recall, respectively.

Voice activity detection and wake-up method and device

A Novel and Efficient Voice Activity Detector Using Shape Features of Speech Wave.

<i>FakeWake</i>: Understanding and Mitigating Fake Wake-up Words of Voice Assistants

Monophone-Based Background Modeling for Two-Stage On-Device Wake Word Detection

Low Bits: Binary Neural Network for Vad and Wakeup

Robust Wake-Up Word Detection by Two-stage Multi-resolution Ensembles

A Robust, Real-Time Voice Activity Detection Algorithm for Embedded Mobile Devices.

Wavoice: A mmWave-assisted Noise-resistant Speech Recognition SystemJust Accepted

Wake Word Detection Based on Res2Net

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System.

Deep Belief Networks Based Voice Activity Detection

DNN-based Voice Activity Detection for Speaker Recognition

Wake-up-word Spotting Using End-to-end Deep Neural Network System.

End-to-End Speaker-Dependent Voice Activity Detection

An Ultra-low Power RNN Classifier for Always-On Voice Wake-Up Detection Robust to Real-World Scenarios

EarSleep: In-ear Acoustic-based Physical and Physiological Activity Recognition for Sleep Stage Detection

Wake Word Detection with Alignment-Free Lattice-Free MMI.

Efficient voice activity detection algorithm based on sub-band temporal envelope and sub-band long-term signal variability

Low Frequency Ultrasonic Voice Activity Detection Using Convolutional Neural Networks.

A 510-nW Wake-Up Keyword-Spotting Chip Using Serial-FFT-Based MFCC and Binarized Depthwise Separable CNN in 28-nm CMOS