Abstract:Events are fundamental for understanding how people experience their lives. It is challenging, however, to automatically record all events in daily life. An understanding of multimedia signals allows recognizing events of daily living and getting their attributes as automatically as possible. In this paper, we consider the problem of recognizing a daily event by employing the commonly used multimedia data obtained from a smartphone and wearable device. We develop an unobtrusive approach to obtain latent semantic information from the data, and therefore an approach for daily event recognition based on semantic context enrichment. We represent the enrichment process through an event knowledge graph that semantically enriches a daily event from a low-level daily activity. To show a concrete example of this enrichment, we perform an experiment with eating activity, which may be one of the most complex events, by using 14 months of data for three users. In this process, to unobtrusively complement the lack of semantic information, we suggest a new food recognition/classification method that focuses only on a physical response to food consumption. Experimental results indicate that our approach is able to show automatic abstraction of life experience. These daily events can then be used to create a personal model that can capture how a person reacts to different stimuli under specific conditions.

Daily Life Event Segmentation for Lifestyle Evaluation Based on Multi-Sensor Data Recorded by a Wearable Device

A Wearable Health Monitoring System with Multi-Parameters

Analysis of Personal Life Patterns Using Accelerometer-Based Wearable Devices

SmartCare: Energy-efficient Long-Term Physical Activity Tracking Using Smartphones

An Activity Management System for Office Workers Using Multimodal Data

A Study of College Students' Lifestyle Regularity Based on Wearable Devices and Deep Learning.

Real-Time Physical Activity Classification And Tracking Using Wearble Sensors

Detecting Events of Daily Living Using Multimodal Data

Detection Of Activities By Wireless Sensors For Daily Life Surveillance: Eating And Drinking

Scalable Mining of Daily Behavioral Patterns in Context Sensing Life-Log Data

Unsupervised Machine Learning Identifies Latent Ultradian States in Multi-Modal Wearable Sensor Signals

An Adaptive Hidden Markov Model for Activity Recognition Based on a Wearable Multi-Sensor Device

Do You Live a Healthy Life? Analyzing Lifestyle by Visual Life Logging

Automatic video analysis and motion estimation for physical activity classification

Unsupervised Human Activity Segmentation Applying Smartphone Sensor for Healthcare.

Pervasive Health Monitor And Analysis Based On Multi-Parameter Smart Armband

Daily Physical Activity Monitoring -- Adaptive Learning from Multi-source Motion Sensor Data

An exploratory study on a chest-worn computer for evaluation of diet, physical activity and lifestyle.

Evaluating Children’s Engagement Through Wrist-worn Biosensors and LSTM Network

A Household Multimodal Physiological Signals Monitoring System

A Single Smartwatch-Based Segmentation Approach in Human Activity Recognition