Abstract:In the current age, human lifestyle has become more knowledge oriented leading to generation of sedentary employment. This has given rise to a number of health and mental disorders. Mental wellness is one of the most neglected but crucial aspects of today's world. Mental health issues can, both directly and indirectly, affect other sections of human physiology and impede an individual's day-to-day activities and performance. However, identifying the stress and finding the stress trend for an individual leading to serious mental ailments is challenging and involves multiple factors. Such identification can be achieved accurately by fusing these multiple modalities (due to various factors) arising from behavioral patterns. Certain techniques are identified in the literature for this purpose; however, very few machine learning-based methods are proposed for such multimodal fusion tasks. In this work, a multimodal AI-based framework is proposed to monitor a person's working behavior and stress levels. We propose a methodology for efficiently detecting stress due to workload by concatenating heterogeneous raw sensor data streams (e.g., face expressions, posture, heart rate, computer interaction). This data can be securely stored and analyzed to understand and discover personalized unique behavioral patterns leading to mental strain and fatigue. The contribution of this work is twofold; proposing a multimodal AI-based strategy for fusion to detect stress and its level and secondly identify a stress pattern over a period of time. We were able to achieve 96.09% accuracy on the test set in stress detection and classification. Further, we reduce the stress scale prediction model loss to 0.036 using these modalities. This work can prove important for the community at large, specifically those working sedentary jobs to monitor and identify stress levels, especially in current times of COVID-19.

An Unobtrusive Stress Recognition System For The Smart Office

An Activity Management System for Office Workers Using Multimodal Data

Detecting Work Stress in Offices by Combining Unobtrusive Sensors

A Privacy-Preserving and Unobtrusive Sitting Posture Recognition System Via Pressure Array Sensor and Infrared Array Sensor for Office Workers

Mmstress

Mmstress: Distilling Human Stress from Daily Activities Via Contact-less Millimeter-wave Sensing

Estimating Stress in Online Meetings by Remote Physiological Signal and Behavioral Features.

Stress Recognition Using Non-invasive Technology

A Framework of Real-Time Stress Monitoring and Intervention System

P-434 NEXT-GEN STRESS MANAGEMENT: AI’S REVOLUTIONARY ROLE IN WORKPLACE OCCUPATIONAL HEALTH

Privacy-preserving Activity Recognition Using Multimodal Sensors in Smart Office

Non-contact Measurement of Mental Stress Via Heart Rate Variability

User stress detection in human-computer interactions

Wearable EEG-Based Brain–Computer Interface for Stress Monitoring

Stress Detection through Wrist-based Electrodermal Activity Monitoring and Machine Learning

EEG Based Stress Monitoring

Emotion and Stress Recognition Utilizing Galvanic Skin Response and Wearable Technology: A Real-time Approach for Mental Health Care

Real Time Worker Stress Prediction in a Smart Factory Assembly Line

A Deep Learning-Based Platform for Workers' Stress Detection Using Minimally Intrusive Multisensory Devices

Employing Multimodal Machine Learning for Stress Detection

Is your mouse attracted by your eyes: Non-intrusive stress detection in off-the-shelf desktop environments