Abstract:In the current age, human lifestyle has become more knowledge oriented leading to generation of sedentary employment. This has given rise to a number of health and mental disorders. Mental wellness is one of the most neglected but crucial aspects of today's world. Mental health issues can, both directly and indirectly, affect other sections of human physiology and impede an individual's day-to-day activities and performance. However, identifying the stress and finding the stress trend for an individual leading to serious mental ailments is challenging and involves multiple factors. Such identification can be achieved accurately by fusing these multiple modalities (due to various factors) arising from behavioral patterns. Certain techniques are identified in the literature for this purpose; however, very few machine learning-based methods are proposed for such multimodal fusion tasks. In this work, a multimodal AI-based framework is proposed to monitor a person's working behavior and stress levels. We propose a methodology for efficiently detecting stress due to workload by concatenating heterogeneous raw sensor data streams (e.g., face expressions, posture, heart rate, computer interaction). This data can be securely stored and analyzed to understand and discover personalized unique behavioral patterns leading to mental strain and fatigue. The contribution of this work is twofold; proposing a multimodal AI-based strategy for fusion to detect stress and its level and secondly identify a stress pattern over a period of time. We were able to achieve 96.09% accuracy on the test set in stress detection and classification. Further, we reduce the stress scale prediction model loss to 0.036 using these modalities. This work can prove important for the community at large, specifically those working sedentary jobs to monitor and identify stress levels, especially in current times of COVID-19.

EmoFit: Affect Monitoring System for Sedentary Jobs

Depression Analysis Using Face Recognition System

A Data Analytic End-to-end Framework for the Automated Quantification of Ergonomic Risk Factors Across Multiple Tasks Using a Single Wearable Sensor

An Activity Management System for Office Workers Using Multimodal Data

Robots as Mental Health Coaches: A Study of Emotional Responses to Technology-Assisted Stress Management Tasks Using Physiological Signals

SensEmo: Enabling Affective Learning through Real-time Emotion Recognition with Smartwatches

User stress detection in human-computer interactions

P-434 NEXT-GEN STRESS MANAGEMENT: AI’S REVOLUTIONARY ROLE IN WORKPLACE OCCUPATIONAL HEALTH

Wearable Healthcare Devices for Monitoring Stress and Attention Level in Workplace Environments

Employing Multimodal Machine Learning for Stress Detection

Prototype Smart Home Environment With Biofeedback

Emotion and Stress Recognition Utilizing Galvanic Skin Response and Wearable Technology: A Real-time Approach for Mental Health Care

Wearable Affective Life-Log System for Understanding Emotion Dynamics in Daily Life

Negative Emotion Management Using a Smart Shirt and a Robot Assistant

In-Situ exploration of emotion regulation via smart clothing: an empirical study of healthcare workers in their work environment

Emotion Detection Affected Soothing Device

Detecting Work Stress in Offices by Combining Unobtrusive Sensors

Dynamical systems modeling of day-to-day signal-based patterns of emotional self-regulation and stress spillover in highly-demanding health professions

An Affective Approach for Behavioral Performance Estimation and Induction

A framework of motion capture system based human behaviours simulation for ergonomic analysis

Unveiling productivity: The interplay of cognitive arousal and expressive typing in remote work