Contactless measurement of stress, its determinants, and consequences
Robert Richer,Nicolas Rohleder,Robert Richer
DOI: https://doi.org/10.1016/j.psyneuen.2023.106752
IF: 4.693
2024-02-01
Psychoneuroendocrinology
Abstract:Stress and its determinants and consequences are well-studied both in laboratory experiments and in the field. Traditional methods for stress assessment include blood- and saliva-based biomarkers such as cortisol, alpha- amylase, and inflammation markers, electrophysiological measurements, such as electrocardiography and electrodermal activity, and self-reports. While these markers have enabled us to understand the body’s response to stress, they also limit the further development of the field of Psychoneuroendocrinology. The currently available traditional assessment methods require a high effort for researchers while concurrently imposing a high burden on the individual. The measurement of these markers is often invasive, at best non-invasive, but, so far, not contactless. In addition, they can only be scaled up to a limited extent in terms of repeated administration, and can only be used to their full extent in the laboratory. Although modern technologies such as smartphones and wearable sensors provide solutions for the collection of self-reported data and certain electrophysiological parameters in the field, the quality of the data obtained is often not adequate. Another major drawback of the methods available so far is that measurements on humans are not possible without influencing the individual - and thus simultaneously interfering with the course of the situation. The prospect of contactless stress assessment has become increasingly attractive and feasible in the context of emerging technological advancements. Contactless sensing techniques, combined with sophisticated signal processing and machine learning algorithms, have the potential for a less-invasive approach to stress assessment that can be conducted remotely and without physical contact. Contactless stress assessment can be achieved by observing changes on the surface of the human body in various scales. On the one hand, macroscopic movements, which include changes in facial expressions, body posture and movements, are often expressions of human emotions. Thus, they can potentially be used for stress detection as certain human emotions, such as threat and shame are causally related to the cortisol stress response. On the other hand, microscopic movements, as they are induced by heartbeat and respiration, can be used to assess the stress response of the autonomic nervous system. These movement-based markers can be complemented by other contactless markers such as voice and speech information, which have also been shown to be promising candidates for the prediction of stress responses. To promote these technological advancements in the field of Psychoneuroendocrinology, this international and interdisciplinary symposium will give examples of recent studies that investigated the contactless assessment of stress, its determinants, and consequences in healthy participants and patients with mental disorders. The symposium will start with Luca Abel who will show that bodily freezing is an observable response to acute psychosocial stress and is related to the cortisol response. In the present study, body posture and movements were assessed by an inertial sensor-based motion capture suit that participants were equipped with during the Trier Social Stress Test (TSST), and the friendly-TSST (f-TSST) on two consecutive days. Hanna Drimalla will report on the video-based measurement of subjective, observable and biological stress responses. Their contactless stress assessment approach is based on machine learning models trained on facial expressions and voice parameters extracted from video data acquired during the TSST. Katharina Schultebraucks will investigate the contactless assessment of long-term stress consequences. She will talk about digital biomarkers, extracted from visual and auditory information, and how they can be used for the diagnostic assessment of stress pathologies. As a discussant, Nicolas Rohleder will discuss the previously presented results and will also give an insight into the collaborative research center "EmpkinS", which is funded by the German Research Foundation and is investigating novel, radar- and camera-based sensor technologies for the contactless measurement of physical and mental states.
neurosciences,endocrinology & metabolism,psychiatry