Applying software‐defined ambient intelligence techniques for cognitive and emotional awareness in the Internet of Things

Salman Azeez Syed,Ishita Nag,Shreya Basu,Deepak Kumar Sharma
DOI: https://doi.org/10.1002/dac.5649
2023-10-23
International Journal of Communication Systems
Abstract:This paper presents a lightweight AI application based on SDN to improve cognitive and emotional awareness for potential integration into ambient intelligent smart home systems. It processes network packets to extract RTP messages and works on audio packets via an MLP‐based SER model while employing a confidence rating system to amortize false positives. This paper incorporates HCI in a step towards complete automation by giving simple AI emotional understanding, which is simple yet powerful. Summary Smart "discrete" technologies are taking over everyday activities with an intended shift towards complete automation. With this, ambient intelligence (AmI) has come under the limelight, to make these routines subtle and automated, enabled through the widespread adoption of the ubiquitous and pervasive Internet of Things (IoT). AmI is context‐driven depending largely on user input through various interfaces, which is nothing but the interplay between IoT and artificial intelligence (AI). Despite extensive incorporation of personal digital assistants and smart home systems, AI is not yet capable of accurately interpreting and responding to human emotions. This paper aims to present one such application to gauge the emotional and cognitive state of the user and respond appropriately, be it ambient lighting or an emergency SOS. The proposed model extracts network packets to work with audio messages on the real‐time transport protocol (RTP) layer and presents a lightweight multilayer perceptron (MLP)‐based speech emotion recognition (SER) model for emotional analysis with an accuracy of 80.52%. It also features a simple confidence rating system for further optimization.
telecommunications,engineering, electrical & electronic
What problem does this paper attempt to address?