Abstract:In the quest for human-robot interaction (HRI), leading to the development of emotion recognition, learning, and analysis capabilities, robotics plays a significant role in human perception, attention, decision-making, and social communication. However, the accurate recognition of emotions in HRI remains a challenge. This is due to the coexistence of multiple sources of information in utilizing multimodal facial expressions and head poses as multiple convolutional neural networks (CNN) and deep learning are combined. This research analyzes and improves the robustness of emotion recognition, and proposes a novel approach that optimizes traditional deep neural networks that fall into poor local optima when optimizing the weightings of the deep neural network using standard methods. The proposed approach adaptively finds the better weightings of the network, resulting in a hybrid genetic algorithm with stochastic gradient descent (HGASGD). This hybrid algorithm combines the inherent, implicit parallelism of the genetic algorithm with the better global optimization of stochastic gradient descent (SGD). An experiment shows the effectiveness of our proposed approach in providing complete emotion recognition through a combination of multimodal data, CNNs, and HGASGD, indicating that it represents a powerful tool in achieving interactions between humans and robotics. To validate and test the effectiveness of our proposed approach through experiments, the performance and reliability of our approach and two variants of HGASGD FER are compared using a large dataset of facial images. Our approach integrates multimodal information from facial expressions and head poses, enabling the system to recognize emotions better. The results show that CNN-HGASGD outperforms CNNs-SGD and other existing state-of-the-art methods in terms of FER.

A Novel Approach to Cross dataset studies in Facial Expression Recognition

Cross-Database Facial Expression Recognition Based on Fine-Tuned Deep Convolutional Network

Bio-Inspired Spiking Neural Networks for Facial Expression Recognition - Generalisation Investigation.

Benchmarking Deep Facial Expression Recognition: An Extensive Protocol with Balanced Dataset in the Wild

Generalisation and Robustness Investigation for Facial and Speech Emotion Recognition Using Bio-Inspired Spiking Neural Networks

Impact of Deep Learning Approaches on Facial Expression Recognition in Healthcare Industries

Facial Emotion Recognition: A multi-task approach using deep learning

A study on computer vision for facial emotion recognition

A Deep Learning Perspective on the Origin of Facial Expressions

Assessing the Efficacy of Deep Learning Approaches for Facial Expression Recognition in Individuals with Intellectual Disabilities

Attention mechanism-based CNN for facial expression recognition

Transfer subspace learning for cross-dataset facial expression recognition

Facial Expressions Recognition for Human-Robot Interaction Using Deep Convolutional Neural Networks with Rectified Adam Optimizer

Building and validation of a set of facial expression images to detect emotions: a transcultural study

Expression-Guided Deep Joint Learning for Facial Expression Recognition

Facial Expression Recognition using Visual Saliency and Deep Learning

CC-CNN: A cross connected convolutional neural network using feature level fusion for facial expression recognition

Multimodal Facial Emotion Recognition Using Improved Convolution Neural Networks Model

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

A feature boosted deep learning method for automatic facial expression recognition

Compound facial expressions recognition approach using DCGAN and CNN