Abstract:Nowadays, in today`s information society, the importance of the knowledge service using the information to creative value is getting higher day by day. In addition, depending on the development of IT technology, it is ease to collect and use information. Also, many companies actively use customer information to marketing in a variety of industries. Into the 21st century, companies have been actively using the culture arts to manage corporate image and marketing closely linked to their commercial interests. But, it is difficult that companies attract or maintain consumer`s interest through their technology. For that reason, it is trend to perform cultural activities for tool of differentiation over many firms. Many firms used the customer`s experience to new marketing strategy in order to effectively respond to competitive market. Accordingly, it is emerging rapidly that the necessity of personalized service to provide a new experience for people based on the personal profile information that contains the characteristics of the individual. Like this, personalized service using customer`s individual profile information such as language, symbols, behavior, and emotions is very important today. Through this, we will be able to judge interaction between people and content and to maximize customer`s experience and satisfaction. There are various relative works provide customer-centered service. Specially, emotion recognition research is emerging recently. Existing researches experienced emotion recognition using mostly bio-signal. Most of researches are voice and face studies that have great emotional changes. However, there are several difficulties to predict people`s emotion caused by limitation of equipment and service environments. So, in this paper, we develop emotion prediction model based on vision-based interface to overcome existing limitations. Emotion recognition research based on people`s gesture and posture has been processed by several researchers. This paper developed a model that recognizes people`s emotional states through body gesture and posture using difference image method. And we found optimization validation model for four kinds of emotions` prediction. A proposed model purposed to automatically determine and predict 4 human emotions (Sadness, Surprise, Joy, and Disgust). To build up the model, event booth was installed in the KOCCA`s lobby and we provided some proper stimulative movie to collect their body gesture and posture as the change of emotions. And then, we extracted body movements using difference image method. And we revised people data to build proposed model through neural network. The proposed model for emotion prediction used 3 type time-frame sets (20 frames, 30 frames, and 40 frames). And then, we adopted the model which has best performance compared with other models.` Before build three kinds of models, the entire 97 data set were divided into three data sets of learning, test, and validation set. The proposed model for emotion prediction was constructed using artificial neural network. In this paper, we used the back-propagation algorithm as a learning method, and set learning rate to 10%, momentum rate to 10%. The sigmoid function was used as the transform function. And we designed a three-layer perceptron neural network with one hidden layer and four output nodes. Based on the test data set, the learning for this research model was stopped when it reaches 50000 after reaching the minimum error in order to explore the point of learning. We finally processed each model`s accuracy and found best model to predict each emotions. The result showed prediction accuracy 100% from sadness, and 96% from joy prediction in 20 frames set model. And 88% from surprise, and 98% from disgust in 30 frames set model. The findings of our research are expected to be useful to provide effective algorithm for personalized service in various industries such as advertisement, exhibition, performance, etc.

Joint user-interest and social-influence emotion prediction for individuals

Emotion Detection in Online Social Networks: A Multilabel Learning Approach

Predicting Personalized Emotion Perceptions of Social Images

Exploring User Emotion in Microblogs for Music Recommendation.

Predicting Personalized Image Emotion Perceptions in Social Networks

Modeling Emotion Influence in Image Social Networks.

A Joint Neural Model for User Behavior Prediction on Social Networking Platforms

Predicting Happiness State Based on Emotion Representative Mining in Online Social Networks.

Neural Gender Prediction in Microblogging with Emotion-aware User Representation

Modeling Emotion Influence from Images in Social Networks

Predicting Emotions in User-Generated Videos.

Predicting Social Emotions from Readers’ Perspective

MoodCast: Emotion Prediction Via Dynamic Continuous Factor Graph Model.

Emotion Detection with Neural Personal Discrimination

Dissecting emotion and user influence in social media communities: An interaction modeling approach

Modeling Emotion Influence Using Attention-based Graph Convolutional Recurrent Network

Inferring Emotions from Social Images Leveraging Influence Analysis

The Audience Behavior-based Emotion Prediction Model for Personalized Service

Interest prediction in social networks based on Markov chain modeling on clustered users

Emotion recognition of social media users based on deep learning

A Novel Adaptive Conditional Probability-Based Predicting Model for User’s Personality Traits