Special Issue on Computational Intelligence and Affective Computing [guest Editorial]

Dongrui Wu,Christian Wagner

DOI: https://doi.org/10.1109/mci.2013.2247822

IF: 9.809

2013-01-01

IEEE Computational Intelligence Magazine

Abstract:The articles in this special issue focus on the topic of affective computing applications for emotion recognition and human/computer interaction technologies.

What problem does this paper attempt to address?

Introduction to the Special Issue on Sentiment Analysis and Affective computing in Multimedia Data on Social Network

Rajni Mohana,Anand Nayyar,Pradeep Kumar,Aman Sharma

DOI: https://doi.org/10.12694/scpe.v24i4.2863

2023-11-17

Abstract:In the Age of Multimedia and Social Networks, the proliferation of user-generated data has been nothing short of meteoric. This wealth of information necessitates careful analysis and processing to truly comprehend the subjective perceptions of users. At the intersection of this data-driven revolution, two critical fields emerge: Sentiment Analysis and Affective Computing. Sentiment analysis delves into the intricate realm of people's opinions, sentiments, evaluations, attitudes, and emotions as expressed through written language. On the other hand, Affective Computing focuses on the development of systems and devices capable of recognizing, interpreting, processing, and even simulating human emotions. It is, in essence, the fusion of Emotion AI and other affective technologies, with the overarching goal of enhancing people's lives. With the exponential growth of user-generated data, thanks to social networks, wikis, and social tagging systems, it has become imperative to decipher the high-level semantics and user subjective perceptions embedded in this vast sea of information. Emotions and sentiments, in particular, stand out as significant facets of user-generated data, often carrying the emotional imprints of their creators. The concurrent advancement of computational techniques for sentiment analysis and opinion mining has been accompanied by a surge in the utilization of psychological and cognitive models and theories. These are being harnessed to model sentiments and emotions, often in synergy with social computing techniques such as social network analysis and personalization, user review mining, and user profiling within social networks, among others. The synergy between affective/sentimental models and social computing techniques is not merely an academic endeavor; it paves the way for comprehending big data at a semantic level and enhances the performance of a wide array of social computing applications in this era of big data. This convergence not only combines affective and sentimental models with social computing but also charts a promising direction replete with opportunities for developing novel algorithms, methods, and tools. It is a privilege for us to introduce the Special Issue on Sentiment Analysis and Affective computing in Multimedia Data on Social Network. Among the numerous research papers we received (50 in total), we meticulously selected 18 papers for publication. The overarching objective of this special issue is to delve into the recent advancements and disseminate state-of-the-art research related to sentiment analysis and affective computing in multimedia data within social networks and the technologies that make this possible. This special issue represents a showcase of new dimensions of research, offering researchers and industry professionals an illuminating perspective on sentiment analysis and affective computing in the realm of multimedia data within social networks. We sincerely hope that the contributions in this special issue will not only inform but also inspire future research endeavors, leading to a deeper understanding of the multifaceted world of sentiment analysis and affective computing in the age of multimedia and social networks.
Intelligent Signal Processing for Affective Computing [from the Guest Editors]

Bjoern W. Schuller,Rosalind Picard,Elisabeth Andre,Jonathan Gratch,Jianhua Tao

DOI: https://doi.org/10.1109/msp.2021.3096415

IF: 15.204

2021-01-01

IEEE Signal Processing Magazine

Abstract:Affective computing is computing that relates to, arises from, or deliberately influences emotion or other affective phenomena. Human emotion and affect in general are fundamental to human experience, influencing cognition, perception, and everyday tasks such as learning and communication, but are also fundamental to human health and well-being. The field of affective computing has matured over its roughly two-and-a-half decades coming closer than ever to the point of usage at scale. Affective computing is facing a plethora of different signal types-audio, video, and physiological signals, to name but the most dominant.
Special Issue on Semantic Web Meets Computational Intelligence [guest Editorial]

Huajun Chen,Philippe Cudre-Mauroux

DOI: https://doi.org/10.1109/mci.2012.2188579

IF: 9.809

2012-01-01

IEEE Computational Intelligence Magazine

Abstract:of the importance of introducing these CI methodologies and approaches to study the complexity of such a huge web of data. For example, Fuzzy Logic has inspired the design of variant fuzzy extensions of several Semantic Web languages. Nature-inspired optimization methods such as Genetic Algorithms (GA), Swarm Intelligence (SI), Artificial Immune Systems (AIS) have been witnessed in optimizing query answering and reasoning over such a vast, decentralized data space. This special issue aims at promoting the discussion on current trends in the marriage of the Semantic Web and Computational Intelligence. Our goal is
Fuzzy Sets and Systems in Building Closed-Loop Affective Computing Systems for Human-Computer Interaction: Advances and New Research Directions

Dongrui Wu

DOI: https://doi.org/10.1109/fuzz-ieee.2012.6250779

2012-01-01

Abstract:Affective computing is computing that relates to, arises from, or deliberately influences emotions. It has lots of applications in the next generation of human-computer interfaces. We have proposed a closed-loop affective computing system, which includes affect recognition, affect modeling, and affect control. Because emotions include both intra-personal uncertainty, which is the uncertainty a person has about an emotion, and inter-personal uncertainty, which results from the fact that different people have different perceptions and expressions of the same emotion, it is promising to use fuzzy sets and systems, especially type-2 fuzzy sets and systems, to handle these uncertainties in an affective computing system. This paper introduces four applications of affective computing, reviews some recent advances on the application of fuzzy sets and systems to affect recognition, modeling, and control, and points out some new research directions. It will be very useful to both the fuzzy logic research community and the affective computing research community, especially to researchers working at the intersection of these two areas.
Special Issue on Multimodal Affective Interaction

Nicu Sebe,Hamid Aghajan,Thomas Huang,Nadia Magnenat-Thalmann,Caifeng Shan

DOI: https://doi.org/10.1109/tmm.2010.2052315

IF: 7.3

2010-01-01

IEEE Transactions on Multimedia

Abstract:The 11 papers in this special issue can be categorized into five groups: Emotional speech synthesis and recognition; affective video content analysis; facial expressions and head movements; affect analysis in small groups; and audio-visual affective corpus.
Advances of Research in Affective Processes in Communication and Collaboration

Jie Xu,Enid Montague,Jonathan Gratch,Peter Hancock,Myounghoon Jeon,Mark S. Pfaff

DOI: https://doi.org/10.1177/1541931215591061

2015-01-01

Proceedings of the Human Factors and Ergonomics Society Annual Meeting

Abstract:Affective processes have been an important research area for human factors and ergonomics. Although there is an obvious connection between affect and communication and collaboration, little research has been conducted in the human factors community until recently. In this panel, the panelists will discuss recent advances in affective research in communication and collaboration systems. Theoretical perspectives in human computer interaction, human agent interaction, and teamwork that take affective process into account will be discussed. Methodological issues will also be addressed, such as the measurements of affect, research design, and data analysis methods. Finally the applications of the theories and methods in different systems, such as human robot interaction, healthcare, and multi-tasking teams, will be discussed.
Guest Editorial: Ethics in Affective Computing

Jonathan Gratch,Gretchen Greene,Rosalind Picard,Lachlan Urquhart,Michel Valstar

DOI: https://doi.org/10.1109/taffc.2023.3322918

IF: 13.99

2024-03-02

IEEE Transactions on Affective Computing

Abstract:Stunning advances in machine learning are heralding a new era in sensing, interpreting, simulating and stimulating human emotion. In the human sciences, research is increasingly highlighting the explanatory power of emotions, feelings, and other affective processes to predict how we think and behave. This is beginning to translate into an explosion of applications that can improve human wellbeing including methods to reduce stress and improve emotion regulation skills, techniques to support healthier social media use, pain monitoring in neonates, and decision-support tools that recognize emotional bias.

computer science, cybernetics, artificial intelligence
Ieee Access Special Section Editorial: Emotion-Aware Mobile Computing

Yin Zhang,Giancarlo Fortino,Honggang Wang,Wei Wang

DOI: https://doi.org/10.1109/ACCESS.2017.2719558

IF: 3.9

2017-01-01

IEEE Access

Abstract:With the rapid development of smart phones and wireless technology, mobile services and applications in the world are growing rapidly. Advanced mobile computing and communications greatly enhance users’ experience by the notion of “carrying small while enjoying large”, which have brought a huge impact to all aspects of people’s lifestyles in terms of work, social, and economy. Although these advanced techniques have extensively improved users’ quality of experience (QoE), it is not adequate to provide affective services without efficient mechanisms of emotion-aware mobile computing, which includes various unique aspects, e.g., mobile data sensing and transmissions; sentiment analysis and emotion recognition; affective interaction. Under the new service paradigm, novel mobile services and innovative applications need to be extensively investigated to gain the great potentials brought by emotion-aware mobile computing.
Guest Editorial Best of ACII 2021

Mohammad Soleymani,Shiro Kumano,Emily Mower Provost,Nadia Bianchi-Berthouze,Akane Sano,Kenji Suzuki

DOI: https://doi.org/10.1109/taffc.2024.3389249

IF: 13.99

2024-05-31

IEEE Transactions on Affective Computing

Abstract:The 9TH AAAC Conference on Affective Computing and Intelligent Interaction 2021 was held in a virtual format in the fall of 2021. It was technically co-sponsored by the IEEE Computer Society and featured the recent work on Affective Computing. The six best papers from this conference were selected by the technical program chairs. They were invited to submit their extended version to be considered for this special section at the IEEE Transactions on Affective Computing. Each submission was reviewed by at least three expert reviewers and was evaluated in terms of overall contribution and the adequacy of the additional content to warrant a new article. This special section features five accepted submissions whose major contributions are summarized below.

computer science, cybernetics, artificial intelligence
A systematic review on affective computing: emotion models, databases, and recent advances

Yan Wang,Wei Song,Wei Tao,Antonio Liotta,Dawei Yang,Xinlei Li,Shuyong Gao,Yixuan Sun,Weifeng Ge,Wei Zhang,Wenqiang Zhang

DOI: https://doi.org/10.1016/j.inffus.2022.03.009

IF: 18.6

2022-07-01

Information Fusion

Abstract:Affective computing conjoins the research topics of emotion recognition and sentiment analysis, and can be realized with unimodal or multimodal data, consisting primarily of physical information (e.g., text, audio, and visual) and physiological signals (e.g., EEG and ECG). Physical-based affect recognition caters to more researchers due to the availability of multiple public databases, but it is challenging to reveal one's inner emotion hidden purposefully from facial expressions, audio tones, body gestures, etc. Physiological signals can generate more precise and reliable emotional results; yet, the difficulty in acquiring these signals hinders their practical application. Besides, by fusing physical information and physiological signals, useful features of emotional states can be obtained to enhance the performance of affective computing models. While existing reviews focus on one specific aspect of affective computing, we provide a systematical survey of important components: emotion models, databases, and recent advances. Firstly, we introduce two typical emotion models followed by five kinds of commonly used databases for affective computing. Next, we survey and taxonomize state-of-the-art unimodal affect recognition and multimodal affective analysis in terms of their detailed architectures and performances. Finally, we discuss some critical aspects of affective computing and its applications and conclude this review by pointing out some of the most promising future directions, such as the establishment of benchmark database and fusion strategies. The overarching goal of this systematic review is to help academic and industrial researchers understand the recent advances as well as new developments in this fast-paced, high-impact domain.

computer science, artificial intelligence, theory & methods
Proceedings of 2011 International Workshop on Ubiquitous Affective Awareness and Intelligent Interaction

Bin Hu,Jürg Gutknecht,Li Liu

DOI: https://doi.org/10.1145/2030092

2011-01-01

Abstract:It is our great pleasure to welcome you to the 2011 ACM Workshop on Ubiquitous Affective Awareness and Intelligent Interaction -- UAAII'11. This workshop aims to build a forum for researchers from academy and industry to investigate challenging and innovative research issues in the subject, which combines Affective Interaction within ubiquitous environment and to explore creative concepts, theories, innovative technologies and intelligent solutions. Potential participants may come from communities of ubiquitous computing, intelligent computing, brain computer interaction, affective computing, neuroergonomics, cognitive neuroscience etc. The call for papers attracted 24 submissions from Asia and Europe. The program committee accepted 5 papers that cover three topics, including Recognition & Synthesis of Human Affect in Ubiquitous Environment, Affective & Behavioral Interfaces in Ubiquitous Environment, and Affective and Multimodal Intelligent Systems. In addition, the program includes a discuss panel on a subject related to the Workshop Venue. We hope that these proceedings will serve as a valuable reference for Affective Computing and Intelligence Interaction researchers and developers.
Cognitive-inspired Computing: Advances and Novel Applications

Rongbo Zhu,Lu Liu,Maode Ma,Hongxiang Li

DOI: https://doi.org/10.1016/j.future.2020.03.017

IF: 7.307

2020-01-01

Future Generation Computer Systems

Abstract:Cognition is emerging as a new and promising methodology with the development of cognitive-inspired computing and interaction systems, which enables a large class of applications and has emerged with a significance to change our life. However, recent advances on artificial intelligence (AI), edge computing, big data, and cognitive computational theory show that multidisciplinary cognitive-inspired computing still struggles with fundamental, long-standing problems, such as computational models and decision-making mechanisms based on the neurobiological processes of the brain, cognitive sciences, and psychology. How to enhance human cognitive performance with machine learning (ML), common sense, intelligent interaction, privacy security and novel applications is worth exploring. The objective of this special issue is to report high-quality state-of-the-art research contributions that address these key aspects of cognitive-inspired computing and novel applications. By presenting a selection of papers on various topics related to cognitive-inspired computing and applications, we hope to shed light on the multiple aspects of this emerging multidisciplinary paradigm. The papers included in this issue propose solutions for cognitive-inspired systems, AI-assisted computing, intelligent health analysis, security and privacy issues, as well as novel applications.
Cognitive-inspired Computing: Advances and Novel Applications.

Rongbo Zhu,Lu Liu,Maode Ma,Hongxiang Li

DOI: https://doi.org/10.1016/j.future.2020.03.017

IF: 7.307

2020-01-01

Future Generation Computer Systems

Abstract:Cognition is emerging as a new and promising methodology with the development of cognitive-inspired computing and interaction systems, which enables a large class of applications and has emerged with a significance to change our life. However, recent advances on artificial intelligence (AI), edge computing, big data, and cognitive computational theory show that multidisciplinary cognitive-inspired computing still struggles with fundamental, long-standing problems, such as computational models and decision-making mechanisms based on the neurobiological processes of the brain, cognitive sciences, and psychology. How to enhance human cognitive performance with machine learning (ML), common sense, intelligent interaction, privacy security and novel applications is worth exploring. The objective of this special issue is to report high-quality state-of-the-art research contributions that address these key aspects of cognitive-inspired computing and novel applications. By presenting a selection of papers on various topics related to cognitive-inspired computing and applications, we hope to shed light on the multiple aspects of this emerging multidisciplinary paradigm. The papers included in this issue propose solutions for cognitive-inspired systems, AI-assisted computing, intelligent health analysis, security and privacy issues, as well as novel applications.
Affective Computing for Healthcare: Recent Trends, Applications, Challenges, and Beyond

Yuanyuan Liu,Ke Wang,Lin Wei,Jingying Chen,Yibing Zhan,Dapeng Tao,Zhe Chen

DOI: https://doi.org/10.48550/arXiv.2402.13589

2024-02-21

Abstract:Affective computing, which aims to recognize, interpret, and understand human emotions, provides benefits in healthcare, such as improving patient care and enhancing doctor-patient communication. However, there is a noticeable absence of a comprehensive summary of recent advancements in affective computing for healthcare, which could pose difficulties for researchers entering this field. To address this, our paper aims to provide an extensive literature review of related studies published in the last five years. We begin by analyzing trends, benefits, and limitations of recent datasets and affective computing methods devised for healthcare. Subsequently, we highlight several healthcare application hotspots of current technologies that could be promising for real-world deployment. Through our analysis, we identify and discuss some ongoing challenges in the field as evidenced by the literature. Concluding with a thorough review, we further offer potential future research directions and hope our findings and insights could guide related researchers to make better contributions to the evolution of affective computing in healthcare.

Human-Computer Interaction
Affective Computing and Intelligent Interaction

Jianhua Tao,Tieniu Tan,Rosalind W. Picard

DOI: https://doi.org/10.1007/11573548

2005-01-01

Abstract:This volume contains the proceedings of the 1st International Conference on A?ective Computing and Intelligent Interaction (ACII 2005) held in Beijing, China, on 22–24 October 2005. Traditionally, the
Affective Information Processing Introduction

Jianhua Tao,Tieniu Tan

DOI: https://doi.org/10.1007/978-1-84800-306-4_1

2009-01-01

Abstract:Affective information processing is intended to give computers the human-like capabilities of observation, interpretation and generation of affect features. It is essential for natural and effective human-computer interaction and has become a very hot research topic. This state-of-the-art volume discusses the latest developments in affective information processing, and summarises the key technologies researched, such as facial expression recognition, face animation, emotional speech synthesis, intelligent agents, and virtual reality. The detailed and accessible coverage includes a wide range of topics, including areas which look to challenge and improve current research. The book is organised into the following themed parts to aid the readers in their understanding of the field: Cognitive Emotion Model, Affect in Speech, Affect in Face and Affect in Multimodal Interaction. Topics and Features: Reports on the state of the art research in affective information processing Summarises key technologies researched during the last few years, such as affective speech processing, affective facial expressions, affective body gesture and movement, affective multi-modal systems, etc. Offers a foundational introductory chapter that grounds readers in core concepts and principles Discusses applications of this technology, such as in education against bullying Provides summarising conclusions throughout Describes affect in multimodal information Looks at cognitive emotion modelling in natural language communication Explores emotion perception and recognition from speech, and based on multimodal information Includes face animation based on large audio-visual database Presents physiological sensing for affective computing Examines evolutionary expression of emotions in virtual humans using lights and pixels Written to provide an opportunity for scientists, engineers and graduate students to explore the difficulties, solutions and technologies in this exciting new area, this ground-breaking book provides a comprehensive overview and significant insight into the field and will prove a valuable reference tool and resource.
Affective computing and engineering rationality

HUANG Yun-feng,WANG Shi-long

DOI: https://doi.org/10.3969/j.issn.1001-3695.2009.09.007

2009-01-01

Abstract:Through the compatibility analysis of emotion and rationality,and the study of emotional functions in integration,adaptation,motivity and interaction,it was pointed out that emotion was an effective mechanism in dealing with complex problems in real world.As the emotion functions matched well with the engineering requirements,affective computing,with emotion as its core,was of effectiveness and certain necessity,and had great potential in solving complex engineering problems.Committed the endogenous,relevance and operational strategy of affective computing.Pointed out that concerns should be made to the entry point,the emotion elicitor,the emotion effector,and the platform choice,which constituted the key links to success in emotion-based systems in engineering projects,and gave related recommendations.
Ten Challenges for EEG-based Affective Computing

Xin Hu,Jingjing Chen,Fei Wang,Dan Zhang

DOI: https://doi.org/10.1177/2096595819896200

2019-01-01

Brain Science Advances

Abstract:The emerging field of affective computing focuses on enhancing computers’ ability to understand and appropriately respond to people’s affective states in human-computer interactions, and has revealed significant potential for a wide spectrum of applications.Recently, the electroencephalography（EEG） based affective computing has gained increasing interest for its good balance between mechanistic exploration and real-world practical application. The present work reviewed ten theoretical and operational challenges for the existing affective computing researches from an interdisciplinary perspective of information technology, psychology, and neuroscience.On the theoretical side, we suggest that researchers should be well aware of the limitations of the commonly used emotion models, and be cautious about the widely accepted assumptions on EEG-emotion relationships as well as the transferability of findings based on different research paradigms. On the practical side, we propose several operational recommendations for the challenges about data collection, feature extraction, model implementation, online system design, as well as the potential ethical issues. The present review is expected to contribute to an improved understanding of EEG-based affective computing and promote further applications.
Multimodal Information Processing For Affective Computing

Jianhua Tao

DOI: https://doi.org/10.1007/978-0-387-73819-2_9

2010-01-01

Abstract: Affective computing is interaction that relates to, arises from or deliberately influences emotions [1]; it tries to assign computers the human-like capabilities of observation, interpretation and generation of affect features. It is an important topic in human–computer interaction (HCI), because it helps increase the quality of human to computer communications.
ASMMC21: the 6th International Workshop on Affective Social Multimedia Computing

Dongyan Huang,Björn W. Schuller,Jianhua Tao,Lei Xie,Jie Yang

DOI: https://doi.org/10.1145/3462244.3480980

2021-01-01

Abstract:Affective social multimedia computing is an emergent research topic for both affective computing and multimedia research communities. Social multimedia is fundamentally changing how we communicate, interact, and collaborate with other people in our daily lives. Comparing with well-organized broadcast news and professionally made videos such as commercials, TV shows, and movies, social multimedia media computing imposes great challenges to research communities. Social multimedia contains much affective information. Effective extraction of affective information from social multimedia can greatly help social multimedia computing (e.g., processing, index, retrieval, and understanding). Although much progress have been made in traditional multimedia research on multimedia content analysis, indexing, and retrieval based on subjective concepts such as emotion, aesthetics, and preference, affective social multimedia computing is a new research area. The affective social multimedia computing aims to proceed affective information from social multi-media. For massive and heterogeneous social media data, the research requires multidisciplinary understanding of content and perceptual cues from social multimedia. This workshop served as a successful step towards this goal and attracted contributions from different research disciplines on the analysis of affective signals in interaction (multimodal analyses enabling artificial agents in Human-Machine Interaction, social Interaction with artificial agents) and social multimedia (e.g., twitter, wechat, weibo, youtube, facebook, etc). This paper provides a summary of the activities of the workshop and the accepted papers and abstracts.

Special Issue on Computational Intelligence and Affective Computing [guest Editorial]

Introduction to the Special Issue on Sentiment Analysis and Affective computing in Multimedia Data on Social Network

Intelligent Signal Processing for Affective Computing [from the Guest Editors]

Special Issue on Semantic Web Meets Computational Intelligence [guest Editorial]

Fuzzy Sets and Systems in Building Closed-Loop Affective Computing Systems for Human-Computer Interaction: Advances and New Research Directions

Special Issue on Multimodal Affective Interaction

Advances of Research in Affective Processes in Communication and Collaboration

Guest Editorial: Ethics in Affective Computing

Ieee Access Special Section Editorial: Emotion-Aware Mobile Computing

Guest Editorial Best of ACII 2021

A systematic review on affective computing: emotion models, databases, and recent advances

Proceedings of 2011 International Workshop on Ubiquitous Affective Awareness and Intelligent Interaction

Cognitive-inspired Computing: Advances and Novel Applications

Cognitive-inspired Computing: Advances and Novel Applications.

Affective Computing for Healthcare: Recent Trends, Applications, Challenges, and Beyond

Affective Computing and Intelligent Interaction

Affective Information Processing Introduction

Affective computing and engineering rationality

Ten Challenges for EEG-based Affective Computing

Multimodal Information Processing For Affective Computing

ASMMC21: the 6th International Workshop on Affective Social Multimedia Computing