Affective Computing and Intelligent Interaction

Jianhua Tao,Tieniu Tan,Rosalind W. Picard

DOI: https://doi.org/10.1007/11573548

2005-01-01

Abstract:This volume contains the proceedings of the 1st International Conference on A?ective Computing and Intelligent Interaction (ACII 2005) held in Beijing, China, on 22–24 October 2005. Traditionally, the

What problem does this paper attempt to address?

Affective Information Processing Introduction

Jianhua Tao,Tieniu Tan

DOI: https://doi.org/10.1007/978-1-84800-306-4_1

2009-01-01

Abstract:Affective information processing is intended to give computers the human-like capabilities of observation, interpretation and generation of affect features. It is essential for natural and effective human-computer interaction and has become a very hot research topic. This state-of-the-art volume discusses the latest developments in affective information processing, and summarises the key technologies researched, such as facial expression recognition, face animation, emotional speech synthesis, intelligent agents, and virtual reality. The detailed and accessible coverage includes a wide range of topics, including areas which look to challenge and improve current research. The book is organised into the following themed parts to aid the readers in their understanding of the field: Cognitive Emotion Model, Affect in Speech, Affect in Face and Affect in Multimodal Interaction. Topics and Features: Reports on the state of the art research in affective information processing Summarises key technologies researched during the last few years, such as affective speech processing, affective facial expressions, affective body gesture and movement, affective multi-modal systems, etc. Offers a foundational introductory chapter that grounds readers in core concepts and principles Discusses applications of this technology, such as in education against bullying Provides summarising conclusions throughout Describes affect in multimodal information Looks at cognitive emotion modelling in natural language communication Explores emotion perception and recognition from speech, and based on multimodal information Includes face animation based on large audio-visual database Presents physiological sensing for affective computing Examines evolutionary expression of emotions in virtual humans using lights and pixels Written to provide an opportunity for scientists, engineers and graduate students to explore the difficulties, solutions and technologies in this exciting new area, this ground-breaking book provides a comprehensive overview and significant insight into the field and will prove a valuable reference tool and resource.
Intelligent Signal Processing for Affective Computing [from the Guest Editors]

Bjoern W. Schuller,Rosalind Picard,Elisabeth Andre,Jonathan Gratch,Jianhua Tao

DOI: https://doi.org/10.1109/msp.2021.3096415

IF: 15.204

2021-01-01

IEEE Signal Processing Magazine

Abstract:Affective computing is computing that relates to, arises from, or deliberately influences emotion or other affective phenomena. Human emotion and affect in general are fundamental to human experience, influencing cognition, perception, and everyday tasks such as learning and communication, but are also fundamental to human health and well-being. The field of affective computing has matured over its roughly two-and-a-half decades coming closer than ever to the point of usage at scale. Affective computing is facing a plethora of different signal types-audio, video, and physiological signals, to name but the most dominant.
Intelligent Computing Methodologies: 10th International Conference, ICIC 2014, Taiyuan, China, August 3-6, 2014, Proceedings

De-Shuang Huang,Kang-Hyun Jo,Ling Wang

2014-01-01

Abstract:This book in conjunction with the volumes LNCS 8588 and LNBI 8590 constitutes the refereed proceedings of the 10th International Conference on Intelligent Computing, ICIC 2014, held in Taiyuan, China, in August 2014. The 85 papers of this volume were carefully reviewed and selected from numerous submissions. The papers are organized in topical sections such as soft computing; artificial bee colony algorithms; unsupervised learning; kernel methods and supporting vector machines; machine learning; fuzzy theory and algorithms; image processing; intelligent computing in computer vision; intelligent computing in communication networks; intelligent image/document retrievals; intelligent data analysis and prediction; intelligent agent and Web applications; intelligent fault diagnosis; knowledge representation/reasoning; knowledge discovery and data mining; natural language processing and computational linguistics; next gen sequencing and metagenomics; intelligent computing in scheduling and engineering optimization; advanced modeling, control and optimization techniques for complex engineering systems; complex networks and their applications; time series forecasting and analysis using artificial neural networks; computer human interaction using multiple visual cues and intelligent computing; biometric system and security for intelligent computing.
Advances of Research in Affective Processes in Communication and Collaboration

Jie Xu,Enid Montague,Jonathan Gratch,Peter Hancock,Myounghoon Jeon,Mark S. Pfaff

DOI: https://doi.org/10.1177/1541931215591061

2015-01-01

Proceedings of the Human Factors and Ergonomics Society Annual Meeting

Abstract:Affective processes have been an important research area for human factors and ergonomics. Although there is an obvious connection between affect and communication and collaboration, little research has been conducted in the human factors community until recently. In this panel, the panelists will discuss recent advances in affective research in communication and collaboration systems. Theoretical perspectives in human computer interaction, human agent interaction, and teamwork that take affective process into account will be discussed. Methodological issues will also be addressed, such as the measurements of affect, research design, and data analysis methods. Finally the applications of the theories and methods in different systems, such as human robot interaction, healthcare, and multi-tasking teams, will be discussed.
Proceedings of the 2012 International Conference on Information Technology and Software Engineering: Information Technology & Computing Intelligence

Wei Lu,Guoqiang Cai,Weibin Liu,Weiwei Xing

2012-01-01

Abstract:Proceedings of the 2012 International Conference on Information Technology and Software Engineering presents selected articles from this major event, which was held in Beijing, December 8-10, 2012. This book presents the latest research trends, methods and experimental results in the fields of information technology and software engineering, covering various state-of-the-art research theories and approaches. The subjects range from intelligent computing to information processing, software engineering, Web, unified modeling language (UML), multimedia, communication technologies, system identification, graphics and visualizing, etc. The proceedings provide a major interdisciplinary forum for researchers and engineers to present the most innovative studies and advances, which can serve as an excellent reference work for researchers and graduate students working on information technology and software engineering. Prof. Wei Lu, Dr. Guoqiang Cai, Prof. Weibin Liu and Dr. Weiwei Xing all work at Beijing Jiaotong University.
Multimodal Information Processing For Affective Computing

Jianhua Tao

DOI: https://doi.org/10.1007/978-0-387-73819-2_9

2010-01-01

Abstract: Affective computing is interaction that relates to, arises from or deliberately influences emotions [1]; it tries to assign computers the human-like capabilities of observation, interpretation and generation of affect features. It is an important topic in human–computer interaction (HCI), because it helps increase the quality of human to computer communications.
Affect is Computable——A Survey on Affective Computing

Lin Xue-yin

2008-01-01

Computer Science

Abstract:Affective computing is crucial for the implementation of natural human computer interaction.A survey is given on the background,related research areas and key techniques of affective computing.Some future research direc- tions are discussed.
Guest Editorial Best of ACII 2021

Mohammad Soleymani,Shiro Kumano,Emily Mower Provost,Nadia Bianchi-Berthouze,Akane Sano,Kenji Suzuki

DOI: https://doi.org/10.1109/taffc.2024.3389249

IF: 13.99

2024-05-31

IEEE Transactions on Affective Computing

Abstract:The 9TH AAAC Conference on Affective Computing and Intelligent Interaction 2021 was held in a virtual format in the fall of 2021. It was technically co-sponsored by the IEEE Computer Society and featured the recent work on Affective Computing. The six best papers from this conference were selected by the technical program chairs. They were invited to submit their extended version to be considered for this special section at the IEEE Transactions on Affective Computing. Each submission was reviewed by at least three expert reviewers and was evaluated in terms of overall contribution and the adequacy of the additional content to warrant a new article. This special section features five accepted submissions whose major contributions are summarized below.

computer science, cybernetics, artificial intelligence
Proceedings of the 25th International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems: Advanced Research in Applied Artificial Intelligence

He Jiang,Wei Ding,Moonis Ali,Xindong Wu

2012-01-01

Abstract:This volume constitutes the thoroughly refereed conference proceedings of the 25th International Conference on Industrial Engineering and Other Applications of Applied Intelligend Systems, IEA/AIE 2012, held in Dalian, China, in June 2012. The total of 82 papers selected for the proceedings were carefully reviewed and selected from numerous submissions. The papers are organized in topical sections on machine learning methods; cyber-physical system for intelligent transportation applications; AI applications; evolutionary algorithms, combinatorial optimization; modeling and support of cognitive and affective human processes; natural language processing and its applications; social network and its applications; mission-critical applications and case studies of intelligent systems; AI methods; sentiment analysis for asian languages; aspects on cognitive computing and intelligent interaction; spatio-temporal datamining, structured learning and their applications; decision making and knowledge based systems; pattern recognition; agent based systems; decision making techniques and innovative knowledge management; machine learning applications.
Ten Challenges for EEG-based Affective Computing

Xin Hu,Jingjing Chen,Fei Wang,Dan Zhang

DOI: https://doi.org/10.1177/2096595819896200

2019-01-01

Brain Science Advances

Abstract:The emerging field of affective computing focuses on enhancing computers’ ability to understand and appropriately respond to people’s affective states in human-computer interactions, and has revealed significant potential for a wide spectrum of applications.Recently, the electroencephalography（EEG） based affective computing has gained increasing interest for its good balance between mechanistic exploration and real-world practical application. The present work reviewed ten theoretical and operational challenges for the existing affective computing researches from an interdisciplinary perspective of information technology, psychology, and neuroscience.On the theoretical side, we suggest that researchers should be well aware of the limitations of the commonly used emotion models, and be cautious about the widely accepted assumptions on EEG-emotion relationships as well as the transferability of findings based on different research paradigms. On the practical side, we propose several operational recommendations for the challenges about data collection, feature extraction, model implementation, online system design, as well as the potential ethical issues. The present review is expected to contribute to an improved understanding of EEG-based affective computing and promote further applications.
Proceedings of the 2012 International Conference on Information Technology and Software Engineering

Wei Lu,Guoqiang Cai,Weibin Liu,Weiwei Xing

2016-01-01

Abstract:Proceedings of the 2012 International Conference on Information Technology and Software Engineering presents selected articles from this major event, which was held in Beijing, December 8-10, 2012. This book presents the latest research trends, methods and experimental results in the fields of information technology and software engineering, covering various state-of-the-art research theories and approaches. The subjects range from intelligent computing to information processing, software engineering, Web, unified modeling language (UML), multimedia, communication technologies, system identification, graphics and visualizing, etc. The proceedings provide a major interdisciplinary forum for researchers and engineers to present the most innovative studies and advances, which can serve as an excellent reference work for researchers and graduate students working on information technology and software engineering. Prof. Wei Lu, Dr. Guoqiang Cai, Prof. Weibin Liu and Dr. Weiwei Xing all work at Beijing Jiaotong University.
Affective Computing in Intelligent Tutoring Systems: Exploring Insights and Innovations

Phivos Mylonas,C. Troussas,Theofanis Tasoulas,C. Sgouropoulou

DOI: https://doi.org/10.1109/SEEDA-CECNSM63478.2024.00025

2024-09-20

Abstract:Integrating intelligent tutoring systems (ITS) into education has significantly enriched personalized learning experiences for students and educators alike. However, these systems often neglect the critical role of emotions in the learning process. By integrating affective computing, which empowers computers to recognize and respond to emotions, ITS can foster more engaging and impactful learning environments. This paper explores the utilization of affective computing techniques, such as facial expression analysis and voice modulation, to enhance ITS functionality. Case studies and existing systems have been scrutinized to comprehend design decisions, outcomes, and guidelines for effective integration, thereby enhancing learning outcomes and user engagement. Furthermore, this study underscores the necessity of considering emotional aspects in the development and deployment of educational technology to optimize its influence on student learning and well-being. A major conclusion of this research is that integration of affective computing into ITS empowers educators to customize learning experiences to students' emotional states, thereby enhancing educational effectiveness. To achieve this, it is crucial for such systems to make informed design decisions and adhere to established guidelines. These design decisions may involve selecting appropriate emotion recognition algorithms and integrating them seamlessly into the ITS interface, while guidelines can offer practical insights into effectively implementing affective computing techniques in ITS, such as ensuring data privacy and security measures are in place and providing adequate training for educators on interpreting emotional data.

Education,Computer Science
Proceedings of the 2015 Chinese Intelligent Systems Conference: Volume 1

Yingmin Jia,Junping Du,Hongbo Li,Weicun Zhang

2015-01-01

Abstract:This book presents selected research papers from the 2015 Chinese Intelligent Systems Conference (CISC15), held in Yangzhou, China. The topics covered include multi-agent systems, evolutionary computation, artificial intelligence, complex systems, computation intelligence and soft computing, intelligent control, advanced control technology, robotics and applications, intelligent information processing, iterative learning control, and machine learning. Engineers and researchers from academia, industry and the government can gain valuable insights into solutions combining ideas from multiple disciplines in the field of intelligent systems.
2021 International Conference on Artificial Intelligence and Information Technology

Yue Li,Qiao Zhang

DOI: https://doi.org/10.1088/1742-6596/2037/1/011001

2021-09-01

Journal of Physics: Conference Series

Abstract:2021 International Conference on Artificial Intelligence and Information Technology were successfully held online from 27th to 28th of March 2021, Peking, China. The conference was jointly organized and sponsored by Shaanxi Juxing Exhibition Co., Ltd and Juneng Electronic Technology Co., Ltd. The conference invited scholars and experts in the fields of artificial intelligence and information technology from various universities to participate in the review and guidance of this conference. The conference focuses on the latest research fields such as "information technology", "artificial intelligence", "big data" and "cloud computing", and aims to provide an international cooperation and exchange platform for experts, scholars and business managers in the fields of communication, electronic technology and computer engineering application to share their research achievements, discuss the key challenges and research directions of the development of this field, and jointly promote the industrialization cooperation and continuous innovation of international academic achievements. This collection of Proceedings compiles oral and paper presentations submitted by the authors and scrutinized by the Special Committee.List of Organizing Committee, Scientific Committee, Editorial Committee, Invited Speakers, Organizing Institutions, Sponsors are available in this pdf.
Intelligence Science and Big Data Engineering. Big Data and Machine Learning Techniques

Xiaofei He,Xinbo Gao,Yanning Zhang,Zhi‐Hua Zhou,Zhiyong Liu,Baochuan Fu,Fuyuan Hu,Zhancheng Zhang

DOI: https://doi.org/10.1007/978-3-319-23862-3

2015-01-01

Abstract:The two-volume set LNCS 9242 + 9243 constitutes the proceedings of the 5th International Conference on Intelligence Science and Big Data Engineering, IScIDE 2015, held in Suzhou, China, in June 2015.
Affective Computing for Large-Scale Heterogeneous Multimedia Data: A Survey

Sicheng Zhao,Shangfei Wang,Mohammad Soleymani,Dhiraj Joshi,Qiang Ji

DOI: https://doi.org/10.1145/3363560

2019-10-04

Abstract:The wide popularity of digital photography and social networks has generated a rapidly growing volume of multimedia data (i.e., image, music, and video), resulting in a great demand for managing, retrieving, and understanding these data. Affective computing (AC) of these data can help to understand human behaviors and enable wide applications. In this article, we survey the state-of-the-art AC technologies comprehensively for large-scale heterogeneous multimedia data. We begin this survey by introducing the typical emotion representation models from psychology that are widely employed in AC. We briefly describe the available datasets for evaluating AC algorithms. We then summarize and compare the representative methods on AC of different multimedia types, i.e., images, music, videos, and multimodal data, with the focus on both handcrafted features-based methods and deep learning methods. Finally, we discuss some challenges and future directions for multimedia affective computing.

Multimedia,Computer Vision and Pattern Recognition
ASMMC21: the 6th International Workshop on Affective Social Multimedia Computing

Dongyan Huang,Björn W. Schuller,Jianhua Tao,Lei Xie,Jie Yang

DOI: https://doi.org/10.1145/3462244.3480980

2021-01-01

Abstract:Affective social multimedia computing is an emergent research topic for both affective computing and multimedia research communities. Social multimedia is fundamentally changing how we communicate, interact, and collaborate with other people in our daily lives. Comparing with well-organized broadcast news and professionally made videos such as commercials, TV shows, and movies, social multimedia media computing imposes great challenges to research communities. Social multimedia contains much affective information. Effective extraction of affective information from social multimedia can greatly help social multimedia computing (e.g., processing, index, retrieval, and understanding). Although much progress have been made in traditional multimedia research on multimedia content analysis, indexing, and retrieval based on subjective concepts such as emotion, aesthetics, and preference, affective social multimedia computing is a new research area. The affective social multimedia computing aims to proceed affective information from social multi-media. For massive and heterogeneous social media data, the research requires multidisciplinary understanding of content and perceptual cues from social multimedia. This workshop served as a successful step towards this goal and attracted contributions from different research disciplines on the analysis of affective signals in interaction (multimodal analyses enabling artificial agents in Human-Machine Interaction, social Interaction with artificial agents) and social multimedia (e.g., twitter, wechat, weibo, youtube, facebook, etc). This paper provides a summary of the activities of the workshop and the accepted papers and abstracts.
A systematic review on affective computing: emotion models, databases, and recent advances

Yan Wang,Wei Song,Wei Tao,Antonio Liotta,Dawei Yang,Xinlei Li,Shuyong Gao,Yixuan Sun,Weifeng Ge,Wei Zhang,Wenqiang Zhang

DOI: https://doi.org/10.1016/j.inffus.2022.03.009

IF: 18.6

2022-07-01

Information Fusion

Abstract:Affective computing conjoins the research topics of emotion recognition and sentiment analysis, and can be realized with unimodal or multimodal data, consisting primarily of physical information (e.g., text, audio, and visual) and physiological signals (e.g., EEG and ECG). Physical-based affect recognition caters to more researchers due to the availability of multiple public databases, but it is challenging to reveal one's inner emotion hidden purposefully from facial expressions, audio tones, body gestures, etc. Physiological signals can generate more precise and reliable emotional results; yet, the difficulty in acquiring these signals hinders their practical application. Besides, by fusing physical information and physiological signals, useful features of emotional states can be obtained to enhance the performance of affective computing models. While existing reviews focus on one specific aspect of affective computing, we provide a systematical survey of important components: emotion models, databases, and recent advances. Firstly, we introduce two typical emotion models followed by five kinds of commonly used databases for affective computing. Next, we survey and taxonomize state-of-the-art unimodal affect recognition and multimodal affective analysis in terms of their detailed architectures and performances. Finally, we discuss some critical aspects of affective computing and its applications and conclude this review by pointing out some of the most promising future directions, such as the establishment of benchmark database and fusion strategies. The overarching goal of this systematic review is to help academic and industrial researchers understand the recent advances as well as new developments in this fast-paced, high-impact domain.

computer science, artificial intelligence, theory & methods
AIWAC: Affective Interaction Through Wearable Computing and Cloud Technology

Min Chen,Yin Zhang,Yong Li,Mohammad Mehedi Hassan,Atif Alamri

DOI: https://doi.org/10.1109/mwc.2015.7054715

IF: 12.777

2015-01-01

IEEE Wireless Communications

Abstract:To reduce the heavy burden from rapidly growing demands of healthcare service, wearable computing-assisted healthcare has been proposed for health monitoring and remote medical care. Although the provisioning of healthcare services can be significantly enhanced via wearableenabled technologies, great challenges arise due to the lack of a human-centric mechanism for affective interaction. In this article, we propose a novel architecture, Affective Interaction through Wearable Computing and Cloud Technology (AIWAC), which includes three components: collaborative data collection via wearable devices, enhanced sentiment analysis and forecasting models, and controllable affective interactions. Based on the proposed architecture, we present our AIWAC testbed, design a practical mechanism for wearable computing-based emotional interaction, and discuss its open problems, which inspire potential research as a new direction.
Review of Researches on the Emotion Recognition and Affective Computing Based on HCI

Wenqian Lin,Yunjian Zhang

DOI: https://doi.org/10.1109/ICIVC55077.2022.9886306

2022-07-26

Abstract:Human-computer interaction (HCI) is the third revolution of information technology after cloud computing and big data. In the design of HCI, it usually involves physical level, cognitive level and emotional level, while emotion recognition and affective computing (ERAC) are the main contents of emotional level. In this paper, the concept and function of ERAC are described; the progress of research on ERAC from facial expression, voice, text, physiological signal and other aspects are analyzed; the application of ERAC in the computer science, health care, media entertainment, intelligent equipment, education and other fields are expound. Finally, in order to provide reference and basis for further research, the problems that need to be studied and future work are prospected.

Psychology,Computer Science

Affective Computing and Intelligent Interaction

Affective Information Processing Introduction

Intelligent Signal Processing for Affective Computing [from the Guest Editors]

Intelligent Computing Methodologies: 10th International Conference, ICIC 2014, Taiyuan, China, August 3-6, 2014, Proceedings

Advances of Research in Affective Processes in Communication and Collaboration

Proceedings of the 2012 International Conference on Information Technology and Software Engineering: Information Technology & Computing Intelligence

Multimodal Information Processing For Affective Computing

Affect is Computable——A Survey on Affective Computing

Guest Editorial Best of ACII 2021

Proceedings of the 25th International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems: Advanced Research in Applied Artificial Intelligence

Ten Challenges for EEG-based Affective Computing

Proceedings of the 2012 International Conference on Information Technology and Software Engineering

Affective Computing in Intelligent Tutoring Systems: Exploring Insights and Innovations

Proceedings of the 2015 Chinese Intelligent Systems Conference: Volume 1

2021 International Conference on Artificial Intelligence and Information Technology

Intelligence Science and Big Data Engineering. Big Data and Machine Learning Techniques

Affective Computing for Large-Scale Heterogeneous Multimedia Data: A Survey

ASMMC21: the 6th International Workshop on Affective Social Multimedia Computing

A systematic review on affective computing: emotion models, databases, and recent advances

AIWAC: Affective Interaction Through Wearable Computing and Cloud Technology

Review of Researches on the Emotion Recognition and Affective Computing Based on HCI