Abstract:With the development of the self-driving technology, more diverse in-car interaction design has become an essential tendency for the future. In order to enhance the interaction experience between driver and back-seat passenger, we propose the concept of “AEIC” (Augmented Emoji in Car). By modifying the existing in-car equipment with information augment, we can offer multi-modal ways of interaction inside the car for the driver and back-seat passenger, so that they can have a better mutual understanding of each other under the premise of safe drive regulations. By optimizing the current central rear-view mirror, the mood of back-seat passenger can be detected and judged by means of facial recognition. Though the sound, light and Emoji, the passenger’s current emotional state will be fed back to the driver. In order to test the designed scheme, we constructed a vehicle driving simulator experimental platform with highly free scalability to obtain interactive data to conduct the user research. We invited 20 participants to participate in our prototype test, by observing them simulating the driving scenes we designed in the platform, their interactive feedback information can be precisely collected. Then we conducted depth interviews with the users about the earlier experience of interactions in the simulated scenario to obtain the reference information for further design iterations. On the basis of these results we concluded that: a. With the conversion of light source color and the intervention of Emoji (symbolic expression), the driver can have a better understanding of the back-seat passenger’s emotional state. b. The information interface, which is designed based on the attention span and short-term memory, can optimizing information output in the car without increasing the cognitive load. However, we found that there are significant differences in interactive feedbacks of different user combinations in scenario simulation. Accordingly, we should design according to different users. At the same time, we believe that the experiments based on the vehicle driving simulator platform is conducive to the preliminary basic research on in-car interaction. By amplifying interaction feedback in the driving scenes, the designers can identify the potential design needs more conveniently. Therefore, we will continue to use the platform to conduct the simulation experiments on the design prototype in the follow-up research to gradually address the gap in the interaction between the front-seat driver and back-seat passenger.

Enablers or Inhibitors? Unpacking the Emotional Power Behind In-Vehicle AI Anthropomorphic Interaction: A Dual-Factor Approach by Text Mining

Forecasting the Evolution of Urban Mobility: the Influence of Anthropomorphism and Social Responsiveness in the Transition from Human to Automated Driving

AI-Enabled Emotion Communication

Exploring the emotional mechanism of consumer satisfaction in new energy vehicles: a dual-path model of intelligent and eco-friendly experiences

Emotion-matched in-vehicle assistants: an exploration in regulating drivers' incidental emotions and enhancing takeover performance and situational awareness

Driving with agents: Investigating the influences of anthropomorphism level and physicality of agents on drivers' perceived control, trust, and driving performance

Intelligent Agents in Cars: Investigating the Effects of Anthropomorphism and Physicality of Agents in Driving Contexts

Using a Configurational Approach to Examine the Impacts of Vehicle Appearance Perception on Pedestrian Acceptance of the External Human-Machine Interfaces on Autonomous Vehicles

Driver Emotion Recognition Involving Multimodal Signals: Electrophysiological Response, Nasal-Tip Temperature, and Vehicle Behavior

What If Your Car Would Care? Exploring Use Cases For Affective Automotive User Interfaces

Designing Future In-Vehicle Assistants: Insights from User Imaginations and Experiences.

Review and Perspectives on Human Emotion for Connected Automated Vehicles

Intelligent Cockpit for Intelligent Vehicle in Metaverse: A Case Study of Empathetic Auditory Regulation of Human Emotion.

Human-computer interaction: Evaluation of trust and emotional

Emo-View: Convey the Emotion of the Back-Seat Passenger with an Emoji in Rear-View Mirror to the Driver.

Motivation, Social Emotion, and the Acceptance of Artificial Intelligence Virtual Assistants-Trust-Based Mediating Effects

Acceptability Study of Emotional Expressions of In-Vehicle Virtual Assistant

How Can Autonomous Vehicles Convey Emotions to Pedestrians? A Review of Emotionally Expressive Non-Humanoid Robots

Enhancing Trust in Autonomous Vehicles through Intelligent User Interfaces That Mimic Human Behavior

Affective Automotive User Interfaces -- Reviewing the State of Emotion Regulation in the Car