Abstract:With the development of the self-driving technology, more diverse in-car interaction design has become an essential tendency for the future. In order to enhance the interaction experience between driver and back-seat passenger, we propose the concept of “AEIC” (Augmented Emoji in Car). By modifying the existing in-car equipment with information augment, we can offer multi-modal ways of interaction inside the car for the driver and back-seat passenger, so that they can have a better mutual understanding of each other under the premise of safe drive regulations. By optimizing the current central rear-view mirror, the mood of back-seat passenger can be detected and judged by means of facial recognition. Though the sound, light and Emoji, the passenger’s current emotional state will be fed back to the driver. In order to test the designed scheme, we constructed a vehicle driving simulator experimental platform with highly free scalability to obtain interactive data to conduct the user research. We invited 20 participants to participate in our prototype test, by observing them simulating the driving scenes we designed in the platform, their interactive feedback information can be precisely collected. Then we conducted depth interviews with the users about the earlier experience of interactions in the simulated scenario to obtain the reference information for further design iterations. On the basis of these results we concluded that: a. With the conversion of light source color and the intervention of Emoji (symbolic expression), the driver can have a better understanding of the back-seat passenger’s emotional state. b. The information interface, which is designed based on the attention span and short-term memory, can optimizing information output in the car without increasing the cognitive load. However, we found that there are significant differences in interactive feedbacks of different user combinations in scenario simulation. Accordingly, we should design according to different users. At the same time, we believe that the experiments based on the vehicle driving simulator platform is conducive to the preliminary basic research on in-car interaction. By amplifying interaction feedback in the driving scenes, the designers can identify the potential design needs more conveniently. Therefore, we will continue to use the platform to conduct the simulation experiments on the design prototype in the follow-up research to gradually address the gap in the interaction between the front-seat driver and back-seat passenger.

Acceptability Study of Emotional Expressions of In-Vehicle Virtual Assistant

Discovering the Power of External Human-Machine Interface: an EEG Study on the Driving Anger Regulation

Emotion-matched in-vehicle assistants: an exploration in regulating drivers' incidental emotions and enhancing takeover performance and situational awareness

Affective Care to Drivers by an Interactive Automobile Interface System

Drivers' Attitudes, Preference, and Acceptance of In-Vehicle Anger Intervention Systems and Their Relationships to Demographic and Personality Characteristics

The influence of tactile feedback in In-vehicle central control interfaces on driver emotions: A comparative study of touchscreens and physical buttons

Using a Configurational Approach to Examine the Impacts of Vehicle Appearance Perception on Pedestrian Acceptance of the External Human-Machine Interfaces on Autonomous Vehicles

Happiness and high reliability develop affective trust in in-vehicle agents

What If Your Car Would Care? Exploring Use Cases For Affective Automotive User Interfaces

Human-computer interaction: Evaluation of trust and emotional

Evaluating the Feasibility of Emotion Expressions in Avatars Created From Real Person Photos: Pilot Web-Based Survey of Virtual Reality Software

A Tale of Three Advantages: Cross-Cultural Recognition of Basic Emotions Through Virtual Stickers

Voices that Care Differently: Understanding the Effectiveness of a Conversational Agent with an Alternative Empathy Orientation and Emotional Expressivity in Mitigating Verbal Abuse

Designing and Evaluating an Emotionally Responsive Virtual Patient Simulation

Investigating emotion fluctuations in driving behaviors of online car-hailing drivers using naturalistic driving data

Review and Perspectives on Human Emotion for Connected Automated Vehicles

Affective responses to chromatic ambient light in a vehicle

Affective Automotive User Interfaces -- Reviewing the State of Emotion Regulation in the Car

Driver Emotion Recognition Involving Multimodal Signals: Electrophysiological Response, Nasal-Tip Temperature, and Vehicle Behavior

Emo-View: Convey the Emotion of the Back-Seat Passenger with an Emoji in Rear-View Mirror to the Driver.

The Effect of Acceptability and Personality on the Intention to Use Automated Vehicles among Chinese Samples