Abstract:With the development of the self-driving technology, more diverse in-car interaction design has become an essential tendency for the future. In order to enhance the interaction experience between driver and back-seat passenger, we propose the concept of “AEIC” (Augmented Emoji in Car). By modifying the existing in-car equipment with information augment, we can offer multi-modal ways of interaction inside the car for the driver and back-seat passenger, so that they can have a better mutual understanding of each other under the premise of safe drive regulations. By optimizing the current central rear-view mirror, the mood of back-seat passenger can be detected and judged by means of facial recognition. Though the sound, light and Emoji, the passenger’s current emotional state will be fed back to the driver. In order to test the designed scheme, we constructed a vehicle driving simulator experimental platform with highly free scalability to obtain interactive data to conduct the user research. We invited 20 participants to participate in our prototype test, by observing them simulating the driving scenes we designed in the platform, their interactive feedback information can be precisely collected. Then we conducted depth interviews with the users about the earlier experience of interactions in the simulated scenario to obtain the reference information for further design iterations. On the basis of these results we concluded that: a. With the conversion of light source color and the intervention of Emoji (symbolic expression), the driver can have a better understanding of the back-seat passenger’s emotional state. b. The information interface, which is designed based on the attention span and short-term memory, can optimizing information output in the car without increasing the cognitive load. However, we found that there are significant differences in interactive feedbacks of different user combinations in scenario simulation. Accordingly, we should design according to different users. At the same time, we believe that the experiments based on the vehicle driving simulator platform is conducive to the preliminary basic research on in-car interaction. By amplifying interaction feedback in the driving scenes, the designers can identify the potential design needs more conveniently. Therefore, we will continue to use the platform to conduct the simulation experiments on the design prototype in the follow-up research to gradually address the gap in the interaction between the front-seat driver and back-seat passenger.

Exploring user cognition difference and pleasure balance guidance method for product perceptible features in vehicle-mounted system

Using Psychophysiological Measures to Evaluate the Multisensory and Emotional Dynamics of the Tea Experience

Discovering the Power of External Human-Machine Interface: an EEG Study on the Driving Anger Regulation

Augmented Affective-Cognition for Usability Study of In-Vehicle System User Interface

Using a Configurational Approach to Examine the Impacts of Vehicle Appearance Perception on Pedestrian Acceptance of the External Human-Machine Interfaces on Autonomous Vehicles

A new approach for product evaluation based on integration of EEG and eye-tracking

An integrated decision-making method for product design scheme evaluation based on cloud model and EEG data

A Cyber-Physical System for Product Conceptual Design Based on an Intelligent Psycho-Physiological Approach

Intelligent emotion recognition in product design using multimodal physiological signals and machine learning

Cognitive task analysis-driven intelligent steering wheel interaction design

A user experience map design method based on emotional quantification of in-vehicle HMI

Vehicle Human-Machine Interaction Interface Evaluation Method Based on Eye Movement and Finger Tracking Technology

In-Vehicle Human Machine Interface: Investigating the Effects of Tactile Displays on Information Presentation in Automated Vehicles

Study on physiological representation of passenger cognitive comfort: An example with overtaking scenarios

Driver Emotion Recognition Involving Multimodal Signals: Electrophysiological Response, Nasal-Tip Temperature, and Vehicle Behavior

Emo-View: Convey the Emotion of the Back-Seat Passenger with an Emoji in Rear-View Mirror to the Driver.

Analysis of Relationship between Electroencephalograms and Subjective Measurements for In-Vehicle Information System: A Preliminary Study

Application of Neural Network Based on Visual Recognition in Color Perception Analysis of Intelligent Vehicle HMI Interactive Interface under User Experience

Research on Performance-oriented Perceptual Image Evaluation Method for Cus Tomized Products

Design of Human-Machine Interaction Interface for Autonomous Vehicles Based on Multidimensional Perceptual Context

The Influence of Screen Brightness and Saturation on Emotional Perception in Human-Machine Interactions: A Functional Near-Infrared Spectroscopy Study