Driver’s Preview Modeling Based on Visual Characteristics through Actual Vehicle Tests

Hongyu Hu,Ming Cheng,Fei Gao,Yuhuan Sheng,Rencheng Zheng
DOI: https://doi.org/10.3390/s20216237
IF: 3.9
2020-10-31
Sensors
Abstract:This paper proposes a method for obtaining driver’s fixation points and establishing a preview model based on actual vehicle tests. Firstly, eight drivers were recruited to carry out the actual vehicle test on the actual straight and curved roads. The curvature radii of test curved roads were selected to be 200, 800, and 1500 m. Subjects were required to drive at a speed of 50, 70 and 90 km/h, respectively. During the driving process, eye movement data of drivers were collected using a head-mounted eye tracker, and road front scene images and vehicle statuses were collected simultaneously. An image-world coordinate mapping model of the visual information of drivers was constructed by performing an image distortion correction and matching the images from the driving recorder. Then, fixation point data for drivers were accordingly obtained using the Identification-Deviation Threshold (I-DT) algorithm. In addition, the Jarque–Bera test was used to verify the normal distribution characteristics of these data and to fit the distribution parameters of the normal function. Furthermore, the preview points were extracted accordingly and projected into the world coordinate. At last, the preview data obtained under these conditions are fit to build general preview time probability density maps for different driving speeds and road curvatures. This study extracts the preview characteristics of drivers through actual vehicle tests, which provides a visual behavior reference for the humanized vehicle control of an intelligent vehicle.
engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
What problem does this paper attempt to address?
The paper attempts to address the problem of obtaining the driver's gaze points through actual vehicle tests and establishing a preview model. Specifically, the study aims to collect visual information, especially gaze point data, from drivers under different vehicle speeds and road curvature conditions through real driving experiments, thereby constructing a model that reflects the driver's preview behavior. This will provide a visual behavior reference for the humanized control of intelligent vehicles. ### Background and Problem Statement 1. **Importance of the Driver in Driving**: - The driver is a major component of the driver-vehicle-road closed-loop control system. - During driving, the driver acquires about 90% of environmental information through vision, which is used for judgment and decision-making, ultimately translating into driving operations. 2. **Limitations of Existing Research**: - Most studies on driver gaze points are conducted under specific environmental conditions, such as typical driving conditions or special work areas. - There is a lack of research on the distribution of driver gaze points in general driving environments. - The accuracy of gaze point information collected in existing studies cannot be guaranteed due to the lack of systematic preprocessing methods. 3. **Research Objectives**: - Design an image processing-based method to obtain the driver's preview points through actual vehicle tests. - Construct a general preview time probability density map to reflect the driver's preview behavior under different vehicle speeds and road curvature conditions. ### Experimental Design 1. **Experimental Equipment**: - Use an experimental vehicle with an open Controller Area Network (CAN) protocol. - Collect the driver's steering behavior information and vehicle dynamics information through a CAN acquisition card. - Use Tobii Glasses 2 smart eye tracker to collect the driver's gaze data. - Install a forward-looking camera and a fixed-angle dashcam to synchronously record the driver's gaze data and vehicle state information. 2. **Experimental Conditions**: - Select three different vehicle speeds (50, 70, 90 km/h) and three different road curvature radii (200, 800, 1500 m). - The experimental route includes straight and curved sections, ensuring good road surface adhesion, clear lane markings, longitudinal slope less than 5%, lateral wind speed less than 2 m/s, and low traffic volume. 3. **Experimental Process**: - Eight qualified drivers (six men and two women) participated in the experiment, with an average age of 27.13 years and an average driving experience of 3.86 years. - Drivers first familiarize themselves with the experimental route and instruments, then perform calibration to ensure the eye tracker works properly. - Drivers drive according to the predetermined route, maintaining a constant speed when approaching the test area, and record experimental data. ### Data Processing 1. **Gaze Point Acquisition**: - Use the I-DT algorithm to separate gaze points from the raw gaze data set. - Correct the distortion of the collected images and project the driver's gaze points onto the fixed-angle image coordinate system through image matching. 2. **Data Synchronization**: - Synchronize the images collected by the eye tracker and the fixed-angle dashcam based on UNIX timestamps, with an overall synchronization error of less than 1 ms. ### Main Contributions 1. **Actual Road Testing**: - Collect the driver's gaze data and vehicle dynamics information through actual vehicle tests, overcoming the reliability issues of traditional simulators and providing a real visual reference for automated driver control. 2. **Testing Under Typical Road Conditions**: - Test straight and curved sections with different curvature radii, fitting the driver's preview model and extending the model's applicability. 3. **Accurate Gaze Point Coordinates**: - Obtain more accurate gaze point coordinates through image processing steps, including image distortion correction and image matching, improving the accuracy of the driver's preview model. In summary, this paper systematically studies the visual behavior of drivers under different driving conditions through actual vehicle tests, providing important references for the humanized control of intelligent vehicles.