Study the Model of the Comprehensive Perception of Humachined Intelligent System

Canjun YANG,Ying CHEN

DOI: https://doi.org/10.3969/j.issn.1000-8152.2000.02.014

2000-01-01

Abstract:This paper studied on modeling the humachined perception of humachined system based on the analysis of human and machine's perception, and the humachined percepdon system for the intelligent driving system had been introduced simply.

What problem does this paper attempt to address?

Study on the humachine intelligent system and its application

Canjun Yang

DOI: https://doi.org/10.3901/jme.2000.06.042

IF: 2.964

2000-01-01

Chinese Journal of Mechanical Engineering

Abstract:A new method for setting up the Intelligent system is put forward aimed at the localization of the study on inteligent system at present.This new method is setting up humachined intelligent system.The model of humachinde intelligent system is constituted.The three kinds of humachined cooperation methods such as Human Master/Machine Slave(HM/MS) and Machine Master/HumanSlave(MM/HM)and Human Machine Equivalence(HME)has been adopted to accomplish the humachined intelligence.Automobillism is a very complicated manipulation.In order to improve the security of automobilism,A new humachinde intelligent driving method based on the idea of humachine system has been put forward.The simulation experimentation by automobile simulator is done.The humachined intelligent system has prodigious feasibility and superiority is indicated.
Research of sentient city under guidance of new concept

Jun MENG,Wen-yuan XU,Xi-meng ZHAO

DOI: https://doi.org/10.3785/j.issn.1008-973X.2017.08.024

2017-01-01

Abstract:A new concept was proposed to achieve a goal that machine can proactively sense human information,such as physiological states,emotions and behaviors,and provide effective interventions for human and environment.The core of the concept is that machine senses human information proactively and spontaneously.The new concept was compared with a similar concept,ambient intelligence.The core and components of sentient city was elaborated based on the new concept.A coupling relation between information and devices was proposed.A platform of sentient city was constructed.The platform is centered on the core that machine proactively senses human information and environment can spontaneously adapt to human.The platform was compared with a platform proposed by IBM.An example of a chair was taken to illustrate how to achieve the goal that machine proactively senses human information,self-regulation of environment and make the environment fit human in a Sentient City.
Applying a WNN-HMM Based Driver Model in Human Driver Simulation: Method and Test.

Bin Shi,Li Xu,Wuqiang Meng

DOI: https://doi.org/10.1109/TITS.2017.2776118

IF: 8.5

2018-01-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Modeling and evaluation of human driving behavior are the core to intelligent transportations and autonomous vehicles. This paper applies a human-like driver model based on vehicle test data and the neural network. This is accomplished by compromising the merits of error-based HMM-PID module and style-based neural network algorithm, both of which will work together to form a united driver model. I...
A Simulation System for Human-in-the-Loop Driving

Yan Li,Yuanqi Su,Xiaoning Zhang,Qingchao Cai,Haoang Lu,Yuehu Liu

DOI: https://doi.org/10.1109/itsc55140.2022.9921924

2022-01-01

Abstract:By combining driver's ability with the machine intelligence, we are trying to augment the system with the combination of both roles during driving. The human-in-the-loop hybrid-augmented system is expected to monitor and model drivers' behavior; while the current datasets for driving mainly focus on the data of scene. The lack of the driver's data restricts the capability to understand driver's inner state. In the paper, we supply an effective way to monitor the driver and construct a simulation system for the human-in-the-loop autonomous driving, which realizes the modeling of driver's behavior. Based on it, we provide a data acquisition scheme for both driver's behavior and scene content and subsequently construct the corresponding dataset. For the simulated driving dataset, we provide a method for evaluating the human-in-the-loop-system, which can help the community to develop such human-in-the-loop systems.
Design of Human-Machine Interaction Interface for Autonomous Vehicles Based on Multidimensional Perceptual Context

Jin Lu,Jun Ma,Zaiyan Gong

DOI: https://doi.org/10.1155/2021/5859800

2021-11-25

Scientific Programming

Abstract:The objective of the study is to provide guidance for automobile human-computer interface design through the research, practice, and evaluation of intelligent driving automobile human-computer interfaces. In this study, the methods of intelligent vehicle automatic cruise control function, theoretical models of the situation analysis, and a three-level information architecture are proposed and designed. During the study, interface space layout is combined with the interactive interface design. The results obtained on the basis of the proposed three levels of perception and prediction of situation awareness are combined with typical application scenarios. The information on AR-HUD and W-HUD in anterior cingulate cortex (or ACC) function is analyzed. The feasibility of the theory is verified through the design practice of information architecture design, key prototype, and typical effect diagram. The human-computer interaction interface based on situational awareness can effectively clarify the display content and process of information and improve the usability of the interface.

computer science, software engineering
A review of sensory interactions between autonomous vehicles and drivers

Jiayi Lu,Zhaoxia Peng,Shichun Yang,Yuan Ma,Rui Wang,Zhaowen Pang,Xinjie Feng,Yuyi Chen,Yaoguang Cao

DOI: https://doi.org/10.1016/j.sysarc.2023.102932

IF: 5.836

2023-06-28

Journal of Systems Architecture

Abstract:Nowadays, human-oriented has already become the direction of the development of the intelligent vehicle, among which, the cabin, in constant contact with drivers, is getting more and more attention. Intelligent assisted systems have alleviated the burden on drivers during long journeys and provided a remedy for operational errors. As the trend towards increasingly intelligent vehicles, the issue of human-machine co-driving is receiving attention from scientific researchers. The technologies of human-machine interactions usually contain two parts, the human-to-vehicle and vehicle-to-human. This paper analyzes the potential innovation of human-machine systems from the perspective of human sensing, including visual, auditory, tactile, and olfactory. Based on the review of human-machine technologies, the current intelligentization of vehicles is divided into driver interaction and crew service systems. Then, the structure of a future intelligent interaction system considering multi-sensing is proposed and further discussed. Finally, by analyzing the relationship between the system for human and autonomous systems, a classification of the intelligence level for interaction systems is presented.

computer science, software engineering, hardware & architecture
iCPS-Car: An Intelligent Cyber-physical System for Smart Automobiles

Sha Zhao,Shijian Li,Longbiao Chen,Yang Ding,Zeming Zheng,Gang Pan

DOI: https://doi.org/10.1109/GreenCom-iThings-CPSCom.2013.145

2013-01-01

Abstract:Automobiles are becoming increasingly important in our daily life. However, people usually need to cost lots of efforts and time to get their required services. On one hand, an automobile itself consists of many physical processes to achieve its traditional functionality, on the other hand, it is being integrated with more and more sensors and actuators, which makes it a typical cyber-physical system. In order to provide friendly and human-centric services for users, we proposed the Intelligent Cyber-Physical System for automobiles (iCPS-Car) for automobiles. iCPS-Car integrates people, cars and cyber spaces together and provides natural interaction manners, and personalized and continuous services. A prototype, along with several applications such as remote surveillance, gesture-based control, media migration, was built and evaluated to verify the efficiency of iCPS-Car. The prototype car has been exhibited on Beijing Auto 2012.
Establishing Style-Oriented Driver Models by Imitating Human Driving Behaviors

Li Xu,Jie Hu,Hong Jiang,Wuqiang Meng

DOI: https://doi.org/10.1109/tits.2015.2409870

IF: 8.5

2015-01-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Driver modeling is important for both automobile industry and intelligent transportation. One of its key topics has been studied in this paper, i.e., the style-oriented driver modeling for speed control, and a modeling scheme based on distal learning control and real-world vehicle test data (VTD) is proposed to make this possible. The driver model adapts to be an inverse model of the vehicle at run, which is accomplished under the distal guidance of the discrepancy between the actual and the desired vehicle speed. To tackle the divergence and local mutability of real-world vehicle data, the partly connected multilayered perceptron (PCMLP), which is a locally designed neural network, is utilized to fulfill the imitating of human operations on gas or brake pedals during real-world driving. The FTP-75 driving cycles are borrowed to test the established driver models, and driving styles of the original human drivers are retained and reproduced while accomplishing the speed following task. Simulations are conducted to verify the effectiveness of the proposed scheme.
Analysis of intelligent and connected vehicles driving system modeling

Hong Zhang,Zan Zheng,Hailiang Yu,Gang Yang,Shengdong Yuan

DOI: https://doi.org/10.1177/09544070241228643

2024-02-01

Proceedings of the Institution of Mechanical Engineers Part D Journal of Automobile Engineering

Abstract:Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, Ahead of Print. In response to the limitations of traditional offline static simulation modeling technology in accurately addressing the intricacies and complexities of intelligent and connected vehicles (ICVs) driving processes, this paper introduces the concept of an ICV driving system (ICVDS) model based on digital twin technology. Firstly, the paper delves into the theory of ICVDS digital twin modeling, covering aspects such as model elements and the operational mechanism of the model. The ICVDS, which relies on digital twin (DT) technology, is designed in accordance with the characteristics of ICVs, their technical requirements, and the architecture of the DT system. Subsequently, the paper explores four key areas: the modeling of driving elements, the modeling of the driving process, simulation modeling of the driving process, and a summary of modeling technology. The section on modeling driving elements primarily elucidates the methodology for creating twin models and illustrates how these models describe the system's functionality in controlling the subject. The segment on modeling the driving process elucidates the approach to real-time data-driven modeling. The part on driving process simulation modeling explains the methodology for establishing simulation models and demonstrates how they predict the future state of the subject. Lastly, the paper introduces the construction of autonomous driving test scenarios based on ICVDS.

engineering, mechanical,transportation science & technology
Analyze on multi-vehicle coordination-enhanced intelligent driving framework based on human–machine hybrid intelligence

Zhaohui Yuan,Lin Li

DOI: https://doi.org/10.1007/s00500-023-07837-2

IF: 3.732

2023-01-31

Soft Computing

Abstract:With the gradual popularization of automobiles, it has become a very important means of transportation for people, bringing a lot of convenience to people’s travel. In the field of driving, with the development of intelligent communication technology, intelligent driving vehicles “drive into” people’s field of vision. In contemporary society, intelligence is integrated into all aspects of life and is more and more inseparable from intelligence. In order to research multi-vehicle coordination-enhanced intelligent driving framework based on human–machine hybrid intelligence, from the perspective of human–machine hybrid intelligence, this paper takes multi-vehicle coordination as the starting point, introduces the fish swarm effect and builds a multi-vehicle coordinated, intelligent driving system with strong self-adaptability and scalability, so that it can adapt to more complex and real road environments.

computer science, artificial intelligence, interdisciplinary applications
A Hidden Markov Model Based Driver Intention Prediction System

Duy Tran,Weihua Sheng,Li Liu,Meiqin Liu

DOI: https://doi.org/10.1109/cyber.2015.7287920

2015-01-01

Abstract:Awareness of other vehicle's intention may help human drivers or autonomous vehicles judge the risk and avoid traffic accidents. This paper proposed an approach to predicting driver's intentions using Hidden Markov Model (HMM) which is able to access the control and the state of the vehicle. The driver performs maneuvers including stop/non-stop, change lane left/right and turn left/right in a simulator in both highway and urban environments. Moreover, the structure of the road (curved road) is also taken into account for classification. Experiments were conducted with different input sets (steering wheel data with and without vehicle state data) to compare the system performance.
A Data-Driven Path-Tracking Model Based on Visual Perception Behavior Analysis and ANFIS Method

Ziniu Hu,Yue Yu,Zeyu Yang,Haotian Zhu,Lvfan Liu,Yunshui Zhou

DOI: https://doi.org/10.3390/electronics13010061

IF: 2.9

2023-12-22

Electronics

Abstract:This paper proposes a data-driven human-like driver model (HDM) based on the analysis and understanding of human drivers' behavior in path-tracking tasks. The proposed model contains a visual perception module and a decision-making module. The visual perception module was established to extract the visual inputs, including road information and vehicle motion states, which can be perceived by human drivers. The extracted inputs utilized for lateral steering decisions can reflect specific driving skills exhibited by human drivers like compensation control, preview behavior, and anticipation ability. On this basis, an adaptive neuro-fuzzy inference system (ANFIS) was adopted to design the decision-making module. The inputs of the ANFIS include the vehicle speed, lateral deviation in the near zone, and heading angle error in the far zone. The output is the steering wheel angle. ANFIS can mimic the fuzzy reasoning characteristics of human driving behavior. Next, a large amount of human driving data was collected through driving simulator experiments. Based on the data, the HDM was established. Finally, the results of the joint simulation under PreScan/MATLAB verified the superior performances of the proposed HDM.

engineering, electrical & electronic,computer science, information systems,physics, applied
A Human-Like Model to Understand Surrounding Vehicles’ Lane Changing Intentions for Autonomous Driving

Yingji Xia,Zhaowei Qu,Zhe Sun,Zhihui Li

DOI: https://doi.org/10.1109/tvt.2021.3073407

IF: 6.8

2021-05-01

IEEE Transactions on Vehicular Technology

Abstract:Autonomous vehicles have to share the road with human-driven ones for a prolonged period in the near future. Thus, they should have the ability to understand the lane changing intentions of surrounding human-driven vehicles. Unlike human drivers, the state-of-the-art models used in autonomous vehicles recognize a driver's lane changing intention based on the target vehicle's lateral movement, which leaves little to no time for the autonomous vehicle to react. In this paper, a Human-like Lane Changing Intention Understanding Model (HLCIUM) for autonomous driving is proposed to understand the lane changing intentions of surrounding vehicles. By imitating the selective attention mechanism of human vision systems, the proposed model emulates the way human drivers concentrate on the surrounding vehicles and recognizes their lane changing intentions accordingly. The velocity changes of the surrounding vehicles are treated as the lane changing hints, and the attention is drawn to the corresponding vehicle following a saliency-based scheme. Then, the lane changing intention is identified by a Hidden Markov Model (HMM) based intention recognizer. The proposed model is tested with Next Generation Simulation (NGSIM) vehicle trajectory dataset, and the proposed method has reached 90.89% in detecting lane changing intention and 88.58% in lane keeping in urban road scenarios, and reached 87.73% and 87.48% for the lane changing and lane keeping intentions in highway scenarios, respectively. Importantly, the average recognition time before the lane changing maneuver of the proposed model is 6.67 seconds for the urban road datasets and 7.08 seconds for the highway datasets, which is far earlier than state-of-the-art models. Furthermore, the proposed method shows efficiency and robustness in complex real urban traffic datasets, which is ideal to use in human-like autonom-us driving systems.

telecommunications,engineering, electrical & electronic,transportation science & technology
How to Evaluate Human-likeness of Interaction-aware Driver Models

Jemin Woo,Changsun Ahn

2024-02-29

Abstract:This study proposes a method for qualitatively evaluating and designing human-like driver models for autonomous vehicles. While most existing research on human-likeness has been focused on quantitative evaluation, it is crucial to consider qualitative measures to accurately capture human perception. To this end, we conducted surveys utilizing both video study and human experience-based study. The findings of this research can significantly contribute to the development of naturalistic and human-like driver models for autonomous vehicles, enabling them to safely and efficiently coexist with human-driven vehicles in diverse driving scenarios.

Systems and Control,Robotics
Brain Inspired Cognitive Model with Attention for Self-Driving Cars

Shitao Chen,Songyi Zhang,Jinghao Shang,Badong Chen,Nanning Zheng

DOI: https://doi.org/10.48550/arXiv.1702.05596

2017-02-18

Abstract:Perception-driven approach and end-to-end system are two major vision-based frameworks for self-driving cars. However, it is difficult to introduce attention and historical information of autonomous driving process, which are the essential factors for achieving human-like driving into these two methods. In this paper, we propose a novel model for self-driving cars named brain-inspired cognitive model with attention (CMA). This model consists of three parts: a convolutional neural network for simulating human visual cortex, a cognitive map built to describe relationships between objects in complex traffic scene and a recurrent neural network that combines with the real-time updated cognitive map to implement attention mechanism and long-short term memory. The benefit of our model is that can accurately solve three tasks simultaneously:1) detection of the free space and boundaries of the current and adjacent lanes. 2)estimation of obstacle distance and vehicle attitude, and 3) learning of driving behavior and decision making from human driver. More significantly, the proposed model could accept external navigating instructions during an end-to-end driving process. For evaluation, we build a large-scale road-vehicle dataset which contains more than forty thousand labeled road images captured by three cameras on our self-driving car. Moreover, human driving activities and vehicle states are recorded in the meanwhile.

Computer Vision and Pattern Recognition,Robotics
Driving Behavior Modeling and Characteristic Learning for Human-like Decision-Making in Highway

Can Xu,Wanzhong Zhao,Chunyan Wang,Taowen Cui,Chen Lv

DOI: https://doi.org/10.1109/tiv.2022.3224912

IF: 8.2

2023-02-01

IEEE Transactions on Intelligent Vehicles

Abstract:To make autonomous vehicles consider driver's personalized characteristics, this paper proposes an integrated model and learning combined (IMLC) algorithm to realize human-like driving. It includes the integrated driving behavior modeling to ensure basic safety and the characteristic learning to further imitate human driver's style. Firstly, an integrated behavior model is built according to driver's operation logics, including lane advantage assessment, target lane selection and acceleration determination. The lane advantage is assessed by five lane features, like safety, efficiency, cooperativity, etc. Then, parameters of the built model are learned from human's demonstrations. For the lane selection parameter, a novel lane feature extraction method is presented and the maximum entropy inverse reinforcement learning (IRL) is adopted to solve. For the acceleration parameter, since it's hard to extract human's acceleration features accurately, the particle filtering is used to estimate. Finally, the IMLC algorithm is validated in highD dataset compared to existing algorithms. The results show that the RMSE of position and velocity in 9s are within 4.2 m and 0.9 ms, which has great advantage. Moreover, we test the human-like performance in driver simulator. The safety and efficiency in this process are fairly approximate.

English Else
DME-Driver: Integrating Human Decision Logic and 3D Scene Perception in Autonomous Driving

Wencheng Han,Dongqian Guo,Cheng-Zhong Xu,Jianbing Shen

2024-01-08

Abstract:In the field of autonomous driving, two important features of autonomous driving car systems are the explainability of decision logic and the accuracy of environmental perception. This paper introduces DME-Driver, a new autonomous driving system that enhances the performance and reliability of autonomous driving system. DME-Driver utilizes a powerful vision language model as the decision-maker and a planning-oriented perception model as the control signal generator. To ensure explainable and reliable driving decisions, the logical decision-maker is constructed based on a large vision language model. This model follows the logic employed by experienced human drivers and makes decisions in a similar manner. On the other hand, the generation of accurate control signals relies on precise and detailed environmental perception, which is where 3D scene perception models excel. Therefore, a planning oriented perception model is employed as the signal generator. It translates the logical decisions made by the decision-maker into accurate control signals for the self-driving cars. To effectively train the proposed model, a new dataset for autonomous driving was created. This dataset encompasses a diverse range of human driver behaviors and their underlying motivations. By leveraging this dataset, our model achieves high-precision planning accuracy through a logical thinking process.

Robotics,Computer Vision and Pattern Recognition
Influences on Drivers' Understandings of Systems by Presenting Image Recognition Results

Bo Yang,Koichiro Inoue,Satoshi Kitazaki,Kimihiko Nakano

DOI: https://doi.org/10.48550/arXiv.2106.13388

2021-06-25

Abstract:It is essential to help drivers have appropriate understandings of level 2 automated driving systems for keeping driving safety. A human machine interface (HMI) was proposed to present real time results of image recognition by the automated driving systems to drivers. It was expected that drivers could better understand the capabilities of the systems by observing the proposed HMI. Driving simulator experiments with 18 participants were preformed to evaluate the effectiveness of the proposed system. Experimental results indicated that the proposed HMI could effectively inform drivers of potential risks continuously and help drivers better understand the level 2 automated driving systems.

Human-Computer Interaction
Evaluation and Prediction of Driver's Bad Driving Behavior Based on the Moving Vehicle Attitude

Huaikun Xiang,Shaopeng Yang,Shi An,Shaoyun Ren

DOI: https://doi.org/10.14257/ijsia.2015.9.11.07

2015-01-01

International Journal of Security and Its Applications

Abstract:The driver takes leading part in the complex model of "human-vehicle-roadenvironment". The driving behavior has the characteristics of randomness, impulsivity and autonomy etc. which make it difficult to study the driver's driving behavior directly. Monitoring vehicle attitude is an important element of proactive safety management of public transport vehicles. This paper constructs a data acquisition system by using an InvenSense's 6-Axis inertial measurement unit (IMU) as the center of this system, which can sense the vehicle attitude information to make up for the lack of driver senses, and then builds fuzzy synthetical evaluation model which is combined with ISO 26311:1997/Amd 1:2010 standard. Finally, prediction of the driver's driving behavior in transient term has been established with Elman neural network method.
Data and Decision Intelligence for Human-in-the-Loop Cyber-Physical Systems: Reference Model, Recent Progresses and Challenges.

Meng Ma,Weilan Lin,Disheng Pan,Yangxin Lin,Ping Wang,Yuchen Zhou,Xiaoxing Liang

DOI: https://doi.org/10.1007/s11265-017-1304-0

2017-01-01

Journal of Signal Processing Systems

Abstract:With the rapid development of sensing technology, Cyber-Physical Systems (CPS) are connecting our real-world and cyber spaces by real-time situation awareness and intelligent control. In this process, one of the major challenge is how to make fast, accurate and intelligent decisions based on high-dimension, speed and volume sensing data stream. In this paper, we put human into the traditional CPS data process model and formulate a closed-loop computing paradigm for CPS data and decision intelligence. We propose a human-in-the-loop reference model for CPS, which extends the traditional cyber-physical interaction into a closed-loop process based on cyber, physical and human factors. We define the key features of human-in-the-loop CPS, summarize it as three aspects: semantic, interactive, iterative and analyze the major challenges from the perspective of data characteristics. Recent progresses in three typical application domains are reviewed and examined for their decision models and whether they have solved the target issues of human-in-the-loop CPS. According to the review and comparison, the paper finally summarizes several key future opportunities to establish an intelligent human-in-the-loop CPS.

Study the Model of the Comprehensive Perception of Humachined Intelligent System

Study on the humachine intelligent system and its application

Research of sentient city under guidance of new concept

Applying a WNN-HMM Based Driver Model in Human Driver Simulation: Method and Test.

A Simulation System for Human-in-the-Loop Driving

Design of Human-Machine Interaction Interface for Autonomous Vehicles Based on Multidimensional Perceptual Context

A review of sensory interactions between autonomous vehicles and drivers

iCPS-Car: An Intelligent Cyber-physical System for Smart Automobiles

Establishing Style-Oriented Driver Models by Imitating Human Driving Behaviors

Analysis of intelligent and connected vehicles driving system modeling

Analyze on multi-vehicle coordination-enhanced intelligent driving framework based on human–machine hybrid intelligence

A Hidden Markov Model Based Driver Intention Prediction System

A Data-Driven Path-Tracking Model Based on Visual Perception Behavior Analysis and ANFIS Method

A Human-Like Model to Understand Surrounding Vehicles’ Lane Changing Intentions for Autonomous Driving

How to Evaluate Human-likeness of Interaction-aware Driver Models

Brain Inspired Cognitive Model with Attention for Self-Driving Cars

Driving Behavior Modeling and Characteristic Learning for Human-like Decision-Making in Highway

DME-Driver: Integrating Human Decision Logic and 3D Scene Perception in Autonomous Driving

Influences on Drivers' Understandings of Systems by Presenting Image Recognition Results

Evaluation and Prediction of Driver's Bad Driving Behavior Based on the Moving Vehicle Attitude

Data and Decision Intelligence for Human-in-the-Loop Cyber-Physical Systems: Reference Model, Recent Progresses and Challenges.