Abstract:Abstract Autonomous driving at intersections is one of the most complicated and accident-prone traffic scenarios, especially with mixed traffic participants such as vehicles, bicycles and pedestrians. The driving policy should make safe decisions to handle the dynamic traffic conditions and meet the requirements of on-board computation. However, most of the current researches focuses on simplified intersections considering only the surrounding vehicles and idealized traffic lights. This paper improves the integrated decision and control framework and develops a learning-based algorithm to deal with complex intersections with mixed traffic flows, which can not only take account of realistic characteristics of traffic lights, but also learn a safe policy under different safety constraints. We first consider different velocity models for green and red lights in the training process and use a finite state machine to handle different modes of light transformation. Then we design different types of distance constraints for vehicles, traffic lights, pedestrians, bicycles respectively and formulize the constrained optimal control problems (OCPs) to be optimized. Finally, reinforcement learning (RL) with value and policy networks is adopted to solve the series of OCPs. In order to verify the safety and efficiency of the proposed method, we design a multi-lane intersection with the existence of large-scale mixed traffic participants and set practical traffic light phases. The simulation results indicate that the trained decision and control policy can well balance safety and tracking performance. Compared with model predictive control (MPC), the computational time is three orders of magnitude lower.

Coordinated Real-Time Control Algorithm for Multi-Crossing Traffic Lights.

Regional Signal Coordinated Control System Based on an Ant Algorithm

Adaptive signal control for urban traffic network gridlock

Fuzzy Neural Network Control Technique and Its Application in A Complex Intersection

Study on Intelligent Control for Urban Region Traffic

Traffic Scheduling and Control in Fully Connected and Automated Networks

General Multi-Phase Intelligent Control Method for Traffic Flow at Single Intersection

Integrated decision and control at multi-lane intersections with mixed traffic flow

Urban Traffic Signal System Control Structural Optimization Based on Network Analysis

Research on Multi-Objective Optimization Models for Intersection Crossing of Connected Autonomous Vehicles With Traffic Signals

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning

Two-layer Coordinated Reinforcement Learning for Traffic Signal Control in Traffic Network

Intelligent Control Scheme for Traffic Signals at Multi-intersections based on Pedestrian Safety

Reinforcement Learning-Based Adaptive Optimal Control Model for Signal Light in Intelligent Transportation Systems

Pareto Front–based Multi-Objective Real-Time Traffic Signal Control Model for Intersections Using Particle Swarm Optimization Algorithm

An Information Fusion Approach to Intelligent Traffic Signal Control Using the Joint Methods of Multiagent Reinforcement Learning and Artificial Intelligence of Things

Researches on Intelligent Traffic Signal Control Based on Deep Reinforcement Learning

Urban Arterial Traffic Intelligent Coordination Control Technique And Its Application

Environmental Adaptive Urban Traffic Signal Control Based on Reinforcement Learning Algorithm

Optimizing Traffic Efficiency Via a Reinforcement Learning Approach Based on Time Allocation

Multiobjective Reinforcement Learning for Traffic Signal Control Using Vehicular Ad Hoc Network