Abstract:Shared Automated Vehicles (SAVs) Fleets companies are starting pilot projects nationwide. In 2020 in Fairfax Virginia it was announced the first Shared Autonomous Vehicle Fleet pilot project in Virginia. SAVs promise to improve quality of life. However, SAVs will also induce some negative externalities by generating excessive vehicle miles traveled (VMT), which leads to more congestions, energy consumption, and emissions. The excessive VMT are primarily generated via empty relocation process. Reinforcement Learning based algorithms are being researched as a possible solution to solve some of these problems: most notably minimizing waiting time for riders. But no research using Reinforcement Learning has been made about reducing parking space cost nor reducing empty cruising time. This study explores different \textbf{Reinforcement Learning approaches and then decide the best approach to help minimize the rider waiting time, parking cost, and empty travel

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve several key problems in the fleet management of shared autonomous vehicles (SAVs). Specifically, it hopes to optimize the following aspects by using deep reinforcement learning techniques: 1. **Reduce passenger waiting time**: Through more efficient vehicle scheduling algorithms, reduce the time passengers spend waiting for a ride. 2. **Reduce parking costs**: Optimize the vehicle parking strategy to reduce unnecessary parking fees. 3. **Reduce empty cruising mileage (Empty Cruising Time)**: Through intelligent scheduling, reduce the distance traveled by vehicles without passengers, thereby reducing energy consumption and greenhouse gas emissions. #### Background and Motivation With the development of autonomous driving technology, shared autonomous vehicles (SAVs) are gradually entering the market and are expected to improve urban traffic conditions, reduce traffic accidents, and lower the private vehicle ownership rate. However, SAVs also bring some negative effects, such as excessive vehicle - miles - traveled (VMT), which will lead to more traffic congestion, energy consumption, and environmental pollution. In particular, the empty cruising mileage generated during the vehicle re - positioning process is one of the main problems. Existing research mainly focuses on how to reduce passenger waiting time through different algorithms, but few studies focus on how to simultaneously reduce parking costs and empty driving time. Therefore, this study attempts to use deep reinforcement learning (Deep Reinforcement Learning, DRL) to comprehensively optimize these aspects. #### Methodology To achieve the above - mentioned goals, the author adopts the following methods: - **Select a suitable simulator**: Evaluate multiple simulators and finally select a simulator that can provide detailed feedback on travel time, passenger waiting time, and parking costs. - **Design a reinforcement learning algorithm**: Based on the selected simulator, design and test multiple reinforcement learning algorithms, including but not limited to Q - Learning, Double Q - Learning, etc., to find the optimal vehicle scheduling strategy. - **Optimize the reward function**: Incorporate passenger waiting time, parking costs, and empty driving time into the reward function to ensure that the model can achieve a balance in multi - objective optimization. Through this method, the research hopes to provide a more efficient and environmentally - friendly solution for future SAVs fleet management systems.

Deep Reinforcement Learning for Shared Autonomous Vehicles (SAV) Fleet Management

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

Agent-Based Modeling and Simulation for Systematic Operations of Shared Automated Electric Vehicles

Integrated Operations Strategies for Shared and Privately-Owned Autonomous Vehicles: A Deep Reinforcement Learning Framework

Operations of Shared Autonomous Vehicle Fleet for Austin, Texas, Market

Optimization of Shared Autonomous Vehicles Routing Problem: from the View of Parking

Dampen the Stop-and-Go Traffic with Connected and Automated Vehicles -- A Deep Reinforcement Learning Approach

Effects and Feasibility of Shared Mobility with Shared Autonomous Vehicles: an Investigation Based on Data-Driven Modeling Approach

Idle Vehicle Relocation Strategy through Deep Learning for Shared Autonomous Electric Vehicle System Optimization

Policy and Strategy Evaluation of Ridesharing Autonomous Vehicle Operation: A London Case Study

Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions using Reinforcement Learning

The vehicle routing problem with speed optimization for shared autonomous electric vehicles service

Deep Reinforcement Learning-Based Long-Range Autonomous Valet Parking for Smart Cities

How Many Vehicles Do We Need? Fleet Sizing for Shared Autonomous Vehicles with Ridesharing

Mobility-Aware Charging Scheduling for Shared On-Demand Electric Vehicle Fleet Using Deep Reinforcement Learning

A Reinforcement Learning Approach for Dynamic Rebalancing in Bike-Sharing System

A Distributed Model-Free Algorithm for Multi-Hop Ride-Sharing Using Deep Reinforcement Learning

Smart Insertion Strategies for Sustainable Operation of Shared Autonomous Vehicles

The role of shared autonomous vehicle systems in delivering smart urban mobility: A systematic review of the literature

Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness

Autonomous Highway Driving using Deep Reinforcement Learning