Reinforcement Learning Based Optimal Operation Strategy for Electric Taxis

Yiqi Zhao,Yinliang Xu,Ye Guo,Qinglai Guo
DOI: https://doi.org/10.1109/ei250167.2020.9346984
2020-01-01
Abstract:The large-scale adoption of electric vehicles (EVs) is drawing great attention in recent years. The travel/charging patterns of different types of EVs, such as private EVs, electric buses (EBs), electric taxis (ETs), could greatly differ from each other. Among them, the ET plays an important role in public transportation and has rather special characteristics including long daily travel distance, highly uncertain behaviors etc., which thus needs to be further investigated independently. To address this issue, a reinforcement-learning (RL) based optimal operation strategy for the ETs is designed by this paper. Moreover, the proposed method better addressed the profit-making characteristic of ETs that were not well handled by other related works. The studied network is first evenly divided into small blocks with certain travel demands. ETs are classified according to their battery levels, and different rewards are designed for all possible actions at every state correspondingly. The Q-learning method in the RL field is then used to obtain the value tables for all actions so that to give the best operation strategies for different ET groups. Simulation results show that the proposed method not only can improve the ET system performance from the view point of the whole society, but also benefits each individual ET.
What problem does this paper attempt to address?