Abstract:Recently, Internet of Vehicles (IoV) has become one of the most active research fields in both academic and industry, which exploits resources of vehicles and Road Side Units (RSUs) to execute various vehicular applications. Due to the increasing number of vehicles and the asymmetrical distribution of traffic flows, it is essential for the network operator to design intelligent offloading strategies to improve network performance and provide high-quality services for users. However, the lack of global information and the time-variety of IoVs make it challenging to perform effective offloading and caching decisions under long-term energy constraints of RSUs. Since Artificial Intelligence (AI) and machine learning can greatly enhance the intelligence and the performance of IoVs, we push AI inspired computing, caching and communication resources to the proximity of smart vehicles, which jointly enable RSU peer offloading, vehicle-to-RSU offloading and content caching in the IoV framework. A Mix Integer Non-Linear Programming (MINLP) problem is formulated to minimize total network delay, consisting of communication delay, computation delay, network congestion delay and content downloading delay of all users. Then, we develop an online multi-decision making scheme (named OMEN) by leveraging Lyapunov optimization method to solve the formulated problem, and prove that OMEN achieves near-optimal performance. Leveraging strong cognition of AI, we put forward an imitation learning enabled branch-and-bound solution in edge intelligent IoVs to speed up the problem solving process with few training samples. Experimental results based on real-world traffic data demonstrate that our proposed method outperforms other methods from various aspects.

Intelligent Online Traffic Optimization Based on Deep Reinforcement Learning for Information-Centric Networks

Deep Reinforcement Learning for Smart City Communication Networks

Deep Reinforcement Learning for Intelligent Computing and Content Edge Service in ICN-based IoV

Joint Optimization of Content Replication and Traffic Engineering in ICN

A Reinforcement Learning Based Data Storage and Traffic Management in Information-Centric Data Center Networks

IEACC: an Intelligent Edge-Aided Congestion Control Scheme for Named Data Networking with Deep Reinforcement Learning.

Joint Computing and Caching in 5G-Envisioned Internet of Vehicles: A Deep Reinforcement Learning-Based Traffic Control System

Adaptive ACO- Driven ICN Routing Mechanism with Network Status Analysis.

Joint Traffic Control and Multi-Channel Reassignment for Core Backbone Network in SDN-IoT: A Multi-Agent Deep Reinforcement Learning Approach

Intelligent Edge Computing in Internet of Vehicles: A Joint Computation Offloading and Caching Solution

TIDE: Time-relevant deep reinforcement learning for routing optimization

A Deep Reinforcement Learning Based Congestion Control Mechanism for NDN.

A Novel Congestion Control Algorithm Based on Inverse Reinforcement Learning with Parallel Training

An Intelligent Optimization-Based Traffic Information Acquirement Approach to Software-Defined Networking

A Reinforcement Learning-Based Network Traffic Prediction Mechanism in Intelligent Internet of Things

An SDN-based algorithm for caching, routing, and load balancing in ICN

Design and Evaluation of Probabilistic Caching in Information-Centric Networking

Deep-Reinforcement-Learning-Based AoI-Aware Resource Allocation for RIS-Aided IoV Networks

Intelligent Routing Strategy in the Internet of Things Based on Deep Reinforcement Learning

Deep Reinforcement Learning-based Edge Caching and Multi-link Cooperative Communication in Internet-of-Vehicles

A New Deep-Q-Learning-Based Transmission Scheduling Mechanism for the Cognitive Internet of Things