Abstract:With the rapid development of enabling technologies like VR and AR, we human beings are on the threshold of the ubiquitous human-centric intelligence era. 6G is believed to be an indispensable cornerstone for efficient interaction between humans and computers in this promising vision. 6G is supposed to boost many human-centric applications due to its unprecedented performance improvements compared to 5G and before. However, challenges are still to be addressed, including but not limited to the following six aspects: Terahertz and millimeter-wave communication, low latency and high reliability, energy efficiency, security, efficient edge computing and heterogeneity of services. It is a daunting job to fit traditional analytical methods into these problems due to the complex architecture and highly dynamic features of ubiquitous interactive 6G systems. Fortunately, deep learning can circumvent the interpretability issue and train tremendous neural network parameters, which build mapping relationships from neural network input (status and specific requirements of a 6G application) to neural network output (settings to satisfy the requirements). Deep learning methods can be an efficient alternative to traditional analytical methods or even conquer unresolvable predicaments of analytical methods. We review representative deep learning solutions to the aforementioned six aspects separately and focus on the principles of fitting a deep learning method into specific 6G issues. Based on this review, our main contributions are highlighted as follows. (i) We investigate the representative works in a systematic view and find out some important issues like the vital role of deep reinforcement learning in the 6G context. (ii) We point out solutions to the lack of training data in 6G communication context. (iii) We reveal the relationship between traditional analytical methods and deep learning, in terms of 6G applications. (iv) We identify some frequently used efficient techniques in deep-learning-based 6G solutions. Finally, we point out open problems and future directions.

Deep Reinforcement Learning for Mobile 5G and Beyond: Fundamentals, Applications, and Challenges

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Survey on Reinforcement Learning Applications in Communication Networks.

Reinforcement Learning Meets Wireless Networks: A Layering Perspective

Deep Reinforcement Learning for Intelligent Communications

A survey of deep reinforcement learning application in 5G and beyond network slicing and virtualization

Machine Learning for 5G and Beyond: from Model-Based to Data-Driven Mobile Wireless Networks

Reinforcement Learning-Empowered Mobile Edge Computing for 6G Edge Intelligence

Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination

Deep Neural Mobile Networking

Applications of Deep Reinforcement Learning in Communications and Networking: A Survey

Advanced Deep Learning Models for 6G: Overview, Opportunities and Challenges

Beyond the Edge: An Advanced Exploration of Reinforcement Learning for Mobile Edge Computing, its Applications, and Future Research Trajectories

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Deep Learning for Physical-Layer 5G Wireless Techniques: Opportunities, Challenges and Solutions

A Mathematical Introduction to Deep Reinforcement Learning for 5G/6G Applications

An Overview of Reinforcement Learning Algorithms for Handover Management in 5G Ultra-Dense Small Cell Networks

Deep Learning in the Ubiquitous Human–Computer Interactive 6G Era: Applications, Principles and Prospects

Deep learning in physical layer communications: Evolution and prospects in 5G and 6G networks

Applications of Machine Learning for 5G Advanced Wireless Systems

Machine Learning for 6G Wireless Networks: Carrying Forward Enhanced Bandwidth, Massive Access, and Ultrareliable/Low-Latency Service