Abstract:Despite the growing interest in the interplay of machine learning and optimization, existing contributions remain scattered across the research board, and a comprehensive overview on such reciprocity still lacks at this stage. In this context, this paper visits one particular direction of interplay between learning-driven solutions and optimization, and further explicates the subject matter with a clear background and summarized theory. For instance, machine learning and its offsprings are trending because of their enhanced capabilities in automating analytical modeling. In this realm, learning-based techniques (supervised, unsupervised, and reinforcement) have grown to complement many of the optimization problems in testing and training. This paper overviews how machine learning-based techniques, namely deep neural networks, echo-state networks, reinforcement learning, and federated learning, can be used to solve complex and analytically intractable optimization problems, for which specific cases are examined in this paper. The paper particularly overviews when learning-based algorithms are useful at solving particular optimizing problems, especially those of random, dynamic, and mathematically complex nature. The paper then illustrates such applications by presenting particular use-cases in communications and signal processing including wireless scheduling, wireless offloading and resource management, power control, aerial base station placement, virtual reality, and vehicular networks. Lastly, the paper sheds light on some future research directions, where the dynamicity and randomness of the underlying optimization problems make deep learning-driven techniques a necessity, namely in sensing at the terahertz (THz) bands, cellular vehicle-to-everything, 6G communication networks, underwater optical networks, distributed optimization, and applications of emerging learning-based techniques.

How Can Machine Learning and Optimization Help Each Other Better?

A Survey of Optimization Methods From a Machine Learning Perspective

Machine Learning Problems from Optimization Perspective

Machine Learning Optimization Techniques: A Survey, Classification, Challenges, and Future Research Issues

Optimization Networks for Integrated Machine Learning

Optimization with Trained Machine Learning Models Embedded

Black Box Optimization, Machine Learning, and No-Free Lunch Theorems

Bilevel Optimization for Automated Machine Learning: a New Perspective on Framework and Algorithm

Review of Learning-Assisted Power System Optimization

Connections Between Adaptive Control and Optimization in Machine Learning

Learning to optimize: A tutorial for continuous and mixed-integer optimization

Machine Learning Insides OptVerse AI Solver: Design Principles and Applications

An Overview of Machine Learning-Based Techniques for Solving Optimization Problems in Communications and Signal Processing

Machine Learning Assisted Evolutionary Multi-Objective Optimization [Guest Editorial]

Empowering Optimal Control with Machine Learning: A Perspective from Model Predictive Control

On hyperparameter optimization of machine learning algorithms: Theory and practice

A Survey for Solving Mixed Integer Programming via Machine Learning

When Large Language Model Meets Optimization

Portfolio Optimization Strategies: New Approaches Based on Machine Learning Forecasting

Topology Optimization via Machine Learning and Deep Learning: A Review