Abstract:Simultaneously considering multiple objectives in machine learning has been a popular approach for several decades, with various benefits for multi-task learning, the consideration of secondary goals such as sparsity, or multicriteria hyperparameter tuning. However - as multi-objective optimization is significantly more costly than single-objective optimization - the recent focus on deep learning architectures poses considerable additional challenges due to the very large number of parameters, strong nonlinearities and stochasticity. This survey covers recent advancements in the area of multi-objective deep learning. We introduce a taxonomy of existing methods - based on the type of training algorithm as well as the decision maker's needs - before listing recent advancements, and also successful applications. All three main learning paradigms supervised learning, reinforcement learning and unsupervised learning are covered, and we also address the recently very popular area of generative modeling.

What problem does this paper attempt to address?

The core problem that this paper attempts to solve is: the challenges and methods of considering multiple objectives (multi - objective deep learning) simultaneously in deep learning. Specifically, multi - objective optimization is very important when dealing with multiple conflicting objectives. For example, in machine learning, optimizing the performance of multiple tasks simultaneously, considering secondary objectives such as the sparsity or efficiency of the model, and multi - criteria hyperparameter tuning. However, since multi - objective optimization is more costly than single - objective optimization, and the deep learning architecture itself has a large number of parameters, strong nonlinearity and randomness, this brings additional challenges to multi - objective deep learning. To address these challenges, the paper provides a review of the latest progress in the field of multi - objective deep learning and introduces a classification method (taxonomy) to classify existing methods based on the type of training algorithm and the needs of decision - makers. In addition, the paper also lists the main progress and successful applications in recent years, covering the three major learning paradigms of supervised learning, reinforcement learning and unsupervised learning, and also involves the field of generative modeling. ### Specific Problem Description 1. **Complexity of Multi - objective Optimization**: - In machine learning, especially in deep learning, considering multiple objectives will significantly increase the complexity of the optimization problem. - For example, in multi - task learning, the model needs to optimize the performance of multiple tasks simultaneously, and in reinforcement learning, it may be necessary to balance immediate rewards and long - term returns. 2. **High Computational Cost**: - Multi - objective optimization is usually more computationally expensive than single - objective optimization, especially in deep learning, where the number of model parameters is huge, and the nonlinearity and randomness in the optimization process further increase the difficulty. 3. **Combination of Decision - making and Optimization**: - How to effectively combine the preferences of decision - makers in the optimization process is also an important issue. Decision - makers may have different priorities or preferences, and how to incorporate these preferences into the optimization process is a challenge. ### Solutions and Methods The paper solves these problems in the following ways: - **Classification Method (Taxonomy)**: Classify existing methods according to the type of training algorithm and the needs of decision - makers, helping researchers better understand and select suitable methods. - **Review of the Latest Progress**: Cover the latest progress of multi - objective deep learning in supervised learning, reinforcement learning and unsupervised learning, and provide a comprehensive literature review. - **Successful Application Cases**: List successful application examples of multi - objective deep learning to demonstrate its effectiveness and potential in practical problems. In summary, this paper aims to provide an exhaustive review and classification framework for the research of multi - objective deep learning, helping researchers better understand the current situation and development direction of this field.

Multi-objective Deep Learning: Taxonomy and Survey of the State of the Art

A Survey on Multi-Objective based Parameter Optimization for Deep Learning

Multiobjectivization of Single-Objective Optimization in Evolutionary Computation: A Survey

Pareto-Based Multiobjective Machine Learning: an Overview and Case Studies

Multi-Task Learning as Multi-Objective Optimization

Multi-Objective Optimization for Sparse Deep Multi-Task Learning

Bi-level Multi-objective Evolutionary Learning: A Case Study on Multi-task Graph Neural Topology Search

Multi-Disciplinary and Multi-Objective Optimization Method Based on Machine Learning

Multiobjective evolutionary algorithms: A survey of the state of the art

Gradient-based Bi-level Optimization for Deep Learning: A Survey

Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overview

A survey on multi-agent deep reinforcement learning: from the perspective of challenges and applications

Meta-learning approaches for learning-to-learn in deep learning: A survey

A Survey of Deep Meta-Learning

Multi-objective multi-agent decision making: a utility-based analysis and survey

Deep Learning -- A first Meta-Survey of selected Reviews across Scientific Disciplines, their Commonalities, Challenges and Research Impact

Dynamic Multi-objective Optimization: A Survey of the State-of-the-Art

Evolutionary Large-Scale Multi-Objective Optimization: A Survey

Deep reinforcement learning for multi-objective combinatorial optimization: A case study on multi-objective traveling salesman problem

Multi-agent Reinforcement Learning: A Comprehensive Survey

Meta-Learning in Neural Networks: A Survey