Abstract:Large-scale optimization is vital in today’s artificial intelligence (AI) applications for extracting essential knowledge from huge volumes of data. In recent years, to improve the evolutionary algorithms used to solve optimization problems involving a large number of decision variables, many attempts have been made to simplify the problem solution space of a given problem for the evolutionary search. In the literature, the existing approaches can generally be categorized as decomposition-based methods and dimension-reduction-based methods. The former decomposes a large-scale problem into several smaller subproblems, while the latter transforms the original high-dimensional solution space into a low-dimensional space. However, it is worth noting that a given large-scale optimization problem may not always be decomposable, and it is also difficult to guarantee that the global optimum of the original problem is preserved in the reduced low-dimensional problem space. This article, thus, proposes a new search paradigm, namely the multispace evolutionary search, to enhance the existing evolutionary search methods for solving large-scale optimization problems. In contrast to existing approaches that perform an evolutionary search in a single search space, the proposed paradigm is designed to conduct a search in multiple solution spaces that are derived from the given problem, each possessing a unique landscape. The proposed paradigm makes no assumptions about the large-scale optimization problem of interest, such as that the problem is decomposable or that a certain relationship exists among the decision variables. To verify the efficacy of the proposed paradigm, comprehensive empirical studies in comparison to five state-of-the-art algorithms were conducted using the CEC2013 large-scale benchmark problems as well as an AI application in e-commerce, i.e., movie recommendation.

Resolving the Exploration-Exploitation Dilemma in Evolutionary Algorithms: A Novel Human-Centered Framework

Toward Explicit Control Between Exploration and Exploitation in Evolutionary Algorithms: A Case Study of Differential Evolution

Auto-configuring Exploration-Exploitation Tradeoff in Evolutionary Computation via Deep Reinforcement Learning

Multi-Space Evolutionary Search for Large-Scale Optimization

Evolving Strategies for Competitive Multi-Agent Search

A Dual Control Perspective for Exploration and Exploitation in Autonomous Search

Balancing exploration and exploitation in multiobjective evolutionary optimization.

Adaptive Differential Evolution Based on Exploration and Exploitation Control

An Evolutionary Framework for Automatic and Guided Discovery of Algorithms

Evolving search trajectories

An optimization algorithm inspired by the States of Matter that improves the balance between exploration and exploitation

A Framework to Study Human-AI Collaborative Design Space Exploration

Multispace Evolutionary Search for Large-Scale Optimization with Applications to Recommender Systems

Improving Exploration in Evolution Strategies for Deep Reinforcement Learning via a Population of Novelty-Seeking Agents

Evolving Real-time Heuristic Search Algorithms

Evolutionary Transfer Optimization - A New Frontier in Evolutionary Computation Research

Representing Experience in Continuous Evolutionary Optimisation Through Problem-tailored Search Operators.

The Exploration-Exploitation Dilemma Revisited: An Entropy Perspective

Uncertainty quantification and exploration-exploitation trade-off in humans

Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Model

Evolutionary Sampling Agent for Expensive Problems