Abstract:Evolutionary algorithms and other meta-heuristics have been employed widely to solve optimization problems in many different fields over the past few decades. Their performance in finding optimal solutions often depends heavily on the parameterization of the algorithm's search operators, which affect an algorithm's balance between search diversification and intensification. While many parameter-adaptive algorithms have been developed to improve the searching ability of meta-heuristics, their performance is often unsatisfactory when applied to real-world problems. This is, at least in part, because available computational budgets are often constrained in such settings due to the long simulation times associated with objective function and/or constraint evaluation, thereby preventing convergence of existing parameter-adaptive algorithms. To this end, this paper proposes an innovative parameter-adaptive strategy for ant colony optimization (ACO) algorithms based on controlling the convergence trajectory in decision space to follow any prespecified path, aimed at finding the best possible solution within a given, and limited, computational budget. The utility of the proposed convergencetrajectory controlled ACO (ACO(CTC)) algorithm is demonstrated using six water distribution system design problems (WDSDPs, a difficult type of combinatorial problem in water resources) with varying complexity. The results show that the proposed ACO(CTC) successfully enables the specified convergence trajectories to be followed by automatically adjusting the algorithm's parameter values. Different convergence trajectories significantly affect the algorithm's final performance (solution quality). The trajectory with a slight bias toward diversification in the first half and more emphasis on intensification during the second half of the search exhibits substantially improved performance compared to the best available ACO variant with the best parameterization (no convergence control) for allWDSDPs and computational scenarios considered. For the two large-scale WDSDPs, new best-known solutions are found by the proposed ACO(CTC).

An Adaptive Auto-configuration Tool for Hadoop

BestConfig: Tapping the Performance Potential of Systems Via Automatic Configuration Tuning

An auto-configuration tool for heterogeneous Hadoop cluster

Implementation of Artificial Neural Networks in MapReduce Optimization

HAT: history-based auto-tuning MapReduce in heterogeneous environments

The performance of MapReduce: an in-depth study

DeepCAT+: A Low-Cost and Transferrable Online Configuration Auto-Tuning Approach for Big Data Frameworks

A Recommendation-Based Parameter Tuning Approach for Hadoop.

Autonomic Architecture for Big Data Performance Optimization

The Performance of MapReduce

ConEx: Efficient Exploration of Big-Data System Configurations for Better Performance

An Adaptive Approach to Better Load Balancing in a Consumer-Centric Cloud Environment

mrMoulder: A recommendation-based adaptive parameter tuning approach for big data processing platform.

An Adaptive Model For Building Service-Partition System

A MapReduce Cluster Deployment Optimization Framework with Geo-distributed Data.

Adaptive Task Scheduling Strategy Based on Dynamic Workload Adjustment for Heterogeneous Hadoop Clusters

Automatic Cloud I/O Configurator for I/O Intensive Parallel Applications

Vhadoop: A Scalable Hadoop Virtual Cluster Platform for MapReduce-Based Parallel Machine Learning with Performance Consideration

An Adaptive Convergence-Trajectory Controlled Ant Colony Optimization Algorithm with Application to Water Distribution System Design Problems

Acic: Automatic Cloud I/O Configurator For Hpc Applications

ActCap: Accelerating MapReduce on heterogeneous clusters with capability-aware data placement