Abstract:New metaheuristic algorithms have soared over the past ten years. A common practice in proposing a new algorithm is validating it on several benchmark functions and engineering problems. Although CEC benchmark problems are specifically designed to validate the performance of new meta-heuristics, engineering design problems from pressure vessels to springs have been used in hundreds of papers to prove algorithm efficiency. To date, no benchmark practices have been established yet, i.e., researchers design their own benchmark to validate their algorithm. Thus, the high number of new algorithms combined with the high number of different benchmarking setups complicates the comparing and validating processes. In this paper, we study benchmark practices related to engineering applications. In particular, our exhaustive qualitative systematic review focuses on metaheuristics applied to the tension/compression spring design problem (TCSDP). The aim of this study is threefold: (i) evaluate where the field stands in regards of algorithm performance on the TCSDP, (ii) evaluate benchmarking practices, and (iii) facilitate future algorithm comparison. For these purposes, we first review all the existing metaheuristics applied to the TCSDP in their first publication. For each paper, we gather the data regarding the problem definition, the simulation setup, and the optimized design. We evaluated the data through several metrics to find the best-optimized design so far. Our findings and analysis concluded that the field of metaheuristics and its benchmarking practice have not reached maturity yet. Thus, we recommend some actions to address the issues and provide future research directions.

On benchmarking and good scientific practise in topology optimization

Benchmarking in Optimization: Best Practice and Open Issues

A Novel 3-D Topology Optimization Methodology Based on the Min-Cut Theorem

Topology optimization approaches

On the usefulness of non-gradient approaches in topology optimization

Accelerating Large-scale Topology Optimization: State-of-the-Art and Challenges

On performance bounds for topology optimization

Research on an Effective Bionic Topology Optimization Method for Engineering Applications

Benchmarking for Metaheuristic Black-Box Optimization: Perspectives and Open Challenges

Towards Robust Benchmarking of Quantum Optimization Algorithms

Investigating best algorithms for structural topology optimization

Best practices for comparing optimization algorithms

A New Topology Optimization Methodology Based on Constraint Maximum-Weight Connected Graph Theorem

A Multi-Objective Topology Optimization Methodology Based on Pareto Optimal Min-Cut

A Comprehensive Review of Isogeometric Topology Optimization: Methods, Applications and Prospects

A Review of Methods for the Geometric Post-Processing of Topology Optimized Models

A qualitative systematic review of metaheuristics applied to tension/compression spring design problem: Current situation, recommendations, and research direction

Guidelines for benchmarking of optimization approaches for fitting mathematical models

Benchmarking Evolutionary Algorithms For Single Objective Real-valued Constrained Optimization - A Critical Review

A review on topology optimization of structures

Nature-inspired optimization algorithms: Challenges and open problems