Abstract:Simulated Annealing (SA) is a frequently used stochasticalgorithm to deal with combinatorial optimization problems and it converges with probability infinitely close to 1. However, this parameter sensitive algorithm causes long execution time which prevents it from being accepted for many real applications. Serial SA method has been discussed not only in pure algorithm research but also in many applications. How to parallelize the SA algorithm and how to improve its performance is what this paper concerns. In the research of complex parallel applications, we find that the features of different calculation phases are quite different. One algorithm can only suit for one special phase. So if only one pure algorithm is used in these applications, the performance is not high. The paper presents a hybrid SPMD (Single Program Multiple Data) algorithm which combines SA with local search algorithm——Downhill. The hybrid method not only keeps the convergence of SA but also improves the convergence speed of SA. Approximate solutions can be found quickly for complex optimization problems and more precise solutions can also be found by employing the same algorithm to fine-tune the approximate solutions. SA is an essential serial algorithm, but the SPMD algorithm breaks up the serial bottleneck of SA and in some range its performance scales up with the increase of processors. At the same time, the SPMD algorithm does not require careful choice of control parameters. Cluster computing is a new kind of parallel computing mode and has been used in many fields. It is chosen as our experimental environment not only because it is a typical parallel environment but also because it is available easily. The algorithm has been implemented on a cluster system THNPSC-1. Fives typical multiple maximum functions are used to test the SPMD algorithm. The results show that the algorithm can always find the best values. The application on a quantitative electron crystallography problem shows that the algorithm is robust and it can find high quality solution with high speed. The conclusion is that SA can be parallelized with high performance and for complex optimization problems, different methods can be combines together and in different phases, and different method can be used to speed up the optimization procedure.

A Hybrid Sequence Sampling Technique and Its Application to Multi-Objective Optimization of Blending Process

A Hybrid Cuckoo–harmony Search Algorithm for Optimal Design of Water Distribution Systems

A New Sequential Sampling Method for Surrogate Modeling Based on a Hybrid Metric

Surrogate-guided multi-objective optimization (SGMOO) using an efficient online sampling strategy

A Sampling-based SMO Algorithm

An application of the improved hybrid particle swarm optimization method in the gasoline blending process

Multi-Point Sequential Sampling Method For Complex Engineering Optimization Problems

Optimization of the Sampling Design for Multiobjective Soil Mapping Using the Multiple Path SSA (MP-SSA) Method

Multi-point objective-oriented sequential sampling strategy for constrained robust design

High-Fidelity Surrogate Based Multi-Objective Optimization Algorithm

An Effective Hybrid Optimization Approach for Multi-Objective Flexible Job-Shop Scheduling Problems.

A Novel Two-Stage Method Of Selection Of Sample Points For Surface Quality Estimation Of Multi-Hole Workpiece

A discrete group teaching optimization algorithm for solving many-objective sand casting whole process production scheduling problem

Blending Scheduling under Uncertainty Based on Particle Swarm Optimization Algorithm

Blending scheduling under uncertainty based on particle swarm optimization with hypothesis test

An Improved Parallelized Multi-Objective Optimization Method for Complex Geographical Spatial Sampling: AMOSA-II.

A novel batch-selection strategy for parallel global optimization

SGOP: Surrogate-assisted global optimization using a Pareto-based sampling strategy

A Sequential Sampling Approach for Multi-Fidelity Surrogate Modeling-Based Robust Design Optimization

Pareto-like Sequential Sampling Heuristic for Global Optimisation

Hybrid SPMD Simulated Annealing Algorithm and Its Applications