Simulated Annealing with Tsallis Weights - A Numerical Comparison

Ulrich H.E. Hansmann
DOI: https://doi.org/10.1016/S0378-4371%2897%2900203-3
1997-10-18
Abstract:We discuss the use of Tsallis generalized mechanics in simulated annealing algorithms. For a small peptide it is shown that older implementations are not more effective than regular simulated annealing in finding ground state configurations. We propose a new implementation which leads to an improvement over regular simulated annealing.
Condensed Matter,Chemical Physics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to use Tsallis generalized mechanics in the simulated annealing algorithm to improve the optimization performance, especially for the protein - folding problem. Specifically, the author explored two simulated annealing algorithms based on Tsallis weights and proposed a new implementation method, aiming to improve the performance of the conventional simulated annealing algorithm in finding the global optimal solution. ### Background of the Paper The simulated annealing algorithm (SA) is a commonly - used optimization technique, widely applied to complex optimization problems in various scientific fields. Its basic idea is to find the global optimal solution by simulating the process of crystal growth in nature. However, the performance of SA depends heavily on the annealing schedule, that is, the way the temperature gradually decreases. Selecting an appropriate annealing schedule is a challenge, especially when computational resources are limited. ### Problem Description 1. **Limitations of Existing Methods**: - The conventional simulated annealing algorithm has difficulties in finding the global optimal solution, especially when dealing with problems with complex energy landscapes. - The previously proposed simulated annealing algorithms based on Tsallis generalized mechanics (such as the Penna algorithm and the Andricioaei - Straub algorithm) perform well in some cases, but they require careful adjustment of additional free parameters, such as the Tsallis parameter \( q \) and the energy scale, which makes these methods highly dependent on specific models in practical applications. 2. **Improvement Objectives**: - Propose a new simulated annealing algorithm based on Tsallis weights that can improve the optimization performance without increasing the burden of additional parameter adjustment. - Pay special attention to the optimization performance at low temperatures, because at low temperatures, the conventional Boltzmann weights make it difficult for the system to escape from local minima. ### Solutions 1. **Definition of Tsallis Weights**: - Use the probability distribution in Tsallis generalized mechanics, where the tail of the probability distribution decays as a power law with energy, rather than exponentially. This helps the system cross energy barriers more easily and thus escape from local minima. - The specific Tsallis weight is defined as: \[ w(E)=\left[1-(1 - q)\beta(E - E_0)\right]^{\frac{q}{1 - q}} \] where \( E_0 \) is the ground - state energy, \( q \) is the Tsallis parameter, and \( \beta \) is the inverse temperature. 2. **Selection of the Optimal Tsallis Parameter**: - To ensure that the Tsallis weight can effectively enhance the exploration ability of the system at low temperatures, the author proposes a method for selecting the optimal Tsallis parameter \( q \): \[ q = 1+\frac{1}{n_F} \] where \( n_F \) is the degree of freedom of the molecule. 3. **Experimental Verification**: - The author used the Met - enkephalin peptide as a model system and carried out a large number of simulated annealing experiments to compare the performance of different algorithms. - The experimental results show that the new simulated annealing algorithm based on Tsallis weights is superior to the conventional simulated annealing algorithm in finding the global optimal solution, especially at low temperatures. ### Conclusion The author successfully proposed a new simulated annealing algorithm based on Tsallis weights. This algorithm improves the optimization performance without increasing the burden of additional parameter adjustment. The experimental results show that the new algorithm performs well in finding the global optimal solution, especially when dealing with problems with complex energy landscapes. This method provides an effective optimization tool for biophysical problems such as protein folding.