Abstract:The pheromone-based parameterized probabilistic model for the ACO algorithm is presented as the construction graph that the combinatorial optimization problem can be mapped on. Based on the construction graph, the solution construction procedure and update rule of pheromone model in the ACO algorithm is illustrated. The finite deterministic Markov decision process corresponding to the solution construction procedure is illustrated in the terminology of reinforcement learning (RL) theory. The ACO algorithms are fitted into the framework of generalized policy iteration (GPl) in RL based on incomplete information of the Markov state. Furthermore, we show that the pheromone update in the ACS and Ant-Q algorithm is based on the MC methods or some formalistic combination of MC methods and TD methods. TD methods have usually been found to converge faster than MC methods in many applications, but works worse than the MC method in the non-Markov environment. We propose a novel ACO algorithm, Ant(/spl lambda/) algorithm, which introduces the eligibility trace mechanism into the local update procedure of pheromone, the algorithm unifies the TD method and MC method mathematically, and in the algorithm, the delayed reinforcement can be back propagated in time.

MAX-MIN meeting ant colony algorithm based on cloud model theory and niche ideology

An Optimized Ant System For Clustering With Elitist Ant And Local Search

Max-min Ant Colony Optimization for Design of Water Distribution System

AN ADAPTIVE ANT COLONY SYSTEM ALGORITHM FOR CONTINUOUS-SPACE OPTIMIZATION PROBLEMS

Ant colony algorithm with dynamic transition probability

Improvement of Ant Colony Algorithm Based on Cloud Models Theory

An Accelerated Ant Colony Algorithm for Complex Nonlinear System Optimization

Unit Commitment Solved by Multi Colony Chaotic Ant Optimization Algorithm

The Ant(λ) Ant Colony Optimization Algorithm Based on Eligibility Trace.

A new hybrid genetic algorithm for global minimax optimization

A Nested Hybrid Ant Colony Algorithm for Hybrid Production Scheduling Problems

Ant Colony Optimization For Intelligent Scheduling

Improved Ant Colony Algorithm and Its Application to the Optimization of Recipe

Ant colony search algorithms for optimal packing problem

Hybrid Ant Colony Algorithm Clonal Selection in the Application of the Cloud's Resource Scheduling

Optimum Design of Network Structures Based on Hybrid Intelligence of Genetic - Ant Colonies Algorithm

Ant Colony Algorithm Based on Path Weighting Balance

Design of Ant Colony Algorithm-based Fuzzy Classification System

A Modified Ant Colony Optimization Algorithm Modeled on Tabu-Search Methods

Antlion optimizer algorithm based on chaos search and its application

Design and Realization of Improved Genetic Ant Colony Algorithm Solving Optimization Problems