Abstract:The pheromone-based parameterized probabilistic model for the ACO algorithm is presented as the construction graph that the combinatorial optimization problem can be mapped on. Based on the construction graph, the solution construction procedure and update rule of pheromone model in the ACO algorithm is illustrated. The finite deterministic Markov decision process corresponding to the solution construction procedure is illustrated in the terminology of reinforcement learning (RL) theory. The ACO algorithms are fitted into the framework of generalized policy iteration (GPl) in RL based on incomplete information of the Markov state. Furthermore, we show that the pheromone update in the ACS and Ant-Q algorithm is based on the MC methods or some formalistic combination of MC methods and TD methods. TD methods have usually been found to converge faster than MC methods in many applications, but works worse than the MC method in the non-Markov environment. We propose a novel ACO algorithm, Ant(/spl lambda/) algorithm, which introduces the eligibility trace mechanism into the local update procedure of pheromone, the algorithm unifies the TD method and MC method mathematically, and in the algorithm, the delayed reinforcement can be back propagated in time.

An Optimized Ant System For Clustering With Elitist Ant And Local Search

The Ant(λ) Ant Colony Optimization Algorithm Based on Eligibility Trace.

AN ADAPTIVE ANT COLONY SYSTEM ALGORITHM FOR CONTINUOUS-SPACE OPTIMIZATION PROBLEMS

An Improved Clustering Algorithm Based on Ant Colony Approach

An Improved Ant Colony Optimization Cluster Algorithm Based on Swarm Intelligence.

An Improved Ant Colony Optimization Algorithm For Clustering

CLUSTERING ANALYSIS BASED ON IMPROVED ANT COLONY ALGORITHM

Enhanced ant colony optimization algorithm based on clustering analysis

Data clustering by ant colony on a digraph

The research of a clustering algorithm based on the ant colony system

A Novel Ant Colony Optimization Algorithm For Clustering

A New Clustering Algorithm Based on Hybrid Ant Colony Algorithm

A New Self-Adaptive Clustering Algorithm Based on Ant Swarm

An Improved Ant Colony Optimization Algorithm and Its Application to Electromagnetic Devices Designs

Survey of Ant Colony Clustering Algorithms

Agglomerative hierarchical clustering based on ant colony optimization algorithm

An Information Entropy-Based Animal Migration Optimization Algorithm for Data Clustering.

Ant Colony Clustering Algorithm Based on Multiple Heterogeneous Ants

Clustering via Ant Colonies: Parameter Analysis and Improvement of the Algorithm

An Analysis of Ant Colony Clustering Methods: Models, Algorithms and Applications

Simplifying and Improving Ant-Based Clustering.