Abstract:An update scheme of the state probability vector of actions is critical for learning automata (LA). The most popular is the pursuit scheme that pursues the estimated optimal action and penalizes others. This paper proposes a reverse philosophy that leads to last-position elimination-based learning automata (LELA). The action graded last in terms of the estimated performance is penalized by decreasing its state probability and is eliminated when its state probability becomes zero. All active actions, that is, actions with nonzero state probability, equally share the penalized state probability from the last-position action at each iteration. The proposed LELA is characterized by the relaxed convergence condition for the optimal action, the accelerated step size of the state probability update scheme for the estimated optimal action, and the enriched sampling for the estimated nonoptimal actions. The proof of the epsilon-optimal property for the proposed algorithm is presented. Last-position elimination is a widespread philosophy in the real world and has proved to be also helpful for the update scheme of the learning automaton via the simulations of well-known benchmark environments. In the simulations, two versions of the LELA, using different selection strategies of the last action, are compared with the classical pursuit algorithms Discretized Pursuit Reward-Inaction (DPRI) and Discretized Generalized Pursuit Algorithm (DGPA). Simulation results show that the proposed schemes achieve significantly faster convergence and higher accuracy than the classical ones. Specifically, the proposed schemes reduce the interval to find the best parameter for a specific environment in the classical pursuit algorithms. Thus, they can have their parameter tuning easier to perform and can save much more time when applied to a practical case. Furthermore, the convergence curves and the corresponding variance coefficient curves of the contenders are illustrated to characterize their essential differences and verify the analysis results of the proposed algorithms.

A New Learning Automata Algorithm for Selection of Optimal Subset

A New Class of Learning Automata for Selecting an Optimal Subset.

Incorporation of Optimal Computing Budget Allocation for Ordinal Optimization into Learning Automata

Incorporation of Ordinal Optimization into Learning Automata for High Learning Efficiency

A Set of Novel Continuous Action-Set Reinforcement Learning Automata Models to Optimize Continuous Functions

A New Learning Automaton for Selecting an Arbitrary Subset of Actions

Learning-augmented Algorithms for Online Subset Sum

Adaptive Continuous Action-Set Learning Automata Scheme

Last-Position Elimination-Based Learning Automata

A Novel Estimator Based Learning Automata Algorithm

A New Prospective for Learning Automata: A Machine Learning Approach.

A Novel Framework for Learning Automata: A Statistical Hypothesis Testing Approach

A novel Continuous Action-set Learning Automaton algorithm

An Efficient Learning Automaton Scheme for Massive-Action Environments

Learning automata-accelerated greedy algorithms for stochastic submodular maximization

Learning Automata-Based Multiagent Reinforcement Learning for Optimization of Cooperative Tasks

An Efficient Parameter-Free Learning Automaton Scheme

A Cooperative Framework of Learning Automata and Its Application in Tutorial-Like System

A loss function based parameterless learning automaton scheme.

Last-Position Elimination-Based Parallel Learning Automata

Fast and Epsilon-Optimal Discretized Pursuit Learning Automata