Abstract:Reinforcement learning is one of the subjects of Artificial Intelligence and learning automata have been considered as one of the most powerful tools in this research area. On the evolution of learning automata, the rate of convergence is the most primary goal of designing a learning algorithm. In this paper, we propose a deterministic-estimator based learning automata (LA) of which the estimate of each action is the upper bound of a confidence interval, rather than the Maximum Likelihood Estimate (MLE) that has been widely used in current schemes of Estimator LA. The philosophy here is to assign more confidence on actions that are selected only for a few times, so that the automaton is encouraged to explore the uncertain actions. When all the actions have been fully explored, the automaton behaves just like the Generalized Pursuit Algorithm. A refined analysis is presented to show the 𝜖-optimality of the proposed algorithm. It has been demonstrated by extensive simulations that the presented learning automaton (LA) is faster than any deterministic estimator learning automata that have been reported to date. Moreover, we extend our algorithm to the stochastic estimator schemes. It is also shown that the extended LA has achieved a significant performance improvement, comparing with the current state of the art algorithm of learning automata, especially in complex and confusing environments.

Learning Deterministic Multi-Clock Timed Automata

F L ] 2 3 O ct 2 01 9 Learning One-Clock Timed Automata

Active Learning of Deterministic Timed Automata with Myhill-Nerode Style Characterization

Active learning of timed automata with unobservable resets

Learning Realtime One-Counter Automata

Active Learning of Mealy Machines with Timers

A Systematic Study on Explicit-State Non-Zenoness Checking for Timed Automata

Learning real-time one-counter automata using polynomially many queries

Monitoring Ctmcs By Multi-Clock Timed Automata

Updatable Timed Automata with One Updatable Clock

A Novel Estimator Based Learning Automata Algorithm

LLMs as Probabilistic Minimally Adequate Teachers for DFA Learning

Probabilistic Timed Automata with One Clock and Initialised Clock-Dependent Probabilities

Greybox Learning of Languages Recognizable by Event-Recording Automata

An Efficient Learning Automaton Scheme for Massive-Action Environments

On Reachability Analysis of Updatable Timed Automata with One Updatable Clock

A Myhill-Nerode style Characterization for Timed Automata With Integer Resets

Observing Continuous-Time Mdps By 1-Clock Timed Automata

$L^*LM$: Learning Automata from Examples using Natural Language Oracles

Nested Timed Automata with Frozen Clocks

Adaptive Continuous Action-Set Learning Automata Scheme