Abstract:Stochastic Averaging and Stochastic Extremum Seeking develops methods of mathematical analysis inspired by the interest in reverse engineering and analysis of bacterial convergence by chemotaxis and to apply similar stochastic optimization techniques in other environments. The first half of the text presents significant advances in stochastic averaging theory, necessitated by the fact that existing theorems are restricted to systems with linear growth, globally exponentially stable average models, vanishing stochastic perturbations, and prevent analysis over infinite time horizon. The second half of the text introduces stochastic extremum seeking algorithms for model-free optimization of systems in real time using stochastic perturbations for estimation of their gradients. Both gradient- and Newton-based algorithms are presented, offering the user the choice between the simplicity of implementation (gradient) and the ability to achieve a known, arbitrary convergence rate (Newton). The design of algorithms for non-cooperative/adversarial games is described. The analysis of their convergence to Nash equilibria is provided. The algorithms are illustrated on models of economic competition and on problems of the deployment of teams of robotic vehicles. Bacterial locomotion, such as chemotaxis in E. coli, is explored with the aim of identifying two simple feedback laws for climbing nutrient gradients. Stochastic extremum seeking is shown to be a biologically plausible interpretation for chemotaxis. For the same chemotaxis-inspired stochastic feedback laws, the book also provides a detailed analysis of convergence for models of nonholonomic robotic vehicles operating in GPS-denied environments. The book contains block diagrams and several simulation examples, including examples arising from bacterial locomotion, multi-agent robotic systems, and economic market models. Stochastic Averaging and Extremum Seeking will be informative for control engineers from backgrounds in electrical, mechanical, chemical and aerospace engineering and to applied mathematicians. Economics researchers, biologists, biophysicists and roboticists will find the applications examples instructive. The Communications and Control Engineering series reports major technological advances which have potential for great impact in the fields of communication and control. It reflects research in industrial and academic institutions around the world so that the readership can exploit new possibilities as they become available.

Rare Events Analysis and Computation for Stochastic Evolution of Bacterial Populations

Rare Events Analysis in Stochastic Models for Bacterial Evolution

Stochastic analysis of emergence of evolutionary cyclic behavior in population dynamics with transfer

Fitness Estimation for Genetic Evolution of Bacterial Populations

A Stochastic Adaptive Dynamics Model for Bacterial Populations with Mutation, Dormancy and Transfer

A Quantitative Test of Population Genetics Using Spatio-Genetic Patterns in Bacterial Colonies

Deterministic approximation for population dynamics in the presence of advantageous mutants

Recombination processes and non-linear Markov chains

A large deviation principle linking lineage statistics to fitness in microbial populations

Sequential mutations in exponentially growing populations

Derivation of the bacterial run-and-tumble kinetic model : quantitative and strong convergence results

Coarse-grained analysis of stochastically simulated cell populations with a positive feedback genetic network architecture

Complete Numerical Solution of the Diffusion Equation of Random Genetic Drift

Likelihood-based inference for discretely observed birth-death-shift processes, with applications to evolution of mobile genetic elements

High-resolution Experimental Study and Numerical Modeling of Population Dynamics in a Bacteria Culture

Computation of random time-shift distributions for stochastic population models

Two-time-scale Population Evolution on a Singular Landscape.

Stochastic trade-offs and the emergence of diversification in E. coli evolution experiments

A stochastic model for the bacterial growth exhibiting staged growth, desynchronization, saturation and persistence

Non-equilibrium time dynamics of genetic evolution

Stochastic Averaging and Stochastic Extremum Seeking