Abstract:This paper considers real-time control and learning problems for finite-dimensional linear systems under binary-valued and randomly disturbed output observations. This has long been regarded as an open problem because the exact values of the traditional regression vectors used in the construction of adaptive algorithms are unavailable, as one only has binary-valued output information. To overcome this difficulty, we consider the adaptive estimation problem of the corresponding infinite-impulse-response (IIR) dynamical systems, and apply the double array martingale theory that has not been previously used in adaptive control. This enables us to establish global convergence results for both the adaptive prediction regret and the parameter estimation error, without resorting to such stringent data conditions as persistent excitation and bounded system signals that have been used in almost all existing related literature. Based on this, an adaptive control law will be designed that can effectively combine adaptive learning and feedback control. Finally, we are able to show that the closed-loop adaptive control system is optimal in the sense that the long-run average tracking error is minimized almost surely for any given bounded reference signals. To the best of the authors' knowledge, this appears to be the first adaptive control result for general linear systems with general binary sensors and arbitrarily given bounded reference signals.

Minimax dual control with finite-dimensional information state

Output Feedback Minimax Adaptive Control

Minimax Optimal Control of Uncertain Quasi-Integrable Hamiltonian Systems with Time-Delayed Bounded Feedback

ℒ1adaptive Controller for a Class of Non-Affine Multi-Input Multi-Output Nonlinear Systems

Optimal Linear Filtering for Discrete-Time Systems with Infinite-Dimensional Measurements

Robust Integral Of Neural Network And Sign Of Tracking Error Control Of Uncertain Nonlinear Affine Systems Using State And Output Feedback

A Minimax Stochastic Optimal Control for Bounded-Uncertain Systems

Intrinsic Separation Principles

Robust Output Feedback of Nonlinear Systems through the Efficient Solution of Min-Max Optimization Problems

Optimal Control Design Under Limited Model Information for Discrete-Time Linear Systems With Stochastically-Varying Parameters

Minimax Linear Optimal Control of Positive Systems

An Information-state based Approach to the Optimal Output Feedback Control of Nonlinear Systems

Inverse Optimal Adaptive Fuzzy Output Feedback Control for Nonlinear Systems with Output Quantization

$\mathcal{H}_2/\mathcal{H}_\infty$ Optimal Control with Sparse Sensing and Actuation

Adaptive Tracking Control with Binary-Valued Output Observations

Minimax Performance Limits for Multiple-Model Estimation

Closed-form H-infinity Optimal Control for a Class of Infinite-Dimensional Systems

Minimax control of ambiguous linear stochastic systems using the Wasserstein metric

An Online Learning Analysis of Minimax Adaptive Control

A General Method for Optimal Decentralized Control with Current State/Output Feedback Strategy

Linear-quadratic optimal control for infinite-dimensional input-state-output systems