Abstract:This paper considers real-time control and learning problems for finite-dimensional linear systems under binary-valued and randomly disturbed output observations. This has long been regarded as an open problem because the exact values of the traditional regression vectors used in the construction of adaptive algorithms are unavailable, as one only has binary-valued output information. To overcome this difficulty, we consider the adaptive estimation problem of the corresponding infinite-impulse-response (IIR) dynamical systems, and apply the double array martingale theory that has not been previously used in adaptive control. This enables us to establish global convergence results for both the adaptive prediction regret and the parameter estimation error, without resorting to such stringent data conditions as persistent excitation and bounded system signals that have been used in almost all existing related literature. Based on this, an adaptive control law will be designed that can effectively combine adaptive learning and feedback control. Finally, we are able to show that the closed-loop adaptive control system is optimal in the sense that the long-run average tracking error is minimized almost surely for any given bounded reference signals. To the best of the authors' knowledge, this appears to be the first adaptive control result for general linear systems with general binary sensors and arbitrarily given bounded reference signals.

Adaptive Tracking of a Class of First-Order Systems with Binary-Valued Observations and Fixed Thresholds

Event-triggered Adaptive Control for a Class of Discrete-Time Uncertain Nonlinear Systems

Adaptive Tracking Control of Linear Systems with Binary-Valued Observations and Periodic Target.

Adaptive Tracking Control with Binary-Valued Output Observations

Adaptive Tracking Control of Linear Systems to Periodic Target with Set-Valued Information

Adaptive Neural Asymptotic Tracking Control for a Class of Stochastic Non-Strict-feedback Switched Systems

Adaptive Robust Tracking Control for First-Order Linear Systems with Input Delay and Lipschitz Nonlinear Disturbance.

Adaptive Tracking Control for a Class of Stochastic Switched Systems

Adaptive Exact Tracking Control for a Class of Uncertain Nonlinear Switched Systems with Arbitrary Switchings.

Adaptive Asymptotic Tracking Control of a Class of Discrete-Time Nonlinear Systems with Parametric and Nonparametric Uncertainties

Adaptive Backstepping-Based Tracking Control of a Class of Uncertain Switched Nonlinear Systems.

Intelligent Tracking Control for a Class of Uncertain High-Order Nonlinear Systems

Adaptive Tracking Control with Quantized Output Observations and Single Unknown Parameter

Optimal tracking control of a class of nonlinear discrete-time switched systems using adaptive dynamic programming

Adaptive Tracking Control for a Class of Uncertain Nonlinear Systems with Markovian Jumping Parameters

Adaptive Tracking Control of Nonlinear Systems with Unknown Time‐varying Parameters Via a Monotonically Increasing Function

Adaptive Tracking Control for a Class of Constrained Nonlinear Systems with Uncertainty

Adaptive Tracking Control for Uncertain Switched Stochastic Nonlinear Pure-Feedback Systems with Unknown Backlash-Like Hysteresis

Prescribed Performance Adaptive Tracking Control with Small Overshoot for a Class of Uncertain Second-Order Nonlinear Systems

Adaptive Fuzzy Tracking Control for a Class of High-Order Switched Uncertain Nonlinear Systems

Suboptimal adaptive tracking control for FIR systems with binary-valued observations