Inference for Multiple and Conditional Observers

Martin T. Barlow

2024-11-20

Abstract:We consider models for inference which involve observers which may have multiple copies, such as in the Sleeping Beauty problem. We establish a framework for describing these problems on a probability space satisfying Kolmogorov's axioms, and this enables the main competing solutions to be compared precisely.

Probability

What problem does this paper attempt to address?

Hidden Markov Models with Multiple Observers

Hua Chen,Zhi Geng,Jinzhu Jia

DOI: https://doi.org/10.1007/978-3-540-74205-0_47

2007-01-01

Abstract:Hidden Markov models (HMMs) usually assume that the state transition matrices and the output models are time-invariant. Without this assumption, the parameters in a HMM may not be identifiable. In this paper, we propose a HMM with multiple observers such that its parameters are local identifiable without the time-invariant assumption. We show a sufficient condition for local identifiability of parameters in HMMS.
High-gain Observers with Limited Gain Power for Systems with Observability Canonical Form

Lei Wang,Daniele Astolfi,Lorenzo Marconi,Hongye Su

DOI: https://doi.org/10.1016/j.automatica.2016.09.006

2017-01-01

Abstract:We consider the problem of state observation for systems having a well-defined observability canonical form (Gauthier and Kupka (2004)) by means of high-gain observers. The main goal is to show that, for this class of systems, observers can be designed with the high-gain parameter powered just up to the order 2 regardless the dimension of the state system. In this way we substantially overtake the main limitations of standard design procedures in which the high-gain parameter is powered up to the order of the system. The observer structure, which generalizes the ideas presented in Astolfi and Marconi (2015), can be used in all those contexts where fast state observation is required, such as in the design of output feedback stabilizers by means of the nonlinear separation principle that is also specifically addressed in the paper.
Choosing observation operators to mitigate model error in Bayesian inverse problems

Nada Cvetković,Han Cheng Lie,Harshit Bansal,Karen Veroy

2024-06-26

Abstract:In statistical inference, a discrepancy between the parameter-to-observable map that generates the data and the parameter-to-observable map that is used for inference can lead to misspecified likelihoods and thus to incorrect estimates. In many inverse problems, the parameter-to-observable map is the composition of a linear state-to-observable map called an `observation operator' and a possibly nonlinear parameter-to-state map called the `model'. We consider such Bayesian inverse problems where the discrepancy in the parameter-to-observable map is due to the use of an approximate model that differs from the best model, i.e. to nonzero `model error'. Multiple approaches have been proposed to address such discrepancies, each leading to a specific posterior. We show how to use local Lipschitz stability estimates of posteriors with respect to likelihood perturbations to bound the Kullback--Leibler divergence of the posterior of each approach with respect to the posterior associated to the best model. Our bounds lead to criteria for choosing observation operators that mitigate the effect of model error for Bayesian inverse problems of this type. We illustrate one such criterion on an advection-diffusion-reaction PDE inverse problem from the literature, and use this example to discuss the importance and challenges of model error-aware inference.

Statistics Theory
Theory and Inference for a Class of Observation-driven Models with Application to Time Series of Counts

Richard A. Davis,Heng Liu

DOI: https://doi.org/10.48550/arXiv.1204.3915

2012-04-18

Abstract:This paper studies theory and inference related to a class of time series models that incorporates nonlinear dynamics. It is assumed that the observations follow a one-parameter exponential family of distributions given an accompanying process that evolves as a function of lagged observations. We employ an iterated random function approach and a special coupling technique to show that, under suitable conditions on the parameter space, the conditional mean process is a geometric moment contracting Markov chain and that the observation process is absolutely regular with geometrically decaying coefficients. Moreover the asymptotic theory of the maximum likelihood estimates of the parameters is established under some mild assumptions. These models are applied to two examples; the first is the number of transactions per minute of Ericsson stock and the second is related to return times of extreme events of Goldman Sachs Group stock.

Statistics Theory
[Draft] High-order observers and high-order state-estimation-based properties of discrete-event systems

Kuize Zhang,Xiaoguang Han,Alessandro Giua,Carla Seatzu

2024-08-13

Abstract:State-estimation-based properties are central properties in discrete-event systems modeled by labeled finite-state automata studied over the past 3 decades. Most existing results are based on a single agent who knows the structure of a system and can observe a subset of events and estimate the system's state based on the system's structure and the agent's observation to the system. The main tool used to do state estimation and verify state-estimation-based properties is called \emph{observer} which is the powerset construction originally proposed by Rabin and Scott in 1959, used to determinize a nondeterministic finite automaton with $\varepsilon$-transitions. In this paper, we consider labeled finite-state automata, extend the state-estimation-based properties from a single agent to a finite ordered set of agents and also extend the original observer to \emph{high-order observer} based on the original observer and our \emph{concurrent composition}. As a result, a general framework on high-order state-estimation-based properties have been built and a basic tool has also been built to verify such properties. This general framework contains many basic properties as its members such as state-based opacity, critical observability, determinism, high-order opacity, etc. Special cases for which verification can be done more efficiently are also discussed. In our general framework, the system's structure is publicly known to all agents $A_1,\dots,A_n$, each agent $A_i$ has its own observable event set $E_i$, and additionally knows all its preceding agents' observable events but can only observe its own observable events. The intuitive meaning of our high-order observer is what agent $A_n$ knows about what $A_{n-1}$ knows about \dots what $A_2$ knows about $A_1$'s state estimate of the system.

Formal Languages and Automata Theory
Causal inference using the algorithmic Markov condition

Dominik Janzing,Bernhard Schoelkopf

DOI: https://doi.org/10.48550/arXiv.0804.3678

2008-04-23

Abstract:Inferring the causal structure that links n observables is usually based upon detecting statistical dependences and choosing simple graphs that make the joint measure Markovian. Here we argue why causal inference is also possible when only single observations are present. We develop a theory how to generate causal graphs explaining similarities between single objects. To this end, we replace the notion of conditional stochastic independence in the causal Markov condition with the vanishing of conditional algorithmic mutual information and describe the corresponding causal inference rules. We explain why a consistent reformulation of causal inference in terms of algorithmic complexity implies a new inference principle that takes into account also the complexity of conditional probability densities, making it possible to select among Markov equivalent causal graphs. This insight provides a theoretical foundation of a heuristic principle proposed in earlier work. We also discuss how to replace Kolmogorov complexity with decidable complexity criteria. This can be seen as an algorithmic analog of replacing the empirically undecidable question of statistical independence with practical independence tests that are based on implicit or explicit assumptions on the underlying distribution.

Statistics Theory,Information Theory,Machine Learning
Point estimate observers: A new class of models for perceptual decision making.

Heiko H. Schütt,Aspen H. Yoo,Joshua Calder-Travis,Wei Ji Ma

DOI: https://doi.org/10.1037/rev0000402

IF: 8.2473

2023-04-07

Psychological Review

Abstract:Bayesian optimal inference is often heralded as a principled, general framework for human perception. However, optimal inference requires integration over all possible world states, which quickly becomes intractable in complex real-world settings. Additionally, deviations from optimal inference have been observed in human decisions. A number of approximation methods have previously been suggested, such as sampling methods. In this study, we additionally propose point estimate observers , which evaluate only a single best estimate of the world state per response category. We compare the predicted behavior of these model observers to human decisions in five perceptual categorization tasks. Compared to the Bayesian observer, the point estimate observer loses decisively in one task, ties in two and wins in two tasks. Two sampling observers also improve upon the Bayesian observer, but in a different set of tasks. Thus, none of the existing general observer models appears to fit human perceptual decisions in all situations, but the point estimate observer is competitive with other observer models and may provide another stepping stone for future model development. (PsycInfo Database Record (c) 2023 APA, all rights reserved)

psychology, multidisciplinary
Multi-Sensor Observer Designs For A Class Of Nonlinear Systems

Yu Tang,Haibo Ji,Xinghu Wang

DOI: https://doi.org/10.1109/ICCA.2019.8899953

2019-01-01

Abstract:This paper addresses the observer design for a class of nonlinear systems with multiple sensors giving redundant output measurements. When the output measurements are noisy, it is shown that the (noise-free) clean state of the system can be recovered asymptotically as the number of the coupled observers grows by synchronizing a group of complete-order observers. Contraction analysis enables to establish exponential convergence of the state estimate to the system state. Application to a perspective vision system is considered.
Towards an Approximation Theory of Observable Operator Models

Wojciech Anyszka

2024-04-18

Abstract:Observable operator models (OOMs) offer a powerful framework for modelling stochastic processes, surpassing the traditional hidden Markov models (HMMs) in generality and efficiency. However, using OOMs to model infinite-dimensional processes poses significant theoretical challenges. This article explores a rigorous approach to developing an approximation theory for OOMs of infinite-dimensional processes. Building upon foundational work outlined in an unpublished tutorial [Jae98], an inner product structure on the space of future distributions is rigorously established and the continuity of observable operators with respect to the associated 2-norm is proven. The original theorem proven in this thesis describes a fundamental obstacle in making an infinite-dimensional space of future distributions into a Hilbert space. The presented findings lay the groundwork for future research in approximating observable operators of infinite-dimensional processes, while a remedy to the encountered obstacle is suggested.

Probability,Machine Learning
Explicitly Solvable Continuous-time Inference for Partially Observed Markov Processes

Daniel Chen,Alexander G. Strang,Andrew W. Eckford,Peter J. Thomas

DOI: https://doi.org/10.48550/arXiv.2301.00843

2023-01-03

Abstract:Many natural and engineered systems can be modeled as discrete state Markov processes. Often, only a subset of states are directly observable. Inferring the conditional probability that a system occupies a particular hidden state, given the partial observation, is a problem with broad application. In this paper, we introduce a continuous-time formulation of the sum-product algorithm, which is a well-known discrete-time method for finding the hidden states' conditional probabilities, given a set of finite, discrete-time observations. From our new formulation, we can explicitly solve for the conditional probability of occupying any state, given the transition rates and observations within a finite time window. We apply our algorithm to a realistic model of the cystic fibrosis transmembrane conductance regulator (CFTR) protein for exact inference of the conditional occupancy probability, given a finite time series of partial observations.

Signal Processing,Information Theory,Quantitative Methods
Partial Conditioning for Inference of Many-Normal-Means with Hölder Constraints

Jiasen Yang,Xiao Wang,Chuanhai Liu

2024-04-12

Abstract:Inferential models have been proposed for valid and efficient prior-free probabilistic inference. As it gradually gained popularity, this theory is subject to further developments for practically challenging problems. This paper considers the many-normal-means problem with the means constrained to be in the neighborhood of each other, formally represented by a Hölder space. A new method, called partial conditioning, is proposed to generate valid and efficient marginal inference about the individual means. It is shown that the method outperforms both a fiducial-counterpart in terms of validity and a conservative-counterpart in terms of efficiency. We conclude the paper by remarking that a general theory of partial conditioning for inferential models deserves future development.

Statistics Theory,Methodology
The Mathematical Model of Multivariant Dynamic Observation Process

Chen Bi

2000-01-01

Abstract:The general theory of all information observation problems which include detection, estimation, statistics, pattern recognition is researched. They are described by multiary observation processes. The varying situation of information of observation subject about observation object when information is transformed from object to subject is analysed. A mathematical model which is recurrence algorithm of posterior probability density is given, and it can be referenced by the researchers who research observation processes to find the algorithm to specific problem.
Observer Design For Systems With Unknown Inputs And Missing Measurements

Yang Liu,Zidong Wang,Xiao He,Donghua Zhou

DOI: https://doi.org/10.1109/chicc.2016.7553354

2016-01-01

Abstract:In this paper, the observer design problem is considered for a class of systems with unknown inputs and missing measurements. A Bernoulli distributed sequence taking values on 0 or 1 is employed to govern possible missing measurements. It is worth mentioning that the effects of the unknown inputs cannot be fully eliminated from the estimation error due to the stochastic nature of the addressed system. In such a case, an observer is established which can decouple the estimation error from the unknown inputs in the mathematical expectation sense. Moreover, the uniform ultimate boundedness of the estimation error is discussed. A simulation example is presented to show the effectiveness of the proposed algorithm.
Cooperative Hypothesis Testing by Two Observers with Asymmetric Information

Aneesh Raghavan,John S. Baras

2024-09-17

Abstract:We consider the binary hypothesis testing problem with two observers. There are two possible states of nature (or hypotheses). Observations collected by the two observers are statistically related to the true state of nature. The knowledge of joint distribution of the observations collected and the true state of nature is unknown to the observers. There are two problems to be solved by the observers: (i) true state of nature is known: find the distribution of the local information collected; (ii) true state of nature is unknown: collaboratively estimate the same using the distributions found by solving the first problem. We present four algorithms, each having two phases where the two problems are solved, with emphasis on the information exchange between the observers and resulting patterns. We prove different properties of the algorithms including the following: the probability spaces constructed as a consequence of solving the first problem are dependent on the information patterns at the observers; (ii) the rate of decay of probability of error of algorithms while solving the second problem is dependent on the information exchange between the observers. We present a numerical example demonstrating the four algorithms.

Systems and Control
Simultaneous State and Unknown Input Set-Valued Observers for Some Classes of Nonlinear Dynamical Systems

Mohammad Khajenejad,Sze Zheng Yong

DOI: https://doi.org/10.1002/rnc.6163

2021-02-05

Abstract:In this paper, we propose fixed-order set-valued (in the form of l2-norm hyperballs) observers for some classes of nonlinear bounded-error dynamical systems with unknown input signals that simultaneously find bounded hyperballs of states and unknown inputs that include the true states and inputs. Necessary and sufficient conditions in the form of Linear Matrix Inequalities (LMIs) for the stability (in the sense of quadratic stability) of the proposed observers are derived for ($\mathcal{M},\gamma$)- Quadratically Constrained (($\mathcal{M},\gamma$)-QC) systems, which includes several classes of nonlinear systems: (I) Lipschitz continuous, (II) ($\mathcal{A},\gamma$)-QC* and (III) Linear Parameter-Varying (LPV) systems. This new quadratic constraint property is at least as general as the incremental quadratic constraint property for nonlinear systems and is proven in the paper to embody a broad range of nonlinearities. In addition, we design the optimal $\mathcal{H}_{\infty}$ observer among those that satisfy the quadratic stability conditions and show that the design results in Uniformly Bounded-Input Bounded-State (UBIBS) estimate radii/error dynamics and uniformly bounded sequences of the estimate radii. Furthermore, we provide closed-form upper bound sequences for the estimate radii and sufficient condition for their convergence to steady state. Finally, the effectiveness of the proposed set-valued observers is demonstrated through illustrative examples, where we compare the performance of our observers with some existing observers.

Systems and Control
Partial-Observation Stochastic Games: How to Win When Belief Fails

Krishnendu Chatterjee,Laurent Doyen

DOI: https://doi.org/10.1109/lics.2012.28

2012-06-01

Abstract:We consider two-player stochastic games played on finite graphs with reachability objectives where the first player tries to ensure a target state to be visited almost-surely (i.e., with probability 1), or positively (i.e., with positive probability), no matter the strategy of the second player. We classify such games according to the information and the power of randomization available to the players. On the basis of information, the game can be one-sided with either (a) player 1, or (b) player 2 having partial observation (and the other player has perfect observation), or two-sided with (c) both players having partial observation. On the basis of randomization, the players (a) may not be allowed to use randomization (pure strategies), or (b) may choose a probability distribution over actions but the actual random choice is external and not visible to the player (actions invisible), or (c) may use full randomization. Our main results for pure strategies are as follows. (1) For one-sided games with player 1 having partial observation we show that (in contrast to full randomized strategies) belief-based (subset-construction based) strategies are not sufficient, and we present an exponential upper bound on memory both for almostsure and positive winning strategies; we show that the problem of deciding the existence of almost-sure and positive winning strategies for player 1 is EXPTIME-complete. (2) For one-sided games with player 2 having partial observation we show that non-elementary memory is both necessary and sufficient for both almost-sure and positive winning strategies. (3) We show that for the general (two-sided) case finite-memory strategies are sufficient for both positive and almost-sure winning, and at least non-elementary memory is required. We establish the equivalence of the almost-sure winning problems for pure strategies and for randomized strategies with actions invisible. Our equivalence result exhibits serious flaws in previous results of the literature: we show a non-elementary memory lower bound for almost-sure winning whereas an exponential upper bound was previously claimed.
Inference and learning in sparse systems with multiple states

A Braunstein,A Ramezanpour,R Zecchina,P Zhang

DOI: https://doi.org/10.1103/PhysRevE.83.056114

Abstract:We discuss how inference can be performed when data are sampled from the nonergodic phase of systems with multiple attractors. We take as a model system the finite connectivity Hopfield model in the memory phase and suggest a cavity method approach to reconstruct the couplings when the data are separately sampled from few attractor states. We also show how the inference results can be converted into a learning protocol for neural networks in which patterns are presented through weak external fields. The protocol is simple and fully local, and is able to store patterns with a finite overlap with the input patterns without ever reaching a spin-glass phase where all memories are lost.
A Markovian Model for Joint Observations, Bell's Inequality and Hidden States

Ulrich Faigle,Alexander Schönhuth

DOI: https://doi.org/10.48550/arXiv.1011.1295

2012-06-07

Abstract:While the standard approach to quantum systems studies length preserving linear transformations of wave functions, the Markov picture focuses on trace preserving operators on the space of Hermitian (self-adjoint) matrices. The Markov approach extends the standard one and provides a refined analysis of measurements and quantum Markov chains. In particular, Bell's inequality becomes structurally clear. It turns out that hidden state models are natural in the Markov context. In particular, a violation of Bell's inequality is seen to be compatible with the existence of hidden states. The Markov model moreover clarifies the role of the "negative probabilities" in Feynman's analysis of the EPR paradox.

Information Theory,Quantum Physics
Inconsistency and Acausality in Bayesian Inference for Physical Problems

Klaus Mosegaard,Andrew Curtis

2024-11-13

Abstract:Bayesian inference is used to estimate continuous parameter values given measured data in many fields of science. The method relies on conditional probability densities to describe information about both data and parameters, yet the notion of conditional densities is inadmissible: probabilities of the same physical event, computed from conditional densities under different parameterizations, may be inconsistent. We show that this inconsistency, together with acausality in hierarchical methods, invalidate a variety of commonly applied Bayesian methods when applied to problems in the physical world, including trans-dimensional inference, general Bayesian dimensionality reduction methods, and hierarchical and empirical Bayes. Models in parameter spaces of different dimensionalities cannot be compared, invalidating the concept of natural parsimony, the probabilistic counterpart to Occams Razor. Bayes theorem itself is inadmissible, and Bayesian inference applied to parameters that characterize physical properties requires reformulation.

Methodology
Relative Belief Inferences from Decision Theory

Michael Evans,Gun Ho Jang

DOI: https://doi.org/10.3390/e26090786

IF: 2.738

2024-09-15

Entropy

Abstract:Relative belief inferences are shown to arise as Bayes rules or limiting Bayes rules. These inferences are invariant under reparameterizations and possess a number of optimal properties. In particular, relative belief inferences are based on a direct measure of statistical evidence.

physics, multidisciplinary

Inference for Multiple and Conditional Observers

Hidden Markov Models with Multiple Observers

High-gain Observers with Limited Gain Power for Systems with Observability Canonical Form

Choosing observation operators to mitigate model error in Bayesian inverse problems

Theory and Inference for a Class of Observation-driven Models with Application to Time Series of Counts

[Draft] High-order observers and high-order state-estimation-based properties of discrete-event systems

Causal inference using the algorithmic Markov condition

Point estimate observers: A new class of models for perceptual decision making.

Multi-Sensor Observer Designs For A Class Of Nonlinear Systems

Towards an Approximation Theory of Observable Operator Models

Explicitly Solvable Continuous-time Inference for Partially Observed Markov Processes

Partial Conditioning for Inference of Many-Normal-Means with Hölder Constraints

The Mathematical Model of Multivariant Dynamic Observation Process

Observer Design For Systems With Unknown Inputs And Missing Measurements

Cooperative Hypothesis Testing by Two Observers with Asymmetric Information

Simultaneous State and Unknown Input Set-Valued Observers for Some Classes of Nonlinear Dynamical Systems

Partial-Observation Stochastic Games: How to Win When Belief Fails

Inference and learning in sparse systems with multiple states

A Markovian Model for Joint Observations, Bell's Inequality and Hidden States

Inconsistency and Acausality in Bayesian Inference for Physical Problems

Relative Belief Inferences from Decision Theory