Optimal Inference for Distributed Detection

Earnest Akofor

DOI: https://doi.org/10.48550/arXiv.1605.05808

2020-05-27

Abstract:In distributed detection, there does not exist an automatic way of generating optimal decision strategies for non-affine decision functions. Consequently, in a detection problem based on a non-affine decision function, establishing optimality of a given decision strategy, such as a generalized likelihood ratio test, is often difficult or even impossible. In this thesis we develop a novel detection network optimization technique that can be used to determine necessary and sufficient conditions for optimality in distributed detection for which the underlying objective function is monotonic and convex in probabilistic decision strategies. Our developed approach leverages on basic concepts of optimization and statistical inference which are provided in sufficient detail. These basic concepts are combined to form the basis of an optimal inference technique for signal detection. We prove a central theorem that characterizes optimality in a variety of distributed detection architectures. We discuss three applications of this result in distributed signal detection. These applications include interactive distributed detection, optimal tandem fusion architecture, and distributed detection by acyclic graph networks. In the conclusion we indicate several future research directions, which include possible generalizations of our optimization method and new research problems arising from each of the three applications considered.

Information Theory,Optimization and Control,Applications

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that in distributed detection, for non - affine decision functions, there is a lack of a method for automatically generating optimal decision strategies. Specifically, when the decision function is non - affine, it is usually difficult or even impossible to determine the optimality of a given decision strategy. The main objective of the paper is to develop a new detection network optimization technique that can be used to determine the necessary and sufficient conditions for optimality when the objective function is monotonic and convex with respect to the probability decision strategy.

### Core problems of the paper
1. **Optimality problem of non - affine decision functions**:
- In distributed detection, when the decision function is non - affine, it is difficult or impossible to determine the optimality of a given decision strategy.
- Existing methods usually rely on sub - optimal techniques such as numerical programming and simulation, even in the simplest problems.

2. **Lack of an optimization framework**:
- There is a lack of an efficient optimization framework that can provide explicit model - independent decision rules applicable to all monotonic and convex decision functions without relying on sub - optimal techniques.

### Solutions
The paper proposes a new optimization technique aimed at solving the above problems. The main contributions include:

1. **Optimal hypothesis testing**:
- It is proved that each monotonic and convex decision function has a unique optimal solution.
- The general structure representing the optimal decision rules is derived, and these rules are the necessary and sufficient conditions for this optimal solution.

2. **Interactive distributed detection**:
- Based on the optimality criterion, the case where two sensors exchange 1 - bit decisions through one memoryless interaction in series is studied.
- The results show that this interaction can improve the Neyman - Pearson test of fixed - sample performance, but will not improve the large - sample asymptotic performance of the test.

3. **Optimal fusion architecture**:
- The optimal two - sensor series fusion architecture in which the sensor with a higher signal - to - noise ratio should be the fusion center in the case of low signal - to - noise ratio is determined.

4. **Detection based on directed acyclic graphs**:
- The problem of Bayesian distributed detection in a sensor network in the form of a directed acyclic graph is studied.
- It is proved that if the messages transmitted between sensors are the same, the optimal local decision rules will not be more complex than simple series and parallel networks.

### Importance
- **Reduction of computational effort**: By providing a general optimization framework, the effort required to calculate the decision rules of monotonic and convex decision functions can be significantly reduced.
- **Analytical tractability**: If the sensor observations are conditionally independent and follow some simple distributions (such as the exponential family), then the decision problem becomes analytically tractable even in some complex situations (such as distributed detection based on directed acyclic graphs).

In summary, this paper solves the optimality problem of non - affine decision functions in distributed detection by developing a new optimization technique and provides a general solution applicable to various distributed detection architectures.