Abstract:This paper addresses the problem of modeling and estimating dynamic multi-valued mappings. While most mathematical models provide a unique solution for a given input, real-world applications often lack deterministic solutions. In such scenarios, estimating dynamic multi-valued mappings is necessary to suggest different reasonable solutions for each input. This paper introduces a deep neural network framework incorporating a generative network and a classification component. The objective is to model the dynamic multi-valued mapping between the input and output by providing a reliable uncertainty measurement. Generating multiple solutions for a given input involves utilizing a discrete codebook comprising finite variables. These variables are fed into a generative network along with the input, producing various output possibilities. The discreteness of the codebook enables efficient estimation of the output's conditional probability distribution for any given input using a classifier. By jointly optimizing the discrete codebook and its uncertainty estimation during training using a specially designed loss function, a highly accurate approximation is achieved. The effectiveness of our proposed framework is demonstrated through its application to various imaging problems, using both synthetic and real imaging data. Experimental results show that our framework accurately estimates the dynamic multi-valued mapping with uncertainty estimation.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to model and estimate Dynamic Multi - valued Mapping (DMM) in real - world applications. Most mathematical models provide a unique solution for a given input, but in practical applications, deterministic solutions are often lacking. For example, in natural language processing, a sentence may have two different meanings due to the lack of context information; in medical diagnosis, different doctors may have different diagnoses for the CT scan results of the same patient. Therefore, it becomes necessary to estimate dynamic multi - valued mapping to provide different reasonable solutions for each input and be able to reliably measure uncertainty.
Specifically, the paper proposes a deep neural network framework that combines a generative network and a classification component, aiming to model the dynamic multi - valued mapping between input and output by providing reliable uncertainty measurement. The main contributions of this framework include:
1. **Proposing the concept of Dynamic Multi - valued Mapping (DMM)**: Defining dynamic multi - valued mapping and formalizing it as an optimization problem to address the challenge of calculating multiple possible solutions and their uncertainties in real - world scenarios.
2. **Using deep neural networks to parameterize DMM**: Representing DMM as two bivariate functions \( f \) and \( p \), parameterized by the generative network \( G_\theta \) and the classification network \( P_\phi \) respectively. The generative network is responsible for generating multiple results, and the classification network predicts the probabilities of these results.
3. **Introducing specially designed loss functions**: Including covariance loss and ETF cross - entropy loss to optimize the parameters of the generative network and the classification network, ensuring that the generated multiple results are diverse and the probability estimates are accurate.
4. **Applications in multiple imaging problems**: Through experiments on synthetic data and real data, the effectiveness and accuracy of the proposed framework in solving the dynamic multi - valued mapping problem are verified.
Mathematically, the problem can be described as follows: Let \( X \) and \( Y \) represent the input space and the output space respectively. Given a set of paired data sets \( \{(x_i, y_k^i)\}_{k = 1}^{N_i} \) (where \( y_k^i\in Y \) is a possible output related to \( x_i\in X \)), the goal is to find a suitable mapping \( f \) such that \( f(x)=\{y_j\in Y\}_{j = 1}^{N_x} \), where \( N_x \) is a dynamic value depending on \( x \). To find the optimal DMM, the following optimization problem needs to be solved:
\[ f=\arg\min_{g:X\rightarrow P_f(Y)}L(g) \]
where \( L \) is a suitable loss function, such as \( L_2 \) data - fitting loss.
The paper achieves this goal by introducing a discrete codebook \( C = \{c_1, c_2,\ldots, c_N\} \) and two bivariate functions \( f:X\times C\rightarrow Y^N \) and \( p:C\times X\rightarrow[0, 1]^N \). The generative network \( G_\theta \) generates multiple possible outputs \( G_\theta(x, c_j) \) according to the input \( x \) and the discrete variable \( c_j \) in the codebook, and the classification network \( P_\phi \) predicts the probability \( P_\phi(c_j, x) \) of each output. Through jointly optimizing the parameters of the generative network and the classification network, effective modeling of DMM and uncertainty estimation are achieved.