A study of nonlinear multiview varieties

Yairon Cid-Ruiz,Oliver Clarke,Fatemeh Mohammadi
2023-10-09
Abstract:We study the nonlinear generalization of the classical multiview variety, which is a fundamental concept in computer vision. In this paper, we take the first comprehensive step to develop the nonlinear analogue of multiview varieties. To this end, we introduce a multigraded version of the saturated special fiber ring. By applying this tool, we are able to compute the multidegrees of several families of nonlinear multiview varieties.
Algebraic Geometry,Commutative Algebra
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to generalize the classical concept of multiview variety to the nonlinear case. Specifically, the authors introduce a new tool - a multigraded version of the saturated special fiber ring - to study multiview varieties under nonlinear rational maps. ### Specific Problem Description 1. **Limitations of Classical Multiview Varieties** - The classical multiview variety is a very important concept in computer vision. It is defined as the closure of the image of a linear rational map \( G: \mathbb{P}^3_k \dashrightarrow \mathbb{P}^2_k \times \cdots \times \mathbb{P}^2_k \). - The defining ideal \( J \) of the linear rational map \( G \) has a good structure and can be studied by various methods. For example, \( J \) is a Cartwright - Sturmfels ideal, and its generators can be explicitly described. 2. **Challenges in the Nonlinear Case** - When the rational map \( G \) is nonlinear, the above methods are no longer applicable. In particular, it is difficult to determine the generators of the defining ideal, and this ideal is not necessarily a Cartwright - Sturmfels ideal. - Therefore, how to calculate the Hilbert function and its multidegrees of the nonlinear multiview variety becomes a key problem. ### Goals of the Paper The main goal of the paper is to solve the problem of calculating the multidegrees of nonlinear multiview varieties by introducing and studying the multigraded version of the saturated special fiber ring. Specifically: - **Introducing a New Tool**: Define and study the multigraded version of the saturated special fiber ring (see Definition 3.4), which is a key tool for studying the multidegrees of the images of nonlinear rational maps. - **Main Results**: - Theorem 3.6 gives the relationship between the mixed multiplicities of the saturated special fiber ring and the multidegrees of the nonlinear multiview variety. - Theorem 3.8 provides an upper bound for the multidegrees of the nonlinear multiview variety and gives an exact formula in the case where the base points are zero - dimensional. - Theorem 5.5 gives explicit multidegree formulas for certain special types of base ideals (such as perfect ideals of height two or Gorenstein ideals of height three). ### Applications and Significance Through these results, the paper provides a new theoretical framework and computational methods for the study of nonlinear multiview varieties, further expanding the applications of multiview geometry in computer vision and other related fields. In summary, this paper aims to solve the problem of calculating the multidegrees of nonlinear multiview varieties and introduces new algebraic tools and theoretical frameworks for this purpose.