Abstract:Modeling images/videos with covariance matrices has attracted increasing attentions in various vision tasks, especially in visual classification. For covariances-based visual classification, measuring the distances between covariances is one of the key issues and has been studied for decades. Since the space of covariances is a Riemannian manifold, the geometrical structure of covariances should be favorably considered when designing distance metrics. Although this problem has been widely studied, designing an effective and efficient metric between high-dimensional covariances (HDCOV) for scalable classification is still an open problem. In this paper, we present an information geometry-based distance (IGBD) to tackle this challenge from the perspective of information geometry. Our idea is based on the fact that each covariance can be viewed as a zero-mean Gaussian distribution, and thus the distances between covariances are measured by those between the corresponding Gaussian distributions. The core of our method is to project each distribution, in the form of a set of random samples, to a vector on the tangent space of a common, known distribution on the statistical manifold, based on Fisher information metric and maximum likelihood method. On the tangent space, the Euclidean norm can be used to measure the distances between those sets of projection vectors (or equivalently distributions). The proposed IGBD for HDCOV is computationally efficient and easily combined with a linear support vector machine, suitable for scalable visual classification. The experiments are conducted on various kinds and sizes of benchmarks, and results show the proposed method is efficient and the combination of HDCOV can achieve very competitive performance.

Visibility graph-based covariance functions for scalable spatial analysis in non-convex partially Euclidean domains

A flexible and interpretable spatial covariance model for data on graphs

Hybrid Parametric Classes of Isotropic Covariance Functions for Spatial Random Fields

A Spatial Concordance Correlation Coefficient with an Application to Image Analysis

A class of covariate-dependent spatiotemporal covariance functions for the analysis of daily ozone concentration

Visibility graphs of random scalar fields and spatial data

Semiparametric Estimation of Cross-covariance Functions for Multivariate Random Fields

An Information Geometry-Based Distance Between High-Dimensional Covariances for Scalable Classification

Multi-Fidelity Covariance Estimation in the Log-Euclidean Geometry

Versatile Parametric Classes of Covariance Functions that Interlace Anisotropies and Hole Effects

Nonstationary Spatial Process Models with Spatially Varying Covariance Kernels

A Variational Approach for Modeling High-dimensional Spatial Generalized Linear Mixed Models

Learning a Depth Covariance Function

Normalizing Basis Functions: Approximate Stationary Models for Large Spatial Data

Flexible Basis Representations for Modeling Large Non-Gaussian Spatial Data

Cross-Covariance Functions for Multivariate Geostatistics

Multivariate nearest‐neighbors Gaussian processes with random covariance matrices

Posterior Covariance Structures in Gaussian Processes

Bayesian variable selection for spatially dependent generalized linear models

A Criterion for Multivariate Regionalization of Spatial Data