Abstract:Generating learning-friendly representations for points in space is a fundamental and long-standing problem in machine learning. Recently, multi-scale encoding schemes (such as Space2Vec and NeRF) were proposed to directly encode any point in 2D or 3D Euclidean space as a high-dimensional vector, and has been successfully applied to various (geo)spatial prediction and generative tasks. However, all current 2D and 3D location encoders are designed to model point distances in Euclidean space. So when applied to large-scale real-world GPS coordinate datasets (e.g., species or satellite images taken all over the world), which require distance metric learning on the spherical surface, both types of models can fail due to the map projection distortion problem (2D) and the spherical-to-Euclidean distance approximation error (3D). To solve these problems, we propose a multi-scale location encoder called Sphere2Vec which can preserve spherical distances when encoding point coordinates on a spherical surface. We developed a unified view of distance-reserving encoding on spheres based on the Double Fourier Sphere (DFS). We also provide theoretical proof that the Sphere2Vec encoding preserves the spherical surface distance between any two points, while existing encoding schemes such as Space2Vec and NeRF do not. Experiments on 20 synthetic datasets show that Sphere2Vec can outperform all baseline models including the state-of-the-art (SOTA) 2D location encoder (i.e., Space2Vec) and 3D encoder NeRF on all these datasets with up to 30.8% error rate reduction. We then apply Sphere2Vec to three geo-aware image classification tasks -fine-grained species recognition, Flickr image recognition, and remote sensing image classification. Results on 7 real-world datasets show the superiority of Sphere2Vec over multiple 2D and 3D location encoders on all three tasks. Further analysis shows that Sphere2Vec outperforms other location encoder models, especially in the polar regions and data-sparse areas because of its nature for spherical surface distance preservation. Code and data of this work are available at https://gengchenmai.github.io/sphere2vec-website/.

Constrained Best Euclidean Distance Embedding On A Sphere: A Matrix Optimization Approach

A Class of Optimal Transportation Problems on the Sphere

Doubly Stochastic Neighbor Embedding on Spheres

Global Solutions to Large-Scale Spherical Constrained Quadratic Minimization via Canonical Dual Approach

Riemannian Optimization for Non-convex Euclidean Distance Geometry with Global Recovery Guarantees

Convex optimization learning of faithful Euclidean distance representations in nonlinear dimensionality reduction

Sphere2Vec: A General-Purpose Location Representation Learning over a Spherical Surface for Large-Scale Geospatial Predictions

On the Geometric Analysis of a Quartic–quadratic Optimization Problem under a Spherical Constraint

A Feasible Method for Optimization with Orthogonality Constraints

Constrained Metric Learning Via Distance Gap Maximization

A Convergent Finite Difference Method for Optimal Transport on the Sphere

Sphere Packings in Euclidean Space with Forbidden Distances

GeodesicEmbedding (GE): A High-Dimensional Embedding Approach for Fast Geodesic Distance Queries

Mixed-Projection Conic Optimization: A New Paradigm for Modeling Rank Constraints

Clustering and Geodesic Scaling of Dissimilarities on the Spherical Surface

Barriers for recent methods in geodesic optimization

Sparse Indefinite Kernel Learning on Sphere.

Convex relaxations for large-scale graphically structured nonconvex problems with spherical constraints: An optimal transport approach

Sparse image reconstruction on the sphere: a general approach with uncertainty quantification

Optimization Algorithms for Faster Computational Geometry.

Interpreting Sphere Images Using the Double-Contact Theorem