Abstract:Convolutional neural networks (CNNs) designed for low-dimensional regular grids will unfortunately lead to non-optimal solutions for analyzing spherical images, due to their different geometrical properties from planar images. In this paper, we generalize the grid-based CNNs to a non-Euclidean space by taking into account the geometry of spherical surfaces and propose a Spherical Graph Convolutional Network (SGCN) to encode rotation equivariant representations. Specifically, we propose a spherical graph construction criterion showing that a graph needs to be regular by evenly covering the spherical surfaces in order to design a rotation equivariant graph convolutional layer. For the practical case where the perfectly regular graph does not exist, we design two quantitative measures to evaluate the degree of irregularity for a spherical graph. The Geodesic ICOsahedral Pixelation (GICOPix) is adopted to construct spherical graphs with the minimum degree of irregularity compared to the current popular pixelation schemes. In addition, we design a hierarchical pooling layer to keep the rotation-equivariance, followed by a transition layer to enforce the invariance to the rotations for spherical image classification. We evaluate the proposed graph convolutional layers with different pixelations schemes in terms of equivariance errors. We also assess the effectiveness of the proposed SGCN in fulfilling rotation-invariance by the invariance error of the transition layers and recognizing the spherical images and 3D objects.

Spherical convolutional neural networks: Stability to perturbations in SO ( 3 )

Rotation Equivariant Graph Convolutional Network for Spherical Image Classification

Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutions

Spherical Transformer: Adapting Spherical Signal to CNNs

Scaling Spherical CNNs

A New Rotation-Invariant Deep Network for 3D Object Recognition

Spherical Fractal Convolutional Neural Networks for Point Cloud Recognition

PDO-eS2CNNs: Partial Differential Operator Based Equivariant Spherical CNNs

Equivariant Spherical Deconvolution: Learning Sparse Orientation Distribution Functions from Spherical Data

Leveraging SO(3)-steerable convolutions for pose-robust semantic segmentation in 3D medical data

Rotation-Equivariant Graph Convolutional Networks for Spherical Data Via Global-Local Attention.

Self-supervised rotation-equivariant spherical vector network for learning canonical 3D point cloud orientation

A Spherical Approach to Planar Semantic Segmentation.

Spherical CNNs on Unstructured Grids

Approximate Equivariance SO(3) Needlet Convolution

PDO-s3DCNNs: Partial Differential Operator Based Steerable 3D CNNs

PDO-s3DCNNs: Partial Differential Operator Based Steerable 3D CNNs.

Spherical CNN for Medical Imaging Applications: Importance of Equivariance in image reconstruction and denoising

Spherical convolutional neural networks can improve brain microstructure estimation from diffusion MRI data

Object Detection in Omnidirectional Images Based on Spherical CNN

TetraSphere: A Neural Descriptor for O(3)-Invariant Point Cloud Analysis