Abstract:There has been much recent interest in designing symmetry-aware neural networks (NNs) exhibiting relaxed equivariance. Such NNs aim to interpolate between being exactly equivariant and being fully flexible, affording consistent performance benefits. In a separate line of work, certain structured parameter matrices -- those with displacement structure, characterized by low displacement rank (LDR) -- have been used to design small-footprint NNs. Displacement structure enables fast function and gradient evaluation, but permits accurate approximations via compression primarily to classical convolutional neural networks (CNNs). In this work, we propose a general framework -- based on a novel construction of symmetry-based structured matrices -- to build approximately equivariant NNs with significantly reduced parameter counts. Our framework integrates the two aforementioned lines of work via the use of so-called Group Matrices (GMs), a forgotten precursor to the modern notion of regular representations of finite groups. GMs allow the design of structured matrices -- resembling LDR matrices -- which generalize the linear operations of a classical CNN from cyclic groups to general finite groups and their homogeneous spaces. We show that GMs can be employed to extend all the elementary operations of CNNs to general discrete groups. Further, the theory of structured matrices based on GMs provides a generalization of LDR theory focussed on matrices with cyclic structure, providing a tool for implementing approximate equivariance for discrete groups. We test GM-based architectures on a variety of tasks in the presence of relaxed symmetry. We report that our framework consistently performs competitively compared to approximately equivariant NNs, and other structured matrix-based compression frameworks, sometimes with a one or two orders of magnitude lower parameter count.

A Survey on Symmetrical Neural Network Architectures and Applications

Symmetry Perception by Deep Networks: Inadequacy of Feed-Forward Architectures and Improvements with Recurrent Connections

Symmetrical Singular Value Decomposition Representation for Pattern Recognition

Beyond Planar Symmetry: Modeling Human Perception of Reflection and Rotation Symmetries in the Wild

Symmetry Breaking and Equivariant Neural Networks

A Survey on Convolution Neural Networks

Symmetry Discovery for Different Data Types

Symmetry Awareness Encoded Deep Learning Framework for Brain Imaging Analysis

Current Symmetry Group Equivariant Convolution Frameworks for Representation Learning

A Non-Technical Survey on Deep Convolutional Neural Network Architectures

Invariant multiscale neural networks for data-scarce scientific applications

Learning in the machine: The symmetries of the deep learning channel

Neural Architecture Search Survey: A Computer Vision Perspective

Analysis of modern SOTA-architectures of artificial neural networks for solving problems of image classification and object detection

Symmetry-Based Structured Matrices for Efficient Approximately Equivariant Networks

SRN: Side-Output Residual Network for Object Reflection Symmetry Detection and Beyond

A survey on neural-symbolic learning systems

Symmetry-Based Representations for Artificial and Biological General Intelligence

A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions

PRS-Net: Planar Reflective Symmetry Detection Net for 3D Models