Abstract:The last decade has witnessed an experimental revolution in data science and machine learning, epitomised by deep learning methods. Indeed, many high-dimensional learning tasks previously thought to be beyond reach -- such as computer vision, playing Go, or protein folding -- are in fact feasible with appropriate computational scale. Remarkably, the essence of deep learning is built from two simple algorithmic principles: first, the notion of representation or feature learning, whereby adapted, often hierarchical, features capture the appropriate notion of regularity for each task, and second, learning by local gradient-descent type methods, typically implemented as backpropagation. While learning generic functions in high dimensions is a cursed estimation problem, most tasks of interest are not generic, and come with essential pre-defined regularities arising from the underlying low-dimensionality and structure of the physical world. This text is concerned with exposing these regularities through unified geometric principles that can be applied throughout a wide spectrum of applications. Such a 'geometric unification' endeavour, in the spirit of Felix Klein's Erlangen Program, serves a dual purpose: on one hand, it provides a common mathematical framework to study the most successful neural network architectures, such as CNNs, RNNs, GNNs, and Transformers. On the other hand, it gives a constructive procedure to incorporate prior physical knowledge into neural architectures and provide principled way to build future architectures yet to be invented.

Geometric Deep Learning: Going beyond Euclidean data

Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges

Deep Clustering and Representation Learning that Preserves Geometric Structures

A Comprehensive Survey on Geometric Deep Learning

Beyond Euclid: An Illustrated Guide to Modern Machine Learning with Geometric, Topological, and Algebraic Structures

Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs

Geometric Deep Learning for Computer-Aided Design: A Survey

Deep Learning and Geometric Deep Learning: an introduction for mathematicians and physicists

A Survey of Geometric Optimization for Deep Learning: From Euclidean Space to Riemannian Manifold

Geometric Neural Operators (GNPs) for Data-Driven Deep Learning of Non-Euclidean Operators

Grassmannian Learning: Embedding Geometry Awareness in Shallow and Deep Learning

Hyperbolic Deep Learning in Computer Vision: A Survey

How deep learning works --The geometry of deep learning

Geometric Graph Representations and Geometric Graph Convolutions for Deep Learning on Three-Dimensional (3D) Graphs

Markov-Lipschitz Deep Learning

Geometric Constraints in Deep Learning Frameworks: A Survey

A survey on Deep Learning Advances on Different 3D Data Representations

On the Geometry of Deep Learning

Demystifying Deep Learning: A Geometric Approach to Iterative Projections

A Survey of Deep Learning-Based Mesh Processing

Geometric deep learning methods and applications in 3D structure-based drug design