Abstract: Exemplar-free Class-incremental Learning (CIL) is a challenging problem because rehearsing data from previous phases is strictly prohibited, causing catastrophic forgetting of Deep Neural Networks (DNNs). In this paper, we present iVoro, a holistic framework for CIL, derived from computational geometry. We found Voronoi Diagram (VD), a classical model for space subdivision, is especially powerful for solving the CIL problem, because VD itself can be constructed favorably in an incremental manner -- the newly added sites (classes) will only affect the proximate classes, making the non-contiguous classes hardly forgettable. Further, in order to find a better set of centers for VD construction, we colligate DNN with VD using Power Diagram and show that the VD structure can be optimized by integrating local DNN models using a divide-and-conquer algorithm. Moreover, our VD construction is not restricted to the deep feature space, but is also applicable to multiple intermediate feature spaces, promoting VD to be multi-centered VD (CIVD) that efficiently captures multi-grained features from DNN. Importantly, iVoro is also capable of handling uncertainty-aware test-time Voronoi cell assignment and has exhibited high correlations between geometric uncertainty and predictive accuracy (up to ~0.9). Putting everything together, iVoro achieves up to 25.26%, 37.09%, and 33.21% improvements on CIFAR-100, TinyImageNet, and ImageNet-Subset, respectively, compared to the state-of-the-art non-exemplar CIL approaches. In conclusion, iVoro enables highly accurate, privacy-preserving, and geometrically interpretable CIL that is particularly useful when cross-phase data sharing is forbidden, e.g. in medical applications. Our code is available at https://machunwei.github.io/ivoro.

VoronoiNet: General Functional Approximators with Local Support

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

Split-and-Fit: Learning B-Reps via Structure-Aware Voronoi Partitioning

Voroto: multiscale topology optimization of voronoi structures using surrogate neural networks

Dual octree graph networks for learning adaptive volumetric shape representations

Vector Neurons: A General Framework for SO(3)-Equivariant Networks

DPA-Net: Structured 3D Abstraction from Sparse Views via Differentiable Primitive Assembly

Coupling Explicit and Implicit Surface Representations for Generative 3D Modeling

Mixing-Denoising Generalizable Occupancy Networks

AIR-Nets: An Attention-Based Framework for Locally Conditioned Implicit Representations

Lightweight 3-D Convolutional Occupancy Networks for Virtual Object Reconstruction

Progressive Voronoi Diagram Subdivision: Towards A Holistic Geometric Framework for Exemplar-free Class-Incremental Learning

RenderNet: A deep convolutional network for differentiable rendering from 3D shapes

VIPNet: A Fast and Accurate Single-View Volumetric Reconstruction by Learning Sparse Implicit Point Guidance

3DILG: Irregular Latent Grids for 3D Generative Modeling

ViscoNet: Bridging and Harmonizing Visual and Textual Conditioning for ControlNet

NeurVPS: Neural Vanishing Point Scanning Via Conic Convolution.

DMNet: Delaunay Meshing Network for 3D Shape Representation

Geom-DeepONet: A Point-cloud-based Deep Operator Network for Field Predictions on 3D Parameterized Geometries