Abstract:In real-world clinical settings, traditional deep learning-based classification methods struggle with diagnosing newly introduced disease types because they require samples from all disease classes for offline training. Class incremental learning offers a promising solution by adapting a deep network trained on specific disease classes to handle new diseases. However, catastrophic forgetting occurs, decreasing the performance of earlier classes when adapting the model to new data. Prior proposed methodologies to overcome this require perpetual storage of previous samples, posing potential practical concerns regarding privacy and storage regulations in healthcare. To this end, we propose a novel data-free class incremental learning framework that utilizes data synthesis on learned classes instead of data storage from previous classes. Our key contributions include acquiring synthetic data known as Continual Class-Specific Impression ( CCSI ) for previously inaccessible trained classes and presenting a methodology to effectively utilize this data for updating networks when introducing new classes. We obtain CCSI by employing data inversion over gradients of the trained classification model on previous classes starting from the mean image of each class inspired by common landmarks shared among medical images and utilizing continual normalization layers statistics as a regularizer in this pixel-wise optimization process. Subsequently, we update the network by combining the synthesized data with new class data and incorporate several losses, including an intra-domain contrastive loss to generalize the deep network trained on the synthesized data to real data, a margin loss to increase separation among previous classes and new ones, and a cosine-normalized cross-entropy loss to alleviate the adverse effects of imbalanced distributions in training data. Extensive experiments show that the proposed framework achieves state-of-the-art performance on four of the public MedMNIST datasets and in-house echocardiography cine series, with an improvement in classification accuracy of up to 51% compared to baseline data-free methods. Our code is available at https://github.com/ubc-tea/Continual-Impression-CCSI .

Selecting Distinctive-Variant Training Samples Base on Intra-class Similarity

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Selective Sparse Sampling for Fine-Grained Image Recognition

Tolerant Self-Distillation for Image Classification

DICS: Find Domain-Invariant and Class-Specific Features for Out-of-Distribution Generalization

Multi-representation Based Virtual Samples for Image Classification

Diversified Batch Selection for Training Acceleration

Deep Neural Network Benchmarks for Selective Classification

CCSI: Continual Class-Specific Impression for data-free class incremental learning

DELT: A Simple Diversity-driven EarlyLate Training for Dataset Distillation

Embrace Sustainable AI: Dynamic Data Subset Selection for Image Classification

Modeling Inter-Class and Intra-Class Constraints in Novel Class Discovery

Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruning

S2TNet: Spectral–Spatial Triplet Network for Few-Shot Hyperspectral Image Classification

The More, the Better? Active Silencing of Non-Positive Transfer for Efficient Multi-Domain Few-Shot Classification

Exploiting Inter-sample and Inter-feature Relations in Dataset Distillation

Measuring Discrimination to Boost Comparative Testing for Multiple Deep Learning Models

DSIC: Dynamic Sample-Individualized Connector for Multi-Scale Object Detection

CRISP: Hybrid Structured Sparsity for Class-aware Model Pruning

Dataset Distillation via Curriculum Data Synthesis in Large Data Era