Abstract:Continual learning, also known as incremental learning or life-long learning, stands at the forefront of deep learning and AI systems. It breaks through the obstacle of one-way training on close sets and enables continuous adaptive learning on open-set conditions. In the recent decade, continual learning has been explored and applied in multiple fields especially in computer vision covering classification, detection and segmentation tasks. Continual semantic segmentation (CSS), of which the dense prediction peculiarity makes it a challenging, intricate and burgeoning task. In this paper, we present a review of CSS, committing to building a comprehensive survey on problem formulations, primary challenges, universal datasets, neoteric theories and multifarious applications. Concretely, we begin by elucidating the problem definitions and primary challenges. Based on an in-depth investigation of relevant approaches, we sort out and categorize current CSS models into two main branches including data-replay and data-free sets. In each branch, the corresponding approaches are similarity-based clustered and thoroughly analyzed, following qualitative comparison and quantitative reproductions on relevant datasets. Besides, we also introduce four CSS specialities with diverse application scenarios and development tendencies. Furthermore, we develop a benchmark for CSS encompassing representative references, evaluation results and reproductions, which is available at~\url{<a class="link-external link-https" href="https://github.com/YBIO/SurveyCSS" rel="external noopener nofollow">this https URL</a>}. We hope this survey can serve as a reference-worthy and stimulating contribution to the advancement of the life-long learning field, while also providing valuable perspectives for related fields.

Research on Continuous Learning Classifier System

An XCS-based Approach to Classification Learning on Continuous-Valued Attributes

Robot Reinforcement Learning Based on LCS-GDM

A Survey on Continual Semantic Segmentation: Theory, Challenge, Method and Application

Continual Learning with Knowledge Transfer for Sentiment Classification

Learning Classifier System Ensemble for Data Mining

A Comprehensive Survey of Continual Learning: Theory, Method and Application

Continual learning classification method with constant-sized memory cells based on the artificial immune system

Recent Advances of Foundation Language Models-based Continual Learning: A Survey

Ensemble learning classifier system and compact ruleset

Knowledge Extraction and Retention Based Continual Learning by Using Convolutional Autoencoder-Based Learning Classifier System

Machine Learning from a Continuous Viewpoint,i

SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Model

Learning Algorithm for Neural Networks Based upon Continuous-time System Simulation

Neural-Based Learning Classifier Systems

Confidence-Guided Learning Process for Continuous Classification of Time Series

LCSE: Learning Classifier System Ensemble for Incremental Medical Instances

Continual Graph Convolutional Network for Text Classification

SSXCS:Semi-supervised learning classifier system

Adaptive Rentention & Correction for Continual Learning