Abstract:To infer unknown remote sensing scenarios, most existing technologies use a supervised learning paradigm to train deep neural network (DNN) models on closed datasets. This paradigm faces challenges such as highly spatiotemporal variants and ever-changing scale-heterogeneous remote sensing scenarios. Additionally, DNN models cannot scale to new scenarios. Lifelong learning is an effective solution to these problems. Current lifelong learning approaches focus on overcoming the catastrophic forgetting issue (i.e., a successive increase in heterogeneous remote sensing scenes causes models to forget historical scenes) while ignoring the knowledge recall issue (i.e., how to facilitate the learning of new scenes by recalling historical experiences), which is a significant problem. This article proposes a lifelong learning framework called asymmetric collaborative network (SCN) for lifelong remote sensing image (RSI) classification. This framework consists of two structurally distinct networks: a preserving network (Pres-Net) and a transient network (Trans-Net), which imitate the long- and short-term memory processes in the brain, respectively. Moreover, this framework is based on two synergistic knowledge transfer mechanisms: triple distillation and prior feature fusion. The triple distillation mechanism enables knowledge persistence from Trans-Net to Pres-Net to achieve better memorization; the prior feature fusion mechanism enables knowledge transfer from Pres-Net to Trans-Net to achieve better recall. Experiments on three open datasets demonstrate the effectiveness of SCN for three-, six-, and nine-task-length learning. The idea of asymmetric separation networks and the synergistic strategy proposed in this article are expected to provide new solutions to the translatability of the classification of RSIs in real-world scenarios. The source codes are available at https://github.com/GeoX-Lab/SCN.

Autonomous Cognition Development with Lifelong Learning: A Self-Organizing and Reflecting Cognitive Network

C^2:Co-design of Robots via Concurrent Networks Coupling Online and Offline Reinforcement Learning

C2: Co-design of Robots Via Concurrent-Network Coupling Online and Offline Reinforcement Learning

A Self-Organizing Developmental Cognitive Architecture with Interactive Reinforcement Learning.

Scalable Cognitive Developmental Network: A Strategy for Integrating New Perception Online Using Relation Evolution SOINN

An Autonomous Developmental Cognitive Architecture Based on Incremental Associative Neural Network with Dynamic Audiovisual Fusion

Adaptive Reorganization of Neural Pathways for Continual Learning with Spiking Neural Networks

CLFR-M: Continual Learning Framework for Robots Via Human Feedback and Dynamic Memory

Developmental Cognitive Map Learning And Behavior Acquisition By A Mobile Robot Through A Self-Organizing Incremental Neural Network

Vision-Action Semantic Associative Learning Based on Spiking Neural Networks for Cognitive Robot.

Lifelong Learning of Spatiotemporal Representations with Dual-Memory Recurrent Self-Organization

Self-Organizing Recurrent Stochastic Configuration Networks for Nonstationary Data Modelling

Better Memorization, Better Recall: A Lifelong Learning Framework for Remote Sensing Image Scene Classification

Online Active Continual Learning for Robotic Lifelong Object Recognition

Lifelong Intelligence Beyond the Edge using Hyperdimensional Computing

Self-Organizing Incremental Neural Network And Its Application

Continual Learning for Autonomous Robots: A Prototype-based Approach

A Novel Continuous Learning and Collaborative Decision Making Mechanism for Real-Time Cooperation of Humanoid Service Robots

Neuro-mimetic Task-free Unsupervised Online Learning with Continual Self-Organizing Maps

A Self-Organizing Incremental Neural Network Based on Local Distribution Learning

CoSCL: Cooperation of Small Continual Learners is Stronger than a Big One