Abstract:On-device computing, or edge computing, is becoming increasingly important for remote sensing, particularly in applications like deep network-based perception on on-orbit satellites and unmanned aerial vehicles (UAVs). In these scenarios, two brain-like capabilities are crucial for remote sensing models: (1) high energy efficiency, allowing the model to operate on edge devices with limited computing resources, and (2) online adaptation, enabling the model to quickly adapt to environmental variations, weather changes, and sensor drift. This work addresses these needs by proposing an online adaptation framework based on spiking neural networks (SNNs) for remote sensing. Starting with a pretrained SNN model, we design an efficient, unsupervised online adaptation algorithm, which adopts an approximation of the BPTT algorithm and only involves forward-in-time computation that significantly reduces the computational complexity of SNN adaptation learning. Besides, we propose an adaptive activation scaling scheme to boost online SNN adaptation performance, particularly in low time-steps. Furthermore, for the more challenging remote sensing detection task, we propose a confidence-based instance weighting scheme, which substantially improves adaptation performance in the detection task. To our knowledge, this work is the first to address the online adaptation of SNNs. Extensive experiments on seven benchmark datasets across classification, segmentation, and detection tasks demonstrate that our proposed method significantly outperforms existing domain adaptation and domain generalization approaches under varying weather conditions. The proposed method enables energy-efficient and fast online adaptation on edge devices, and has much potential in applications such as remote perception on on-orbit satellites and UAV.

Space Detector Health Prediction Based on Online Neural Network

Real-Time Epileptic Seizure Detection Based on Deep Learning.

Spacecraft Components Detection Based on a Lightweight YOLOv3 Model

A robust seizure detection and prediction method with feature selection and spatio-temporal casual neural network model.

Online Anomaly Detection of Streaming Data for Space Payloads Based on Improved GNG Algorithm

A Neural Network Approach for Satellite Telemetry Data Prediction

Deep Convolutional Neural Network Algorithm Based on Optical Sensors and Wireless Mobile Networks for Real time Monitoring of Physical Health

A task of anomaly detection for a smart satellite Internet of things system

Brain-Inspired Online Adaptation for Remote Sensing with Spiking Neural Network

AgeDETR: Attention-Guided Efficient DETR for Space Target Detection

Spatial-Temporal Feature Extraction Network for Online Aero-engines Remaining Useful Life Prediction

Designing Deep Neural Networks Robust to Sensor Failure in Mobile Health Environments

A Real-Time Recognition Method for Telemetry Status of Spacecraft In-Orbit Based on Neural Network Pattern Recognition

High-accuracy Health Prediction of Sensor Systems Using Improved Relevant Vector-Machine Ensemble Regression.

Online Growing Neural Gas for Anomaly Detection in Changing Surveillance Scenes

Improved Deep Learning Based Telemetry Data Anomaly Detection to Enhance Spacecraft Operation Reliability

DetectorNet

Deep Neural Network closed-loop with raw data for optical resident space object detection

High-precision Domain Adaptive Detection Method for Non-cooperative Spacecraft Based on Optical Sensor Data

Fall Detection System Based on Deep Learning and Image Processing in Cloud Environment

Deep learning for the next generation (highly sensitive and reliable) ECLSS fire monitoring and detection system