Abstract:With the continuous advancement of sensing technology, applying large amounts of sensor data to practical prediction processes using artificial intelligence methods has become a developmental direction. In sensing images and remote sensing meteorological data, the dynamic changes in the prediction targets relative to their background information often exhibit more significant dynamic characteristics. Previous prediction methods did not specifically analyze and study the dynamic change information of prediction targets at spatiotemporal multi-scale. Therefore, this paper proposes a neural prediction network based on perceptual multi-scale spatiotemporal dynamic changes (PMSTD-Net). By designing Multi-Scale Space Motion Change Attention Unit (MCAU) to perceive the local situation and spatial displacement dynamic features of prediction targets at different scales, attention is ensured on capturing the dynamic information in their spatial dimensions adequately. On this basis, this paper proposes Multi-Scale Spatiotemporal Evolution Attention (MSEA) unit, which further integrates the spatial change features perceived by MCAU units in higher channel dimensions, and learns the spatiotemporal evolution characteristics at different scales, effectively predicting the dynamic characteristics and regularities of targets in sensor information.Through experiments on spatiotemporal prediction standard datasets such as Moving MNIST, video prediction dataset KTH, and Human3.6m, PMSTD-Net demonstrates prediction performance surpassing previous methods. We construct the GPM satellite remote sensing precipitation dataset, demonstrating the network's advantages in perceiving multi-scale spatiotemporal dynamic changes in remote sensing meteorological data. Finally, through extensive ablation experiments, the performance of each module in PMSTD-Net is thoroughly validated.

SARNN: A Spatiotemporal Prediction Model for Reducing Error Transmissions

SARN: Structurally-Aware Recurrent Network for Spatio-Temporal Disaggregation

Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning

Enhancing spatiotemporal predictive learning: an approach with nested attention module

A Spatiotemporal Autoregressive Neural Network Interpolation Method for Discrete Environmental Factors

A Self-Attention Based Method for Wind Speed Forecasting in High-Speed Railway System

PredRNN: Recurrent Neural Networks for Predictive Learning using Spatiotemporal LSTMs

A Spatial–Temporal Attention Approach for Traffic Prediction

PredRANN: the Spatiotemporal Attention Convolution Recurrent Neural Network for Precipitation Nowcasting

ST-D3DDARN: Urban traffic flow prediction based on spatio-temporal decoupled 3D DenseNet with attention ResNet

Spatiotemporal Data Prediction Model Based on a Multi-Layer Attention Mechanism

Triplet Attention Transformer for Spatiotemporal Predictive Learning

SPRNN: A spatial–temporal recurrent neural network for crowd flow prediction

Multi-Step Traffic Flow Prediction Using Recurrent Neural Network

Enhancing Adaptive History Reserving by Spiking Convolutional Block Attention Module in Recurrent Neural Networks

PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning

PSRUNet: a recurrent neural network for spatiotemporal sequence forecasting based on parallel simple recurrent unit

Spatiotemporal Self-Attention-Based LSTNet for Multivariate Time Series Prediction

Self-Attention ConvLSTM for Spatiotemporal Prediction

PMSTD-Net: A Neural Prediction Network for Perceiving Multi-Scale Spatiotemporal Dynamics

An Efficient Traffic Prediction Model Using Deep Spatial-Temporal Network