Abstract:With the continuous advancement of sensing technology, applying large amounts of sensor data to practical prediction processes using artificial intelligence methods has become a developmental direction. In sensing images and remote sensing meteorological data, the dynamic changes in the prediction targets relative to their background information often exhibit more significant dynamic characteristics. Previous prediction methods did not specifically analyze and study the dynamic change information of prediction targets at spatiotemporal multi-scale. Therefore, this paper proposes a neural prediction network based on perceptual multi-scale spatiotemporal dynamic changes (PMSTD-Net). By designing Multi-Scale Space Motion Change Attention Unit (MCAU) to perceive the local situation and spatial displacement dynamic features of prediction targets at different scales, attention is ensured on capturing the dynamic information in their spatial dimensions adequately. On this basis, this paper proposes Multi-Scale Spatiotemporal Evolution Attention (MSEA) unit, which further integrates the spatial change features perceived by MCAU units in higher channel dimensions, and learns the spatiotemporal evolution characteristics at different scales, effectively predicting the dynamic characteristics and regularities of targets in sensor information.Through experiments on spatiotemporal prediction standard datasets such as Moving MNIST, video prediction dataset KTH, and Human3.6m, PMSTD-Net demonstrates prediction performance surpassing previous methods. We construct the GPM satellite remote sensing precipitation dataset, demonstrating the network's advantages in perceiving multi-scale spatiotemporal dynamic changes in remote sensing meteorological data. Finally, through extensive ablation experiments, the performance of each module in PMSTD-Net is thoroughly validated.

MEHGNet: a Multi-Feature Extraction and High-Resolution Generative Network for Satellite Cloud Image Sequence Prediction

MSTCGAN: Multiscale Time Conditional Generative Adversarial Network for Long-Term Satellite Image Sequence Prediction

Typhoon cloud image prediction based on enhanced multi-scale deep neural network

Satellite Image Prediction Relying on GAN and LSTM Neural Networks

Meteorological Satellite Images Prediction Based on Deep Multi-scales Extrapolation Fusion

A Multi-scale Spatiotemporal Attention Network for Ground-Based Remote Sensing Cloud Image Sequence Prediction

CSIP-Net: Convolutional Satellite Image Prediction Network for Meteorological Satellite Infrared Observation Imaging

Visual Prediction of Typhoon Clouds With Hierarchical Generative Adversarial Networks

A sequence-to-sequence based multi-scale deep learning model for satellite cloud image prediction

Exploiting Spatial–Temporal Dynamics for Satellite Image Sequence Prediction

TYPHOON CLOUD PREDICTION VIA GENERATIVE ADVERSARIAL NETWORKS

Enhanced Remote Sensing Image Compression Method Using Large Network with Sparse Extracting Strategy

CMPN: A Multimodal Predictive Model for Cloud Trajectory Forecast

From Single to Multiple: Leveraging Multi-level Prediction Spaces for Video Forecasting

Learning to Generate Time-Lapse Videos Using Multi-Stage Dynamic Generative Adversarial Networks

Prediction of Short-Time Cloud Motion Using a Deep-Learning Model

Cloud Cover Prediction Model Using Multichannel Geostationary Satellite Images

Learning Spatial–Temporal Consistency for Satellite Image Sequence Prediction

MSSTNet: A Multi-Scale Spatiotemporal Prediction Neural Network for Precipitation Nowcasting.

PMSTD-Net: A Neural Prediction Network for Perceiving Multi-Scale Spatiotemporal Dynamics

MEFSR-GAN: A Multi-Exposure Feedback and Super-Resolution Multitask Network via Generative Adversarial Networks