A neural network with spatiotemporal encoding module for tropical cyclone intensity estimation from infrared satellite image

Zhe Zhang,Xuying Yang,Xin Wang,Bingbing Wang,Chao Wang,Zhenhong Du

DOI: https://doi.org/10.1016/j.knosys.2022.110005

2022-12-22

Abstract:Accurate and instant estimation of tropical cyclone (TC) intensity is crucial for emergency decision making. Although deep neural networks and satellite images have been increasingly adopted for estimating TC intensity, most neural networks that estimate TC intensity from satellite images are largely dependent on the network structure or the quantity and quality of training data, without sufficiently considering the physical characteristics of satellite images and TCs. Therefore, a spatiotemporal encoding module named STE-TC is devised to facilitate estimating TC intensity from the Himawari-8 (H-8) geostationary satellite images, which can enhance spatial features and integrate temporal information of TCs into the satellite images. Furthermore, a TC intensity estimation model named DenseConvMixer is constructed by applying the dense connectivity strategy to an easily stacked ConvMixer network. To demonstrate the effectiveness of the proposed STE-TC module and DenseConvMixer network, a series of experiments and visualization analyses have been conducted. The experimental results show that the STE-TC module can be applied to estimation models based on the convolutional neural network (CNN) to improve their estimation performances. Moreover, the proposed DenseConvMixer model outperforms other CNN-based models on H-8 satellite images, with an average mean absolute error of 6.77 kt and root mean squared error of 8.89 kt.

computer science, artificial intelligence