Self‐attention residual network‐based spatial super‐resolution synthesis for time‐varying volumetric data

Ji Ma,Yuhao Ye,Jinjin Chen

DOI: https://doi.org/10.1049/ipr2.13050

IF: 2.3

2024-02-15

IET Image Processing

Abstract:This paper proposes a novel self‐attention residual network‐based spatial super‐resolution (SARN‐SSR) framework for upscaling time‐varying volume data in scientific visualization. It utilizes a generator and discriminator based on generative adversarial networks to generate high‐resolution volume sequences. Comparative evaluations demonstrate that SARN‐SSR outperforms state‐of‐the‐art techniques in generating accurate time‐varying volume datasets. In the field of scientific visualization, the upscaling of time‐varying volume is meaningful. It can be used in in situ visualization to help scientists overcome the limitations of I/O speed and storage capacity when analysing and visualizing large‐scale, time‐varying simulation data. This paper proposes self‐attention residual network‐based spatial super‐resolution (SARN‐SSR), a spatial super‐resolution model based on self‐attention residual networks that can generate time‐varying data with temporal coherence. SARN‐SSR consists of two components: a generator and a discriminator. The generator takes the low‐resolution volume sequences as the input and gives the corresponding high‐resolution volume sequences as the output. The discriminator takes both synthesized and real high‐resolution volume sequence as the input and gives a matrix to predict the realness as the output. To verify the validity of SARN‐SSR, four sets of time‐varying volume datasets are applied from scientific simulation. In addition, SARN‐SSR is compared on these datasets, both qualitatively and quantitatively, with two deep learning‐based techniques and one traditional technique. The experimental results show that by using this method, the closest time‐varying data to the ground truth can be obtained.

computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology