S^2RGAN : Sonar-Image Super-Resolution Based on Generative Adversarial Network

Song Hongtao,Wang Minghao,Zhang Liguo,Li Yang,Jiang Zhengyi,Yin Guisheng
DOI: https://doi.org/10.1007/s00371-020-01986-3
IF: 2.835
2020-01-01
The Visual Computer
Abstract:As an important display mode of underwater environments, the sonar image has limitations on the resolution, which often leads to problems with low resolution of underwater objects. Therefore, the image super-resolution algorithm is needed to transform the images from low-resolution to high-resolution. It can improve the visual effect and contribute to subsequent processing such as 3D reconstruction and object recognition. This paper proposes a method for sonar image super-resolution based on generative adversarial networks (GAN). By comparing the super-resolution effects of various interpolation and convolutional neural network algorithms on sonar images, a Residual-in-Residual Dense Block network is employed as the generator of GAN since it has the low distortion and high perceptual quality. Because the sonar image training set does not have enough data, the generator utilizes the transfer learning on the sonar images to produce an optimized network model which is more suitable for super-resolution of sonar image. The VGG19 network is employed as the discriminator. In addition, the perceptual loss is introduced into the loss function of S 2 RGAN to further improve the perceptual quality of super-resolution images. The experimental results indicate that the proposed S 2 RGAN shows excellent performance. The generated super-resolution images of S 2 RGAN have the remarkable advantages of both lower distortion and higher perceptual quality comparing with other methods. Because S 2 RGAN focuses more on the reality and overall visual effect of super-resolution sonar images, it is suitable for various underwater situations.
What problem does this paper attempt to address?