Implicit Neural Image Stitching

Minsu Kim,Jaewon Lee,Byeonghun Lee,Sunghoon Im,Kyong Hwan Jin

DOI: https://doi.org/10.48550/arXiv.2309.01409

2024-01-22

Abstract:Existing frameworks for image stitching often provide visually reasonable stitchings. However, they suffer from blurry artifacts and disparities in illumination, depth level, etc. Although the recent learning-based stitchings relax such disparities, the required methods impose sacrifice of image qualities failing to capture high-frequency details for stitched images. To address the problem, we propose a novel approach, implicit Neural Image Stitching (NIS) that extends arbitrary-scale super-resolution. Our method estimates Fourier coefficients of images for quality-enhancing warps. Then, the suggested model blends color mismatches and misalignment in the latent space and decodes the features into RGB values of stitched images. Our experiments show that our approach achieves improvement in resolving the low-definition imaging of the previous deep image stitching with favorable accelerated image-enhancing methods. Our source code is available at <a class="link-external link-https" href="https://github.com/minshu-kim/NIS" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

The main goal of this paper is to address several key issues present in existing image stitching methods:

1. **Blurry Artifacts**: Although current image stitching frameworks can generate visually reasonable stitched images, they often exhibit blurry artifacts.
2. **Lighting and Depth Differences**: Existing methods are inadequate in handling lighting and depth differences.
3. **Loss of High-Frequency Details**: Recent learning-based stitching methods, while alleviating some differences, still have issues in maintaining image quality and fail to capture high-frequency details.

To tackle these problems, the authors propose a new method—Neural Implicit Stitching (NIS), which extends arbitrary-scale super-resolution techniques. NIS enhances images by estimating their Fourier coefficients and fuses color mismatches and alignment errors in the latent space, finally decoding the features into RGB values to generate the stitched image. Experimental results show that this method achieves significant improvements in solving low-resolution image stitching problems and offers accelerated image enhancement capabilities.