Abstract:Multi-viewpoint image stitching aims to stitch images taken from different viewpoints into pictures with a broader field of view. The stitched images are subject to artifacts, geometric distortion, and blur distortion due to the mismatch of feature points, inaccurate homography estimation, and improper fusion of the unstitched images. Deep learning has recently been increasingly applied to multi-viewpoint image stitching to overcome these problems. However, there has thus far been little related research to summarize the different deep learning techniques used for multi-viewpoint image stitching. Therefore, this review aims to explore the application of deep learning to multi-viewpoint image stitching. To better illustrate this topic, we first summarize the acquisition methods for multi-viewpoint images and the main challenges of image stitching. After which, deep learning techniques for multi-view image stitching with a single camera are sorted out. Subsequently, deep learning techniques for multi-view image stitching with camera arrays, including parallel-view multi-view image stitching and cross-view multi-view image stitching, are presented. Next, we summarize image stitching datasets, evaluation metrics, and experimental data of several leading stitching algorithms on public datasets. Finally, we discuss potential issues and future work on image stitching with multi-viewpoint images.

Applications of Deep Learning for Top-View Omnidirectional Imaging: A Survey

Deep Learning for Omnidirectional Vision: A Survey and New Perspectives

Object Detection and Localization in 3D Environment by Fusing Raw Fisheye Image and Attitude Data

Object Detection on Panoramic Images Based on Deep Learning

A Survey on Deep Learning Methods for Robot Vision

Real-time Omnidirectional Depth Perception Based on Multi-view Wide-angle Vision System

Monocular Depth Estimation Based on Deep Learning:A Survey

A Survey on Monocular 3D Object Detection Algorithms Based on Deep Learning

Deep ViDAR: CNN Based 360 degrees Panoramic Video System for Outdoor Robot Visual Navigation and SLAM

Deep Learning on Image Stitching With Multi-viewpoint Images: A Survey

3D Reconstruction Using Deep Learning: a Survey.

Deep learning-based scene understanding for autonomous robots: a survey

Where to drive: free space detection with one fisheye camera

Applications of Deep Learning in Fundus Images: A Review

DeepVO: A Deep Learning approach for Monocular Visual Odometry

Deep learning-based perception systems for autonomous driving: A comprehensive survey

Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overview

Multi-view stereo in the Deep Learning Era: A comprehensive review

OmniSLAM: Omnidirectional Localization and Dense Mapping for Wide-baseline Multi-camera Systems.