Abstract:Single-image-based view generation (SIVG) is important for producing 3D stereoscopic content. Here, handling different spatial resolutions as input and optimizing both reconstruction accuracy and processing speed is desirable. Latest approaches are based on convolutional neural network (CNN), and they generate promising results. However, their use of fully connected layers as well as pre-trained VGG forces a compromise between reconstruction accuracy and processing speed. In addition, this approach is limited to the use of a specific spatial resolution. To remedy these problems, we propose exploiting fully convolutional networks (FCN) for SIVG. We present two FCN architectures for SIVG. The first one is based on combination of an FCN and a view-rendering network called DeepView$_{ren}$. The second one consists of decoupled networks for luminance and chrominance signals, denoted by DeepView$_{dec}$. To train our solutions we present a large dataset of 2M stereoscopic images. Results show that both of our architectures improve accuracy and speed over the state of the art. DeepView$_{ren}$ generates competitive accuracy to the state of the art, however, with the fastest processing speed of all. That is x5 times faster speed and x24 times lower memory consumption compared to the state of the art. DeepView$_{dec}$ has much higher accuracy, but with x2.5 times faster speed and x12 times lower memory consumption. We evaluated our approach with both objective and subjective studies.

Virtual Viewpoint Image Generation Method Based On Deep Convolutional Neural Network In Autostereoscopic Display

Virtual View Generation Based on 3D-Dense-attentive GAN Networks

A Novel Method of Multi-view Virtual Image Synthesis for Auto-stereoscopic Display

A New Virtual View Rendering Method Based on Depth Image

A New Virtual View Synthesis Method Using SLIC-based Hole Filling

Holographic near-eye display system based on double-convergence light Gerchberg-Saxton algorithm.

3D Synthesis and Crosstalk Reduction for Lenticular Autostereoscopic Displays

Non-reference Virtual View Quality Evaluation of MVD

Performance Improvement for Additive Light Field Displays with Weighted Simultaneous Algebra Reconstruction Technique and Tracked Views

An Accelerated Rendering Algorithm for Stereoscopic Display

Real-time Stereo to Multi-View Conversion System Based on Adaptive Meshing

Multiview Virtual Image Synthesis for Auto-Stereoscopic Display Based on Two Views

High quality 3D autostereoscopic medical display method with optical enhancement and image compensation

Image generation system and method for stereoscopic 3D display

Visual Fatigue Alleviating in Stereo Imaging of Anaglyphs by Reducing Retinal Rivalry and Color Distortion Based on Mobile Virtual Reality Technology

3D Multi-View Stereoscopic Display and Its Key Technologies

Efficient and Scalable View Generation from a Single Image using Fully Convolutional Networks

A novel method of depth-image-based view synthesis

Learning-Based Stereoscopic View Synthesis with Cascaded Deep Neural Networks

No-Reference Stereoscopic Image Quality Assessment Using Convolutional Neural Network for Adaptive Feature Extraction

Real-time High-Quality Computer-Generated Hologram Using Complex-Valued Convolutional Neural Network