Abstract:The production and playback processes involved in rendering 3D content exhibit a notable degree of intricacy and inefficiency. This article presents a comprehensive array of remedies aimed at addressing challenges to the acquisition, processing, and display of such content. The proposed framework is strategically compartmentalized into three key modules: the depth map generation and optimization module, the multi-viewpoint generation and optimization module, and the 3D content encoding and display module. Within the domain of depth map generation and optimization, we introduce a self-supervised convolutional network that builds upon the PSMNet(Pyramid Stereo Matching Network) architecture. This network serves the purpose of extracting accurate depth data. In the realm of multi-viewpoint generation and optimization, we put forth a novel partial convolutional neural network founded upon the Edge-PUnet framework. This network is specifically designed to enhance virtual viewpoint images. The efficacy of the depth data generation algorithm is substantiated by achieving an Out-Noc value of 2.27% on the KITTI-2012 dataset. Furthermore, the virtual viewpoint optimization algorithm yields notable outcomes, as evidenced by attained PSNR and SSIM values of 32.688 and 0.932, respectively, in the context of a street dance sequence. In summation, the outcomes of our study suggest that the implemented system holds promise for elevating the efficiency of 3D content production while concurrently curbing associated costs.

3D Multi-View Stereoscopic Display and Its Key Technologies

Key Technologies of 3D Auto-stereoscopic Display Systems and Corresponding Applications in China Pavilion of 2010 Expo

Overview on Key Technologies and Application Trends of 3DTV

Overview on three dimensional display technology

Technical Analysis of 3DTV and Outstanding Issues

Multi-view 3D Light Field Video Broadcast System

Real-time Stereo to Multi-View Conversion System Based on Adaptive Meshing

Development of Three-Dimensional Stereoscopic Display Techniques

A Survey on Stereoscopic Television Technologies

Multi-view 3D display system for autostereoscopic LED displays

A Probe into Several Stereoscopic Display Technologies

Design and Implementation of A Stereoscopic Video Player for A Time-Division Display

An automatic 2D to 3D conversion algorithm using multi-depth cues

The Image Processing and Data Analysis of Dense Multi-view Autostereoscopic 3D Display System Based on Dynamic Parallax Barriers

Stereoscopic to Multi-view Video Conversion System FPGA Implementation

17.2: Large‐scale Color Omnidirectional‐view Three‐dimensional Display Based on Projector Array

A Comprehensive System for 3D Display: from Image Capture to Autostereoscopic Playback

Realtime Side-By-Side to Super Multi View 3d Display

An Overview of 3D Video Representation and Coding

A Survey On Three-Dimension Display Technologies

Interactive 3-DTV-Concepts and Key Technologies