Abstract:In the depth map obtained through binocular stereo matching, there are many ill regions due to reasons such as lighting or occlusion. These ill regions cannot be accurately obtained due to the lack of information required for matching. Since the completion model based on Gan generates random results, it cannot accurately complete the depth map. Therefore, it is necessary to accurately complete the depth map according to reality. To address this issue, this paper proposes a depth information precise completion GAN (DIPC-GAN) that effectively uses the Guid layer normalization (GuidLN) module to guide the model for precise completion by utilizing depth edges. GuidLN flexibly adjusts the weights of the guiding conditions based on intermediate results, allowing modules to accurately and effectively incorporate the guiding information. The model employs multiscale discriminators to discriminate results of different resolutions at different generator stages, enhancing the generator's grasp of overall image and detail information. Additionally, this paper proposes Attention-ResBlock, which enables all ResBlocks in each task module of the GAN-based multitask model to focus on their own task by sharing a mask. Even when the ill regions are large, the model can effectively complement the missing details in these regions. Additionally, the multiscale discriminator in the model enhances the generator's robustness. Finally, the proposed task-specific residual module can effectively focus different subnetworks of a multitask model on their respective tasks. The model has shown good repair results on datasets, including artificial, real, and remote sensing images. The final experimental results showed that the model's REL and RMSE decreased by 9.3% and 9.7%, respectively, compared to RDFGan.

Depth Structure Preserving Scene Image Generation

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

Depth Generation Network: Estimating Real World Depth From Stereo And Depth Images

SpatialGAN: Progressive Image Generation Based on Spatial Recursive Adversarial Expansion

Structure First Detail Next: Image Inpainting with Pyramid Generator

Deep Structured Generative Models.

DepthGAN: GAN-based depth generation from semantic layouts

E-DBPN: Enhanced Deep Back-Projection Networks for Remote Sensing Scene Image Superresolution

Unsupervised Learning of Depth Estimation and Camera Pose With Multi-Scale GANs

Unpaired Single-Image Depth Synthesis with cycle-consistent Wasserstein GANs

Scene Graph Disentanglement and Composition for Generalizable Complex Image Generation

Structure Flow-Guided Network for Real Depth Super-Resolution.

Background and Foreground Disentangled Generative Adversarial Network for Scene Image Synthesis

PMBANet: Progressive Multi-Branch Aggregation Network for Scene Depth Super-Resolution

Depth Information Precise Completion-GAN: A Precisely Guided Method for Completing Ill Regions in Depth Maps

Depth Map Prediction from a Single Image with Generative Adversarial Nets.

Exploiting Relationship for Complex-scene Image Generation

Depth Images Could Tell Us More: Enhancing Depth Discriminability for RGB-D Scene Recognition

DH-GCN: Saliency-Aware Complex Scene Graph Generation Using Dual-Hierarchy Graph Convolutional Network

S2R-DepthNet: Learning a Generalizable Depth-specific Structural Representation

Structure Generation and Guidance Network for Unsupervised Monocular Depth Estimation