Abstract:Background Monocular depth estimation aims to predict a dense depth map from a single RGB image,and has important applications in 3D reconstruction, automatic driving, and augmented reality. However, existing methods directly feed the original RGB image into the model to extract depth features without avoiding the interference of depth-irrelevant information on depth-estimation accuracy, which leads to inferior performance.Methods To remove the influence of depth-irrelevant information and improve the depth-prediction accuracy, we propose RADepthNet, a novel reflectance-guided network that fuses boundary features. Specifically, our method predicts depth maps using the following three steps:（1） Intrinsic Image Decomposition. We propose a reflectance extraction module consisting of an encoder-decoder structure to extract the depth-related reflectance. Through an ablation study, we demonstrate that the module can reduce the influence of illumination on depth estimation.（2）Boundary Detection. A boundary extraction module, consisting of an encoder, refinement block, and upsample block, was proposed to better predict the depth at object boundaries utilizing gradient constraints.（3） Depth Prediction Module. We use an encoder different from（2） to obtain depth features from the reflectance map and fuse boundary features to predict depth. In addition, we proposed FIFADataset, a depth-estimation dataset applied in soccer scenarios. Results Extensive experiments on a public dataset and our proposed FIFADataset show that our method achieves state-of-the-art performance.

ReDDLE-Net: Reflectance Decomposition for Directional Light Estimation

NeIF: Representing General Reflectance as Neural Intrinsics Fields for Uncalibrated Photometric Stereo

Depth Cue Enhancement and Guidance Network for RGB-D Salient Object Detection

Neural Reflectance Decomposition under Dynamic Point Light

Reflectance Edge Guided Networks for Detail-Preserving Intrinsic Image Decomposition.

Deep Retinex Decomposition for Low-Light Enhancement

ReCo-Diff: Explore Retinex-Based Condition Strategy in Diffusion Model for Low-Light Image Enhancement

DANI-Net: Uncalibrated Photometric Stereo by Differentiable Shadow Handling, Anisotropic Reflectance Modeling, and Neural Inverse Rendering

RADepthNet: Reflectance-Aware Monocular Depth Estimation

Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Model

DeRenderNet: Intrinsic Image Decomposition of Urban Scenes with Shape-(In)dependent Shading Rendering

ReCap: Better Gaussian Relighting with Cross-Environment Captures

Estimating Neural Reflectance Field from Radiance Field using Tree Structures

NIID-Net: Adapting Surface Normal Knowledge for Intrinsic Image Decomposition in Indoor Scenes

Lighting Estimation Via Differentiable Screen-Space Rendering

Disparity-guided Multi-view Interaction Network for Light Field Reflection Removal

Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images

Efficient Diffusion as Low Light Enhancer

Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance Modeling

Estimating Spatially-Varying Lighting in Urban Scenes with Disentangled Representation

Calibrated Relighting Network for Image Light Transfer