Abstract:Many computer vision tasks, such as monocular depth estimation and height estimation from a satellite orthophoto, have a common underlying goal, which is regression of dense continuous values for the pixels given a single image. We define them as dense continuous-value regression (DCR) tasks. Recent approaches based on deep convolutional neural networks significantly improve the performance of DCR tasks, particularly on pixelwise regression accuracy. However, it still remains challenging to simultaneously preserve the global structure and fine object details in complex scenes. In this article, we take advantage of the efficiency of Laplacian pyramid on representing multiscale contents to reconstruct high-quality signals for complex scenes. We design a Laplacian pyramid neural network (LAPNet), which consists of a Laplacian pyramid decoder (LPD) for signal reconstruction and an adaptive dense feature fusion (ADFF) module to fuse features from the input image. More specifically, we build an LPD to effectively express both global and local scene structures. In our LPD, the upper and lower levels, respectively, represent scene layouts and shape details. We introduce a residual refinement module to progressively complement high-frequency details for signal prediction at each level. To recover the signals at each individual level in the pyramid, an ADFF module is proposed to adaptively fuse multiscale image features for accurate prediction. We conduct comprehensive experiments to evaluate a number of variants of our model on three important DCR tasks, i.e., monocular depth estimation, single-image height estimation, and density map estimation for crowd counting. Experiments demonstrate that our method achieves new state-of-the-art performance in both qualitative and quantitative evaluation on the NYU-D V2 and KITTI for monocular depth estimation, the challenging Urban Semantic 3D (US3D) for satellite height estimation, and four challenging benchmarks for crowd counting. These results demonstrate that the proposed LAPNet is a universal and effective architecture for DCR problems.

DCPNet: A Densely Connected Pyramid Network for Monocular Depth Estimation

Monocular Depth Estimation Based on Multi-Scale Graph Convolution Networks

Pyramid Feature Attention Network for Monocular Depth Prediction

Monocular image depth estimation using dilated convolution and spatial pyramid polling structure

DCU-NET: Self-supervised Monocular Depth Estimation Based on Densely Connected U-shaped Convolutional Neural Networks.

Mixed-Scale Unet Based on Dense Atrous Pyramid for Monocular Depth Estimation

CADNet: Context-aggregated DCPPM Monocular Depth Estimation Network

DMPNet: densely connected multi-scale pyramid networks for crowd counting

Structure-Aware Residual Pyramid Network for Monocular Depth Estimation

A Cnn-Based Depth Estimation Approach With Multi-Scale Sub-Pixel Convolutions And A Smoothness Constraint

PADENet: an Efficient and Robust Panoramic Monocular Depth Estimation Network for Outdoor Scenes.

Bi-Directional Pyramid Network for Edge Detection

Laplacian Pyramid Neural Network for Dense Continuous-Value Regression for Complex Scenes

Monocular Depth Estimation Based on Dilated Convolutions and Feature Fusion

Deep Neighbor Layer Aggregation for Lightweight Self-Supervised Monocular Depth Estimation

Monocular Depth Estimation Using a Laplacian Image Pyramid with Local Planar Guidance Layers

Promoting Monocular Depth Estimation by Multi-Scale Residual Laplacian Pyramid Fusion

PCTDepth: Exploiting Parallel CNNs and Transformer via Dual Attention for Monocular Depth Estimation

Pyramid Scale Network for Crowd Counting

Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detection

Dense Feature Pyramid Deep Completion Network