Abstract:In recent years, convolutional-neural-network based stereo matching methods have achieved significant gains compared to conventional methods in terms of both speed and accuracy. Current state-of-the-art disparity estimation algorithms require many parameters and large amounts of computational resources and are not suited for applications on edge devices. In this paper, we propose an end-to-end light-weight network (LWNet) for fast stereo matching, which consists of an efficient backbone with multi-scale feature fusion for feature extraction, a 3D U-Net aggregation architecture for disparity computation, and color guidance in a 2D convolutional neural network (CNN) for disparity refinement. We adopt MobileNetV2 as an efficient backbone in feature extraction. The channel attention module is applied to improve the representational capacity of features and multi-resolution information is adaptively incorporated into the cost volume via cross-scale connections. In addition, instead of using regular 3D convolutions, we utilize pseudo 3D convolutions in the 3D U-Net architecture to aggregate the cost volume for a better balance between computational cost and accuracy. Further, we introduce a left-right consistency check and color guidance and design a robust disparity refinement network with skip connections and dilated convolutions to capture global context information and further improve disparity-estimation accuracy with little computational cost and memory space. A depth-wise separable convolution is proposed to replace all the standard convolutions in the section of disparity refinement, which can decrease computational complexity and the number of parameters without significant accuracy reduction. Extensive experiments on Scene Flow, KITTI 2015, and KITTI 2012 benchmarks demonstrate that the proposed LWNet achieves competitive accuracy when compared with state-of-the-art stereo matching methods.

Asymmetric Stereo Color Transfer

Asymmetric Color Transfer with Consistent Modality Learning.

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

Continuous Digital Zoom with Cross Attention for Dual Camera System

AdaCM: Adaptive ColorMLP for Real-Time Universal Photo-realistic Style Transfer

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Robust Dual Images Super-Resolution.

Low-Light Color Imaging via Dual Camera Acquisition.

Low-Light Color Imaging Via Cross-Camera Synthesis.

AsymFormer: Asymmetrical Cross-Modal Representation Learning for Mobile Platform Real-Time RGB-D Semantic Segmentation

Cross-Camera Deep Colorization

Learning to Joint Remosaic and Denoise in Quad Bayer CFA via Universal Multi-scale Channel Attention Network.

Asymmetric Stereo High Dynamic Range Imaging with Smartphone Cameras

A Dual Camera System for High Spatiotemporal Resolution Video Acquisition

DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders

Single-Shot Face Anti-Spoofing for Dual Pixel Camera

Du2Net: Learning Depth Estimation from Dual-Cameras and Dual-Pixels

Color Agnostic Cross-Spectral Disparity Estimation

Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation

Hybrid High Dynamic Range Imaging fusing Neuromorphic and Conventional Images

A Light-Weight Network with Multi-Scale Features Fusion and Color Guidance for Stereo Matching