Abstract:Due to their imaging mechanisms and techniques, some depth images inevitably have low visual qualities or have some inconsistent foregrounds with their corresponding RGB images. Directly using such depth images will deteriorate the performance of RGB-D SOD. In view of this, a novel RGB-D salient object detection model is presented, which follows the principle of calibration-then-fusion to effectively suppress the influence of such two types of depth images on final saliency prediction. Specifically, the proposed model is composed of two stages, i.e., an image generation stage and a saliency reasoning stage. The former generates high-quality and foreground-consistent pseudo depth images via an image generation network. While the latter first calibrates the original depth information with the aid of those newly generated pseudo depth images and then performs cross-modal feature fusion for the final saliency reasoning. Especially, in the first stage, a Two-steps Sample Selection (TSS) strategy is employed to select such reliable depth images from the original RGB-D image pairs as supervision information to optimize the image generation network. Afterwards, in the second stage, a Feature Calibrating and Fusing Network (FCFNet) is proposed to achieve the calibration-then-fusion of cross-modal information for the final saliency prediction, which is achieved by a Depth Feature Calibration (DFC) module, a Shallow-level Feature Injection (SFI) module and a Multi-modal Multi-scale Fusion (MMF) module. Moreover, a loss function, i.e., Region Consistency Aware (RCA) loss, is presented as an auxiliary loss for FCFNet to facilitate the completeness of salient objects together with the reduction of background interference by considering the local regional consistency in the saliency maps. Experiments on six benchmark datasets demonstrate the superiorities of our proposed RGB-D SOD model over some state-of-the-arts.

LED: LOCALIZATION-QUALITY ESTIMATION EMBEDDED DETECTOR

A Lightweight SE-YOLOv3 Network for Multi-Scale Object Detection in Remote Sensing Imagery.

Depth Cue Enhancement and Guidance Network for RGB-D Salient Object Detection

LEDet: A Single-Shot Real-Time Object Detector Based on Low-Light Image Enhancement

LEDet: Localization Estimation Detector with Data Augmentation for Ship Detection Based on Unmanned Surface Vehicle

Vehicular Mini-LED backlight display inspection based on residual global context mechanism

Efficient Micro-LED defect detection based on microscopic vision and deep learning

An LED Detection and Recognition Method Based on Deep Learning in Vehicle Optical Camera Communication

EMNet: Edge-guided multi-level network for salient object detection in low-light images

FDLR-Net: A feature decoupling and localization refinement network for object detection in remote sensing images

Being Aware of Localization Accuracy by Generating Predicted-IoU-Guided Quality Scores

Rich Features and Precise Localization with Region Proposal Network for Object Detection.

Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection

Feature Calibrating and Fusing Network for RGB-D Salient Object Detection

Robust one-stage object detection with location-aware classifiers

Stereo RGB and Deeper LIDAR Based Network for 3D Object Detection

Lightweight feature point detection network with channel enhancement

Ge-Rm: Efficient Global Estimation And Refined Model For Salient Object Detection Via Elaborate Receptive Fields

Generalized Focal Loss V2: Learning Reliable Localization Quality Estimation for Dense Object Detection

LED Can Backscatter: Multi-Modal Based 3D Localization Via LED-Tag