A Novel Edge-Inspired Depth Quality Evaluation Network for RGB-D Salient Object Detection
Kun Xu,Jichang Guo
DOI: https://doi.org/10.1007/s10723-023-09674-x
2023-07-06
Journal of Grid Computing
Abstract:Recently, the pair of RGB images and depth images, which is denoted as RGB-D images, are introduced to improve the performances of salient object detection, because one of the pairs may stand out at least in one modality. However, most existing methods still suffer from dilemma. Firstly, the edges of predicted salient object are blurry. Secondly, how to integrate RGB images and depth images effectively still needs be explored. Thirdly, the quality of depth images have a strong impact on the performance of salient object detection so that the selection of depth images is worthy of exploring. To address above problems, we propose an edge-inspired depth quality evaluation network, which evaluates the quality of the depth images based on the edge information. More specifically, the depth quality evaluation module includes two parts: the depth decider and the depth aggregator. The former judges the quality of the depth images while the latter produces the weighted depth features. Then, the edge detection module is proposed to predict edges of salient object and produce edge features. In addition, features from VGG backbone, edge features and depth features are integrated by multi-modality feature fusion module, which is composed of a series of hybrid dilated convolutions. Moreover, the integrated features are fused by three-feature interactive module and double-feature interactive module to predict the final salient map. Our experiments on four RGB-D datasets demonstrate that our proposed method outperforms previous high-performance RGB-D salient object detection.
computer science, information systems, theory & methods