Abstract:Visual saliency refers to the human's ability to quickly focus on important parts of their visual field, which is a crucial aspect of image processing, particularly in fields like medical imaging and robotics. Understanding and simulating this mechanism is crucial for solving complex visual problems. In this paper, we propose a salient object detection method based on boundary enhancement, which is applicable to both 2D and 3D sensors data. To address the problem of large-scale variation of salient objects, our method introduces a multi-level feature aggregation module that enhances the expressive ability of fixed-resolution features by utilizing adjacent features to complement each other. Additionally, we propose a multi-scale information extraction module to capture local contextual information at different scales for back-propagated level-by-level features, which allows for better measurement of the composition of the feature map after back-fusion. To tackle the low confidence issue of boundary pixels, we also introduce a boundary extraction module to extract the boundary information of salient regions. This information is then fused with salient target information to further refine the saliency prediction results. During the training process, our method uses a mixed loss function to constrain the model training from two levels: pixels and images. The experimental results demonstrate that our salient target detection method based on boundary enhancement shows good detection effects on targets of different scales, multi-targets, linear targets, and targets in complex scenes. We compare our method with the best method in four conventional datasets and achieve an average improvement of 6.2% on the mean absolute error (MAE) indicators. Overall, our approach shows promise for improving the accuracy and efficiency of salient object detection in a variety of settings, including those involving 2D/3D semantic analysis and reconstruction/inpainting of image/video/point cloud data.

Salient Object Detection on Large-Scale Video Data

Multilevel Spatial-Temporal Feature Aggregation for Video Object Detection

Video-based Salient Object Detection Via Spatio-Temporal Difference and Coherence

Video Salient Object Detection via Fully Convolutional Networks

Video Saliency Detection Using Object Proposals

Robust Semantic Concept Detection in Large Video Collections

Learning Spatial-Semantic Features for Robust Video Object Segmentation

Salient Object Detection and Segmentation

VIREO-374 : LSCOM Semantic Concept Detectors Using Local Keypoint Features

Overview of deep-learning based methods for salient object detection in videos

Revealing Event Saliency in Unconstrained Video Collection

Video Salient Object Detection via Contrastive Features and Attention Modules

Learning to Detect A Salient Object

Saliency-Aware Video Object Segmentation.

Salient object detection by aggregating contextual information

Multimodal Salient Objects: General Building Blocks Of Semantic Video Concepts

Predicting Salient Object Via Multi-Level Features

Robust Video Object Cosegmentation.

A Salient Object Detection Method Based on Boundary Enhancement

Video diver: generic video indexing with diverse features.

Video Concept Detection Using Support Vector Machines - TRECVID 2007 Evaluations