Abstract:In order to solve the problems of video saliency detection and poor fusion effect, a video saliency detection model and a fusion model are proposed. Video saliency detection is divided into spatial saliency detection and temporal saliency detection. In the spatial domain, inspired by the properties of visual cortex hierarchical perception and the Gestalt visual psychology, we propose a hierarchical saliency detection model with three-layer architecture for single frame image. The video single frame is simplified layer by layer, then the results are combined to form a whole consciousness vision object and become easier to deal with. At the bottom of the model, candidate saliency regions are formed by nonlinear simplification model of the characteristic image (dual color characteristic and luminance characteristic image), which is in accordance with the biological visual characteristic. In the middle of the model, the candidate regions with the strongest competitiveness are selected as the local salient regions according to the property of matrix minimum Fresenius- norm (F- norm). At the top level of the model, the local salient regions are integrated by the core theory of Gestalt visual psychology, and the spatial saliency map is obtained. In the time domain, based on the consistency assumption of a moving object in target location, motion range and direction, the optical flow points detected by Lucas-Kanade method are classified to eliminate the noise interference, then the motion saliency of moving object is measured by the motion amplitude. Finally, based on the difference between the visual sensitivity of dynamic and static information and the difference in visual sensitivity between color information and gray information, a general fusion model of time and spatial domain salient region is proposed. The saliency detection results of single frame image and video sequence frame image are represented by the gray color model and the Munsell color system respectively. Experimental results show that the proposed saliency detection method can suppress the background noise, solve the sparse pixels problem of a moving object, and can effectively detect the salient regions from the video. The proposed fusion model can display two kinds of saliency results simultaneously in a single picture of a complex scene. This model ensures that the detection results of images are so complicated that a chaotic situation will not appear.

A Saliency Detection Model Based on Multi-feature Fusion

Saliency Detection Algorithm Integrating Multiple Features of High and Low Level

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Salient Region Detection by Fusing Foreground and Background Cues Extracted from Single Image

Saliency detection based on integrated features

Multi-Path Feature Fusion Network for Saliency Detection.

Saliency detection based on self-adaptive multiple feature fusion for remote sensing images

Video Saliency Detection Algorithm Based on Biological Visual Feature and Visual Psychology Theory

Deep Fusion Based Video Saliency Detection

Feature fusing and objectness enhanced approach of saliency detection

Salient Detection Via the Fusion of Background-Based and Multiscale Frequency-Domain Features

Assessment of Feature Fusion Strategies in Visual Attention Mechanism for Saliency Detection.

A Saliency Detection Model Combined Local And Global Features

Saliency Optimization Fused Background Feature with Frequency Domain Features

A Multiple Features Distance Preserving (MFDP) Model for Saliency Detection

Saliency Detection Via Integrating Deep Learning Architecture and Low-Level Features

Salient Object Detection Algorithm Based on Multi-Feature Fusion*

A Novel Visual Saliency Analysis Model Based on Dynamic Multiple Feature Combination Strategy

Multi-scale Feature Fusion for 3D Saliency Detection

RGB-D Visual Saliency Detection Algorithm Based on Information Guided and Multimodal Feature Fusion

Enriched Feature Representation and Combination for Deep Saliency Detection