Abstract:Accurately classifying sceneries with different spatial configurations is an indispensable technique in computer vision and intelligent systems, for example, scene parsing, robot motion planning, and autonomous driving. Remarkable performance has been achieved by the deep recognition models in the past decade. As far as we know, however, these deep architectures are incapable of explicitly encoding the human visual perception, that is, the sequence of gaze movements and the subsequent cognitive processes. In this article, a biologically inspired deep model is proposed for scene classification, where the human gaze behaviors are robustly discovered and represented by a unified deep active learning (UDAL) framework. More specifically, to characterize objects' components with varied sizes, an objectness measure is employed to decompose each scenery into a set of semantically aware object patches. To represent each region at a low level, a local-global feature fusion scheme is developed which optimally integrates multimodal features by automatically calculating each feature's weight. To mimic the human visual perception of various sceneries, we develop the UDAL that hierarchically represents the human gaze behavior by recognizing semantically important regions within the scenery. Importantly, UDAL combines the semantically salient region detection and the deep gaze shifting path (GSP) representation learning into a principled framework, where only the partial semantic tags are required. Meanwhile, by incorporating the sparsity penalty, the contaminated/redundant low-level regional features can be intelligently avoided. Finally, the learned deep GSP features from the entire scene images are integrated to form an image kernel machine, which is subsequently fed into a kernel SVM to classify different sceneries. Experimental evaluations on six well-known scenery sets (including remote sensing images) have shown the competitiveness of our approach.

Biologically Inspired Features for Scene Classification in Video Surveillance

Human Detection Based on Head and Shoulder Feature in Intelligent Surveillance System

Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing

Bioinspired Scene Classification by Deep Active Learning With Remote Sensing Applications

Automatic And Robust Classification Of Independent Motions In Video Sequences

Local Attention Sequence Model for Video Object Detection

An Integrated Background Model for Video Surveillance Based on Primal Sketch and 3D Scene Geometry

Real-time Object Classification in Video Surveillance Based on Appearance Learning

Video Surveillance Object Recognition Based on Shape and Color Features

A Biologically Inspired Appearance Model for Robust Visual Tracking.

A biologically inspired computational model for image saliency detection.

Enhanced Biologically Inspired Model for Object Recognition

Security Event Recognition for Visual Surveillance

A survey on scene image classification

Enhancing Unsupervised Video Representation Learning by Decoupling the Scene and the Motion

Face Recognition Using Early Biologically Inspired Features

Pose-oriented scene-adaptive matching for abnormal event detection

Anatomy of a Multicamera Video Surveillance System

Modeling Spatial-Temporal Clues in a Hybrid Deep Learning Framework for Video Classification

Scene Aligned Pooling For Complex Video Recognition

A real time crime scene intelligent video surveillance systems in violence detection framework using deep learning techniques