Abstract:Accurately classifying sceneries with different spatial configurations is an indispensable technique in computer vision and intelligent systems, for example, scene parsing, robot motion planning, and autonomous driving. Remarkable performance has been achieved by the deep recognition models in the past decade. As far as we know, however, these deep architectures are incapable of explicitly encoding the human visual perception, that is, the sequence of gaze movements and the subsequent cognitive processes. In this article, a biologically inspired deep model is proposed for scene classification, where the human gaze behaviors are robustly discovered and represented by a unified deep active learning (UDAL) framework. More specifically, to characterize objects' components with varied sizes, an objectness measure is employed to decompose each scenery into a set of semantically aware object patches. To represent each region at a low level, a local-global feature fusion scheme is developed which optimally integrates multimodal features by automatically calculating each feature's weight. To mimic the human visual perception of various sceneries, we develop the UDAL that hierarchically represents the human gaze behavior by recognizing semantically important regions within the scenery. Importantly, UDAL combines the semantically salient region detection and the deep gaze shifting path (GSP) representation learning into a principled framework, where only the partial semantic tags are required. Meanwhile, by incorporating the sparsity penalty, the contaminated/redundant low-level regional features can be intelligently avoided. Finally, the learned deep GSP features from the entire scene images are integrated to form an image kernel machine, which is subsequently fed into a kernel SVM to classify different sceneries. Experimental evaluations on six well-known scenery sets (including remote sensing images) have shown the competitiveness of our approach.

Introduction to the Special Section on Contextual Object Analysis in Complex Scenes

Learning Visual Context for Group Activity Recognition.

Guest Editorial Introduction to the Special Section on Intelligent Visual Content Analysis and Understanding

DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization

Putting visual object recognition in context

Object2Scene: Putting Objects in Context for Open-Vocabulary 3D Detection

Context understanding in computer vision: A survey

OCNet: Object Context Network for Scene Parsing

Advances in Deep Concealed Scene Understanding

Research on Complex Scene Recognition Based on Semantic Segmentation

Salient Object Detection with Complex Scene Based on Cognitive Neuroscience

The role of context in object recognition

Exploiting Contextual Uncertainty of Visual Data for Efficient Training of Deep Models

Scene Categorization by Deeply Learning Gaze Behavior in a Semisupervised Context

Exploring Person Context and Local Scene Context for Object Detection

A YOLO-Based Method for Head Detection in Complex Scenes

Video Scene Analysis: A Machine Learning Perspective

Design of visual communication based on deep learning approaches

Bioinspired Scene Classification by Deep Active Learning With Remote Sensing Applications

A survey on scene image classification

Scene recognition: A comprehensive survey