Abstract:Visual scene recognition is an indispensable part of automatic localization and navigation. In the same scene, the appearance and viewpoint may be changed greatly, which is the largest challenge for some advanced unmanned systems,e.g. robot,vehicle and UAV,etc., to identify scenes where they have visited. Traditional methods have been subjected to hand-made feature-based paradigms for a long time, mainly relying on the prior knowledge of the designer, and are not sufficiently robust to extreme changing scenes. In this paper, we cope with scene recognition with automatically learning the representation of features from big image samples. Firstly, we propose a novel approach for scene recognition via training a slight-weight convolutional neural network (CNN) that overall has less complex and more efficient network architecture, and is trainable in the manner of end-to-end. The proposed approach uses the deep-leaning features of self-selection combining with light CNN process to perform high semantic understanding of visual scenes. Secondly, we propose to employ a salient region-based technology to extract the local feature representation of a specific scene region directly from the convolution layer based on self-selection mechanism, and each layer performs a linear operation with end-to-end manner. Furthermore, we also utilize probability statistics to calculate the total similarity of several regions in one scene to other regions, and finally rank the similarity scores to select the correct scene. We have conducted a lot of experiments to evaluate the results of performance by comparing four methods (namely, our proposed and other three well known and advanced methods). Experimental results show that the proposed method is more robust and accurate than other three well-known methods in extremely harsh environments (e. g. weak light and strong blur).

A Novel Attention-based Neural Network for Video Scene Classification in Complex Background

Deep Neural Network with Attention Model for Scene Text Recognition.

Deep Hierarchical Attention Network for Video Description

Look and Listen: A Multi-modality Late Fusion Approach to Scene Classification for Autonomous Machines

Audio-visual scene recognition using attention-based graph convolutional model

Frame Attention Mechanism and Transfer Learning Network for Classification on Motion Video

Attention in Attention: Modeling Context Correlation for Efficient Video Classification

A novel attention model and its application in video analysis

Attention in Attention: Modeling Context Correlation for Efficient Video Classification

Sequential Attention Mechanism for Weakly Supervised Video Anomaly Detection

A New Architecture of Neural Network for Fine-Grained Video Analysis Based on Visual Attention

Attention and Language Ensemble for Scene Text Recognition with Convolutional Sequence Modeling.

Self-Selection Salient Region-Based Scene Recognition Using Slight-Weight Convolutional Neural Network

A novel keyframe extraction method for video classification using deep neural networks

Multi-Modal Attention Mechanisms In Lstm And Its Application To Acoustic Scene Classification

Human Behavior Recognition Based on Attention Mechanism and Bottleneck Residual Dual-Path Spatiotemporal Graph Convolutional Network

Exploring Inter-feature and Inter-class Relationships with Deep Neural Networks for Video Classification

Scene Classification with Recurrent Attention of VHR Remote Sensing Images

Video Anomaly Detection Based on Attention Mechanism

Neural Attention Models for Sequence Classification: Analysis and Application to Key Term Extraction and Dialogue Act Detection

Attentional Graph Convolutional Network for Structure-aware Audio-Visual Scene Classification