Abstract:Indoor scenes are usually characterized by scattered objects and their relationships, which turns the indoor scene classification task into a challenging computer vision task. Despite the significant performance boost in classification tasks achieved in recent years, provided by the use of deep-learning-based methods, limitations such as inter-category ambiguity and intra-category variation have been holding back their performance. To overcome such issues, gathering semantic information has been shown to be a promising source of information towards a more complete and discriminative feature representation of indoor scenes. Therefore, the work described in this paper uses both semantic information, obtained from object detection, and semantic segmentation techniques. While object detection techniques provide the 2D location of objects allowing to obtain spatial distributions between objects, semantic segmentation techniques provide pixel-level information that allows to obtain, at a pixel-level, a spatial distribution and shape-related features of the segmentation categories. Hence, a novel approach that uses a semantic segmentation mask to provide Hu-moments-based segmentation categories' shape characterization, designated by Segmentation-based Hu-Moments Features (SHMFs), is proposed. Moreover, a three-main-branch network, designated by GOS$^2$F$^2$App, that exploits deep-learning-based global features, object-based features, and semantic segmentation-based features is also proposed. GOS$^2$F$^2$App was evaluated in two indoor scene benchmark datasets: SUN RGB-D and NYU Depth V2, where, to the best of our knowledge, state-of-the-art results were achieved on both datasets, which present evidences of the effectiveness of the proposed approach.

Indoor Scene Classification Based on Mid-Level Features

A Hybrid Image Representation for Indoor Scene Classification

High-level attributes modeling for indoor scenes classification

Indoor image representation by high-level semantic features

A Review of Indoor-Outdoor Scene Classification

A hierarchical inferential method for indoor scene classification

Point Cloud Instance Segmentation of Indoor Scenes Using Learned Pairwise Patch Relations

A Discriminative Representation of Convolutional Features for Indoor Scene Recognition

Recognition of Indoor Scenes Using 3-D Scene Graphs

Local Quality Assessment of Point Clouds for Indoor Mobile Mapping

Indoor Scene Recognition in 3D

Indoor Scene Recognition from RGB-D Images by Learning Scene Bases

Indoor Scene Understanding Based on Manhattan and Non-Manhattan Projection of Spatial Right-Angles.

Exploiting Object-based and Segmentation-based Semantic Features for Deep Learning-based Indoor Scene Classification

Scene classification using a multi-resolution bag-of-features model

Scene Classification Using Low-Level Feature and Intermediate Feature

OBJECT DETECTION AND CLASSIFICATION FROM CLUTTERED LARGE-SCALE INDOOR SCENE VIA ANCHOR-BASED GRAPH

3D Indoor Environment Modeling and Detection of Moving Object and Scene Understanding

MMAIndoor: Patched MLP and Multi-dimensional Cross Attention Based Self-supervised Indoor Depth Estimation

Indoor scene recognition through object detection

Automatic Semantic Modeling of Indoor Scenes from Low-Quality RGB-D Data Using Contextual Information