Abstract:Introduction: During the last few years, a heightened interest has been shown in classifying scene images depicting diverse robotic environments. The surge in interest can be attributed to significant improvements in visual sensor technology, which has enhanced image analysis capabilities. Methods: Advances in vision technology have a major impact on the areas of multiple object detection and scene understanding. These tasks are an integral part of a variety of technologies, including integrating scenes in augmented reality, facilitating robot navigation, enabling autonomous driving systems, and improving applications in tourist information. Despite significant strides in visual interpretation, numerous challenges persist, encompassing semantic understanding, occlusion, orientation, insufficient availability of labeled data, uneven illumination including shadows and lighting, variation in direction, and object size and changing background. To overcome these challenges, we proposed an innovative scene recognition framework, which proved to be highly effective and yielded remarkable results. First, we perform preprocessing using kernel convolution on scene data. Second, we perform semantic segmentation using UNet segmentation. Then, we extract features from these segmented data using discrete wavelet transform (DWT), Sobel and Laplacian, and textual (local binary pattern analysis). To recognize the object, we have used deep belief network and then find the object-to-object relation. Finally, AlexNet is used to assign the relevant labels to the scene based on recognized objects in the image. Results: The performance of the proposed system was validated using three standard datasets: PASCALVOC-12, Cityscapes, and Caltech 101. The accuracy attained on the PASCALVOC-12 dataset exceeds 96% while achieving a rate of 95.90% on the Cityscapes dataset. Discussion: Furthermore, the model demonstrates a commendable accuracy of 92.2% on the Caltech 101 dataset. This model showcases noteworthy advancements beyond the capabilities of current models.

Scene Recognition and Object Detection in a Unified Convolutional Neural Network on a Mobile Manipulator

ObjectFusion: an Object Detection and Segmentation Framework with RGB-D SLAM and Convolutional Neural Networks

Automatic Object Searching and Behavior Learning for Mobile Robots in Unstructured Environment by Deep Belief Networks.

Multi-Channel Convolutional Neural Network Based 3D Object Detection for Indoor Robot Environmental Perception

IRDC-Net: Lightweight Semantic Segmentation Network Based on Monocular Camera for Mobile Robot Navigation

Convolution Neural Network Based Human and Robot Collaboration for 3D Scene Perception

Multimodal deep learning for robust RGB-D object recognition

A Grasping CNN with Image Segmentation for Mobile Manipulating Robot

Remote intelligent perception system for multi-object detection

Simultaneous Multiple Object Detection and Pose Estimation using 3D Model Infusion with Monocular Vision

Understand Scene Categories by Objects: A Semantic Regularized Scene Classifier Using Convolutional Neural Networks.

Scene Recognition with Omnidirectional Vision for Topological Map Using Lightweight Adaptive Descriptors

Unifying convolution and transformer: a dual stage network equipped with cross-interactive multi-modal feature fusion and edge guidance for RGB-D salient object detection

Robotic Grasp Detection Method Based on Lightweight Feature Fusion Convolutional Neural Network

SDAPNet: End-to-End Multi-task Simultaneous Detection and Prediction Network.

Visual Manipulation Relationship Network for Autonomous Robotics

Multi-view Incremental Segmentation of 3D Point Clouds for Mobile Robots

A YOLO-GGCNN based grasping framework for mobile robots in unknown environments

An End-to-End Trainable Multi-Column CNN for Scene Recognition in Extremely Changing Environment

MonoMM: A Multi-scale Mamba-Enhanced Network for Real-time Monocular 3D Object Detection