Implementation of Intelligent Indoor Service Robot Based on ROS and Deep Learning

Mingyang Liu,Min Chen,Zhigang Wu,Bin Zhong,Wangfen Deng

DOI: https://doi.org/10.3390/machines12040256

IF: 2.899

2024-04-11

Machines

Abstract:When faced with challenges such as adapting to dynamic environments and handling ambiguous identification, indoor service robots encounter manifold difficulties. This paper aims to address this issue by proposing the design of a service robot equipped with precise small-object recognition, autonomous path planning, and obstacle-avoidance capabilities. We conducted in-depth research on the suitability of three SLAM algorithms (GMapping, Hector-SLAM, and Cartographer) in indoor environments and explored their performance disparities. Upon this foundation, we have elected to utilize the STM32F407VET6 and Nvidia Jetson Nano B01 as our processing controllers. For the program design on the STM32 side, we are employing the FreeRTOS operating system, while for the Jetson Nano side, we are employing ROS (Robot Operating System) for program design. The robot employs a differential drive chassis, enabling successful autonomous path planning and obstacle-avoidance maneuvers. Within indoor environments, we utilized the YOLOv3 algorithm for target detection, achieving precise target identification. Through a series of simulations and real-world experiments, we validated the performance and feasibility of the robot, including mapping, navigation, and target detection functionalities. Experimental results demonstrate the robot's outstanding performance and accuracy in indoor environments, offering users efficient service and presenting new avenues and methodologies for the development of indoor service robots.

engineering, mechanical, electrical & electronic

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to achieve accurate small - object recognition, autonomous path planning, and obstacle - avoidance capabilities for service robots in dynamic indoor environments. Specifically, the paper focuses on the following aspects:

1. **Accurate small - object recognition**: In indoor environments, especially in homes and offices, service robots need to be able to accurately recognize small objects, such as fruits and tableware. This poses a challenge to target detection because these objects are usually small and irregularly shaped, increasing the difficulty of recognition.

2. **Autonomous path planning**: Service robots need to be able to autonomously plan paths in complex indoor environments in order to complete tasks efficiently. This requires the robot to have a high degree of autonomous navigation ability and be able to adjust the path in real - time according to environmental changes.

3. **Obstacle - avoidance ability**: In dynamic environments, the robot needs to be able to detect and avoid obstacles in a timely manner to ensure safe and efficient task execution. This requires the robot to have efficient sensing and decision - making abilities.

To address the above challenges, the paper proposes a service robot design scheme based on ROS (Robot Operating System) and deep learning. Specific methods include:

- **SLAM algorithm analysis**: Conduct in - depth research on three commonly used SLAM algorithms (GMapping, Hector - SLAM, and Cartographer), evaluate their applicability and performance differences in indoor environments, and select the most suitable algorithm for robot localization and mapping.

- **Hardware and software implementation**: Use STM32F407VET6 and Nvidia Jetson Nano B01 as the main control units. The FreeRTOS operating system is adopted on the STM32 side, and ROS is used for program design on the Jetson Nano side. Autonomous path planning and obstacle - avoidance operations are achieved through a differential - drive chassis.

- **Visual recognition**: Utilize the YOLOv3 algorithm for target detection to achieve accurate target recognition.

Through a series of simulations and practical experiments, the performance and feasibility of the robot are verified, demonstrating its excellent performance and high precision in indoor environments, providing efficient services for users, and providing new ideas and methods for the development of indoor service robots.