Abstract:Construction robots have conquered the indoor and outdoor building decoration fields, aiming to automatically accomplish the manually performed tasks efficiently, thus reducing the dependence on human labor and saving time. Fixing the putty on walls is a labor-intensive and slow process, so incorporating construction robots into such a task is significant. While fixing the putty on walls, putty bulges emerge in various positions within the working space. To successfully realize this task, the robots must autonomously determine the putty bulge positions within the working area. Integrating visual attention mechanisms into convolutional neural networks has been proven to enhance their feature extraction capability. We proposed a deep learning model for regressing the putty bulge terminal points spatial positions. Two novel visual attention modules were proposed and precisely integrated into the model's backbone. For enhancing the extraction of semantic features and better formulating the channel dependency, a residual channel attention module (RCAM) was proposed. A lightweight spatial attention module (LSAM) was proposed to maximize the weights of significant spatial information so the model can localize the bulge terminal points more accurately. The features generated by the attention modules at multiple scales were fused by a proposed attention feature fusion module (AFFM) to accomplish the putty bulge terminal points regression task. Our experiments proved that fusing the hierarchical feature maps extracted by the proposed attention modules is significantly better than the traditional learning scheme that directly propagates the feature maps throughout the network architecture.

Development of a Robot System for Applying Putty on Plastered Walls

Puttybot: A sensorized robot for autonomous putty plastering

Robotized Interior Finishing Operations with Visual Feedback

3D SLAM Applied to an Autonomous Interior Finishing Robot

Perception of Demonstration for Automatic Programing of Robotic Assembly: Framework, Algorithm, and Validation

Intelligent spraying robot for building walls with mobility and perception

Building information modeling‐based 3D reconstruction and coverage planning enabled automatic painting of interior walls using a novel painting robot in construction

Development of an Autonomous Sanding Robot with Structured-Light Technology

RoboPainter -- a conceptual towards robotized interior finishes

A Robotic Semantic Grasping Method for Pick-and-place Tasks

Task Sensing and Adaptive Control for Mobile Manipulator in Indoor Painting Application

Global Vision-Based Impedance Control for Robotic Wall Polishing.

Develop feedback robot planning method for 3D surface inspection

A Robotic Solution for Precision Smoothing and Roughening of Precast Concrete Surfaces: Design and Experimental Validation

End-To-End Real-Time Visual Perception Framework for Construction Automation

A Remote Control Painting System for Exterior Walls of High-Rise Buildings through Robotic System

Automatic surface roughing with 3D machine vision and cooperative robot control

Development of a SCARA robot arm for palletizing applications based on computer vision

WallNet: Hierarchical Visual Attention-Based Model for Putty Bulge Terminal Points Detection

Design and Reachability Analysis of a Rigid–Flexible Robot for Interior Wall Spraying of Large Oil Cabins

Embedded Systems and Computer Vision Techniques utilized in Spray Painting Robots: A Review