Abstract:High-precision surface defect detection in manufacturing is essential for ensuring quality control. Laser triangulation profilometric sensors are key to this process, providing detailed and accurate surface measurements over a line. To achieve a complete and precise surface scan, accurate relative motion between the sensor and the workpiece is required. It is crucial to control the sensor pose to maintain optimal distance and relative orientation to the surface. It is also important to ensure uniform profile distribution throughout the scanning process. This paper presents a novel Reinforcement Learning (RL) based approach to optimize robot inspection trajectories for profilometric sensors. Building upon the Boustrophedon scanning method, our technique dynamically adjusts the sensor position and tilt to maintain optimal orientation and distance from the surface, while also ensuring a consistent profile distance for uniform and high-quality scanning. Utilizing a simulated environment based on the CAD model of the part, we replicate real-world scanning conditions, including sensor noise and surface irregularities. This simulation-based approach enables offline trajectory planning based on CAD models. Key contributions include the modeling of the state space, action space, and reward function, specifically designed for inspection applications using profilometric sensors. We use Proximal Policy Optimization (PPO) algorithm to efficiently train the RL agent, demonstrating its capability to optimize inspection trajectories with profilometric sensors. To validate our approach, we conducted several experiments where a model trained on a specific training piece was tested on various parts in simulation. Also, we conducted a real-world experiment by executing the optimized trajectory, generated offline from a CAD model, to inspect a part using a UR3e robotic arm model.

Environment-Adaptable Printed-Circuit Board Positioning Using Deep Reinforcement Learning

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Based Ground-Via Placement Optimization for EMI Mitigation

Visual Spatial Attention and Proprioceptive Data-Driven Reinforcement Learning for Robust Peg-in-Hole Task Under Variable Conditions

Reinforcement Learning for Collaborative Robots Pick-and-Place Applications: A Case Study

Pin Assignment Optimization of BGA Packages for EMI Mitigation Using Deep Reinforcement Learning

Robot Control in Human Environment Using Deep Reinforcement Learning and Convolutional Neural Network.

Dynamic Path Planning of Unknown Environment Based on Deep Reinforcement Learning

An Automatic PCB Imposition Method Based on Reinforcement Learning

Learning positioning policies for mobile manipulation operations with deep reinforcement learning

DeepTH: Chip Placement with Deep Reinforcement Learning Using a Three-Head Policy Network

Prehensile and Non-Prehensile Robotic Pick-and-Place of Objects in Clutter using Deep Reinforcement Learning

End-to-end deep learning framework for printed circuit board manufacturing defect classification

Variable Compliance Control for Robotic Peg-in-Hole Assembly: A Deep Reinforcement Learning Approach

Adaptive Deep Reinforcement Learning for Non-Stationary Environments

Deep-Learning Based Robotic Manipulation of Flexible PCBs.

Reinforced Labels: Multi-Agent Deep Reinforcement Learning for Point-Feature Label Placement

Active search and coverage using point-cloud reinforcement learning

Reinforcement Learning Approach to Optimizing Profilometric Sensor Trajectories for Surface Inspection

Multi-environment lifelong deep reinforcement learning for medical imaging

A real-time defect detection in printed circuit boards applying deep learning