Abstract:Despite of the promising advancements in the last decade, the majority of scanning electron microscope (SEM)-based nanomanipulation tasks remain manually performed. Even in automated tasks, human intervention is required, at least during the task preparatory stage, where both the object of interest and robot end-effector are adequately enclosed in the field of view (FOV) of SEM at moderate magnification. This paper proposes a fully automated visual servo control method for workspace navigation of nanorobot end-effector that actively maintains the end-effector position offset from the center of FOV during passive working scene zooming and translation operations. We also propose using the scaling image Jacobian matrix theory to adaptively establish the hand-eye relationship of the nanorobotic system at uncalibrated magnifications, without the need for hardware regulation. This proposed method for workspace navigation is applicable to almost all commercial nanomanipulation systems. To the authors’ best knowledge, there has been no dedicated research on this problem in the literature. Experiments show that the proposed method significantly improves workspace navigation efficiency by about two-thirds, even for a skilled operator. Note to Practitioners—Workspace navigation refers to the process of moving the FOV to visually enclose the object or feature of interest at a moderate magnification, which is prerequisite for initializing either an automated or manual nanomanipulation task. This process involves consecutive zooming of the SEM in and out, as well as translating the sample stage, which can cause the end-effector to move out of the FOV. Therefore, it is necessary to move the robot end-effector with visual assistance along workspace navigation to avoid unexpected collisions. Typically, skilled operators perform this process manually in almost all nanomanipulation tasks, which is tedious and time-consuming. Therefore, developing an automated visual servo control method for workspace navigation of end-effector will significantly contribute to the nanomanipulation community.

SEM Image-Based 3-D Nanomanipulation Information Extraction and Closed-Loop Probe Control

Sensor-Based Control Using an Image Point and Distance Features for Rivet-in-Hole Insertion.

Mechatronic Development and Vision Feedback Control of a Nanorobotics Manipulation System inside SEM for Nanodevice Assembly

Visual Servo Control for Workspace Navigation of Nanorobot End-Effector Inside SEM

Recent Advances in Nanorobotic Manipulation Inside Scanning Electron Microscopes

Hybrid vision control apply on automatic pneumatic micromanipulation system

Automated Manipulation of Micro-Nano Objects with SPM by Using L1 Adaptive Controller

Design and Control of the 3 Axes Pneumatic Servo Micromanipulator for the Biological Technology

Automatic 3D Reconstruction of SEM Images Based on Nano-robotic Manipulation and Epipolar Plane Images.

Automatic Drift Compensation Using Phase Correlation Method for Nanomanipulation

Performing Probe Experiments in the Sem

Automated Nanomanipulation with Afm by Using L-1 Adaptive Controller

Nanorobotic System for Precise in Situ Three-Dimensional Manufacture of Helical Microstructures

Atomic Force Microscope-Based Nanomanipulation with Drift Compensation

Visual Tracking With Motion Distortion Removal for Nanomanipulation Inside SEM

Scanning Probe Microscope Controlled by Single Personal Computer with Linux

Simulation of Optical Nano-Manipulation with Metallic Single and Dual Probe Irradiated by Polarized Near-Field Laser

A Study on the Control Method of 6-DOF Magnetic Levitation System Using Non-Contact Position Sensors

A Compliant Nano-manipulator-based Scanning Probe Lithography System

A 2-DOF nano-positioning scanner with novel compound decoupling-guiding mechanism

Task Space Motion Control for AFM-Based Nanorobot Using Optimal and Ultralimit Archimedean Spiral Local Scan