Abstract:Three-dimensional (3D) morphology of microparts has an important influence on performance of microassembly system that mainly assembles microparts in millimetre and micron scale. Because 3D morphology of microparts cannot be accurately obtained by conventional microscopic vision system, a depth estimation method of surface of micropart in microassembly space based on microscopic vision tomographic scanning (MVTS) images is proposed in this paper. The proposed method uses the positions of pixels with the largest focus values in MVTS image to construct the isodepth contours of surface of micropart and obtains the depth values of micropart's surface at the positions of MVTS by assigning depth values to corresponding isodepth contours. The MVTS images are obtained by MVTS and pixels with the largest focus values in MVTS image are obtained by focus measurement of MVTS images of micropart in microassembly space. On these bases, 3D spatial interpolation method is applied to map depth value of space between adjacent isodepth contours and to obtain depth values of all surface of micropart. Simulation experiments are carried out to verify the proposed method by generating simulated MVTS image array from two simulation objects, and the influence parameters of the proposed method are analysed. In established experimental setup of microassembly that can realise MVTS, experimental verification for the proposed depth estimation method are carried out by using cone cavity and end jaws of microgripper. 3D morphologies of depth maps of cone cavity and end jaws of microgripper are registered with their respective CAD models using iterative nearest point registration algorithm to quantify accuracy of depth estimation. The research results show that 3D morphology of micropart can be obtained by the proposed method and has better accuracy than those by conventional shape from focus method. This method provides a new way to obtain the morphology of microparts and lays a foundation for improving the accuracy and efficiency of gripping, alignment and approaching microparts in microassembly systems.

MICROMANIPULATION ROBOT DEPTH EXTRACTION BASED ON MICRO IMAGE DEFOCUS FEATURE

Autofocus Algorithm Based on Depth from Defocus

Microscopic Visual Servoing for Microassembly Robot Depth Motion Based on Defocus Image Features

Depth Estimation Method for Monocular Camera Defocus Images in Microscopic Scenes

Multi-image-distance Imaging System for Extending Depth-of-field

Data-Driven Microscopic Pose and Depth Estimation for Optical Microrobot Manipulation

Study on the Method of Depth Measurement Based on Depth from Defocus

Three-Dimensional Tracking at Micro-scale Using a Single Optical Microscope

Depth Estimation of Optically Transparent Laser-Driven Microrobots

Fast Autofocus of Microscopy Images Based on Depth-from-Defocus

Depth Measurement for the Objects with a Small Height Using Depth-Focus-Based Microscopic Vision System

Multi-channel Residual Network Model for Accurate Estimation of Spatially-Varying and Depth-Dependent Defocus Kernels.

Micromanipulation System That Improves Depth Visibility via Real-time 3D Image Presentation

Application of MRF to Depth Information Estimation of Micro Image Defocus

Research on Micro-manipulation Robot and Its Micro-visual Servo Control System

The Depth Information Estimation of Microscope Defocus Image Based-on Markov Random Field.

A METHOD ON RECOVERING DEPTH INFORMATION OF OBJECT BASED ON DEFOCUSED IMAGE

Monocular Microscopic Image 3D Reconstruction Algorithm Based on Depth from Defocus with Adaptive Window Selection

Research on Monocular Depth Sensing Method Based on Liquid Zoom Imaging

Micro Lens Mono-channel Light Field 3D Direct Imaging Method Based on Bionic Vision and 3-3 Dimensional Information Transformation Foundation

Depth estimation method of surface of micropart in microassembly space based on microscopic vision tomographic scanning images