Microscopic Structure from Motion (SfM) for Microscale 3D Surface Reconstruction

Dugan Um,Sangsoo Lee

DOI: https://doi.org/10.3390/s20195599

IF: 3.9

2020-09-29

Sensors

Abstract:In microscale photogrammetry, the confocal microscopic imaging technique has been the dominant trend. Unlike the confocal imaging mostly for transparent objects, we propose a novel method to construct a 3D shape in microscale for various micro-sized solid objects in a broad spectrμm of applications. Recently, the structure from motion (SfM) demonstrated reliable 3D reconstruction capability for macroscale objects. In this paper, we discuss the results of a novel micro-surface reconstruction method using the Structure from Motion in microscale. The proposed micro SfM technique utilizes the photometric stereovision via microscopic photogrammetry. The main challenges lie in the scanning methodology, ambient light control, and light conditioning for microscale object photography. Experimental results of the microscale SfM, as well as the modeling accuracy analysis of a reconstructed micro-object, are shared in the paper.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to achieve 3D surface reconstruction on the micro - scale. Specifically, the author proposes a new method, using Structure from Motion (SfM) technology to construct the 3D shapes of various micro - scale solid objects. Traditional micro - scale 3D imaging mainly relies on confocal microscopy imaging technology, which is mainly used for transparent objects. However, for tiny solid objects that are opaque or have complex surface structures, confocal imaging technology has limitations, such as being unable to effectively reconstruct concave structures, and having a long scanning time and high cost.

The main challenges mentioned in the paper include:
1. **Scanning method**: To achieve SfM on the micro - scale, a scanning method that can generate high - quality images needs to be designed.
2. **Ambient light control**: Micro - scale photography has higher requirements for ambient light control to ensure image quality.
3. **Illumination conditions**: It is necessary to precisely control the illumination conditions to reduce the influence of surface reflection and shadow and improve the accuracy of 3D reconstruction.

To solve these problems, the author proposes the following solutions:
- **High - resolution camera**: Use a high - resolution camera (more than 5 megapixels) to obtain clearer images.
- **Camera calibration**: Calibrate the camera to reduce the influence of lens distortion on 3D reconstruction.
- **Surface texture control**: Although it is difficult to control the surface texture on the micro - scale, by optimizing the illumination conditions and shooting angles, the interference of surface reflection can be reduced.
- **Capture sequence**: Design a specific capture sequence to ensure that there are sufficient overlapping areas between images for effective 3D reconstruction.
- **Experimental device**: Build a microscope system with a mobile platform, which can achieve multi - angle and multi - direction shooting, thereby obtaining a complete 3D model.

Through these methods, the author hopes to overcome the challenges of micro - scale SfM technology and achieve fast, low - cost, and high - precision micro - scale 3D surface reconstruction.