Filling the Holes on 3D Heritage Object Surface based on Automatic Segmentation Algorithm

Sinh Van Nguyen,Son Thanh Le,Minh Khai Tran,Le Thanh Sach

2023-10-17

Abstract:Reconstructing and processing the 3D objects are popular activities in the research field of computer graphics, image processing and computer vision. The 3D objects are processed based on the methods like geometric modeling, a branch of applied mathematics and computational geometry, or the machine learning algorithms based on image processing. The computation of geometrical objects includes processing the curves and surfaces, subdivision, simplification, meshing, holes filling, reconstructing, and refining the 3D surface objects on both point cloud data and triangular mesh. While the machine learning methods are developed using deep learning models. With the support of 3D laser scan devices and Lidar techniques, the obtained dataset is close to original shape of the real objects. Besides, the photography and its application based on the modern techniques in recent years help us collect data and process the 3D models more precise. This article proposes an improved method for filling holes on the 3D object surface based on an automatic segmentation. Instead of filling the hole directly as the existing methods, we now subdivide the hole before filling it. The hole is first determined and segmented automatically based on computation of its local curvature. It is then filled on each part of the hole to match its local curvature shape. The method can work on both 3D point cloud surfaces and triangular mesh surface. Comparing to the state of the art methods, our proposed method obtained higher accuracy of the reconstructed 3D objects.

Computer Vision and Pattern Recognition,Computational Geometry

What problem does this paper attempt to address?

The paper is primarily dedicated to addressing the issue of filling holes on the surfaces of 3D artifacts. Specifically, the research proposes an improved method to automatically segment and fill large or structurally complex holes on the surfaces of 3D artifacts. Traditional methods that directly fill these holes may result in significant deviations between the reconstructed 3D model and the original shape. To solve this problem, the authors took the following steps:

1. **Data Acquisition**: Point cloud data of the artifacts were obtained using 3D scanning devices such as the EinScan Pro+ and R-EVO scanners.

2. **Preprocessing and Meshing**: The acquired data were preprocessed to remove noise and construct a triangular mesh representation.

3. **Hole Segmentation and Filling**: This is the core part of the research. For larger or more complexly shaped holes, the positions of the holes were first determined and automatically segmented based on the local curvature of the boundary points. Then, each segmented small hole was filled individually, rather than directly filling the entire large hole. This method better matches the local curvature shape of the holes, thereby improving the accuracy of the reconstruction.

4. **Virtual Museum Application**: The repaired 3D artifact models were used to build applications for virtual museums, allowing users to access these digital heritages through virtual reality (VR) and augmented reality (AR) technologies.

In summary, the goal of this paper is to propose a method that can more accurately repair holes on the surfaces of 3D artifacts, achieving reconstructions that are closer to the original shapes, and ultimately applying them to virtual museum displays.