ReliefNet: Fast Bas-relief Generation from 3D Scenes

Zhongping Ji,Wei Feng,Xianfang Sun,Feiwei Qin,Yigang Wang,Yu-Wei Zhang,Weiyin Ma
DOI: https://doi.org/10.1016/j.cad.2020.102928
2021-01-01
Abstract:The first to study the modeling of general bas-reliefs from 3D scenes based on an end-to-end trained deep neural networks.The proposed loss function is very critical for the high-quality bas-relief modeling. Our network is elaborately designed to deal with a geometric modeling problem. We equip it with a special loss function with the aim that the network can solve the essential problem of bas-relief modeling.Our method is very efficient in predicting a high-quality bas-relief from a 3D scene, even given an input with a high resolution or a batch of inputs. Given a 3D scene, it is often necessary to select different angle of views. Therefore, the instant feedback of an algorithm is important in practice.A bas-relief dataset is first constructed to train the neural network for bas-relief modeling. This dataset will be released to benefit the research community on bas-relief modeling and related applications.Most previous methods of bas-relief generation run slow, or require tuning several important parameters. These issues seriously reduce the efficiency of bas-relief modeling. We introduce a fast generation method for high-quality bas-reliefs from 3D objects based on a deep learning technique. Unlike neural networks for image tasks, the proposed network for reliefs (ReliefNet) is elaborately designed to deal with a modeling problem in the field of graphics. We design our ReliefNet and equip it with a special loss function with the aim that the network can solve the essential problem of bas-relief modeling. Our network eliminates the height gaps and maintains the rich details simultaneously. The advantage over previous methods is that our method does not require parameter tuning and is a very efficient. Once the ReliefNet has been trained, a bas-relief can be produced by one feed-forward pass of the network instantly. To demonstrate the performance and effectiveness of our method, extensive experiments on a range of 3D scenes with high resolutions and comparisons to state-of-the-art methods are conducted.
computer science, software engineering
What problem does this paper attempt to address?