Abstract:Undoubtedly, high-fidelity 3D hair is crucial for achieving realism, artistic expression, and immersion in computer graphics. While existing 3D hair modeling methods have achieved impressive performance, the challenge of achieving high-quality hair reconstruction persists: they either require strict capture conditions, making practical applications difficult, or heavily rely on learned prior data, obscuring fine-grained details in images. To address these challenges, we propose MonoHair,a generic framework to achieve high-fidelity hair reconstruction from a monocular video, without specific requirements for environments. Our approach bifurcates the hair modeling process into two main stages: precise exterior reconstruction and interior structure inference. The exterior is meticulously crafted using our Patch-based Multi-View Optimization (PMVO). This method strategically collects and integrates hair information from multiple views, independent of prior data, to produce a high-fidelity exterior 3D line map. This map not only captures intricate details but also facilitates the inference of the hair's inner structure. For the interior, we employ a data-driven, multi-view 3D hair reconstruction method. This method utilizes 2D structural renderings derived from the reconstructed exterior, mirroring the synthetic 2D inputs used during training. This alignment effectively bridges the domain gap between our training data and real-world data, thereby enhancing the accuracy and reliability of our interior structure inference. Lastly, we generate a strand model and resolve the directional ambiguity by our hair growth algorithm. Our experiments demonstrate that our method exhibits robustness across diverse hairstyles and achieves state-of-the-art performance. For more results, please refer to our project page

DeepMVSHair: Deep Hair Modeling from Sparse Views.

Struct2Hair: A Hair Shape Descriptor for Hairstyle Modeling.

HairNet: Single-View Hair Reconstruction using Convolutional Neural Networks

CT2Hair: High-Fidelity 3D Hair Modeling Using Computed Tomography.

Hair-GAN: Recovering 3D Hair Structure from a Single Image Using Generative Adversarial Networks

Neural Strands: Learning Hair Geometry and Appearance from Multi-View Images

MonoHair: High-Fidelity Hair Modeling from a Monocular Video

Towards Unified 3D Hair Reconstruction from Single-View Portraits

HairStep: Transfer Synthetic to Real Using Strand and Depth Maps for Single-View 3D Hair Modeling

Dynamic Hair Modeling from Monocular Videos Using Deep Neural Networks

Dynamic Hair Manipulation in Images and Videos

HVH: Learning a Hybrid Neural Volumetric Representation for Dynamic Hair Performance Capture

Single-view Hair Modeling for Portrait Manipulation

DeepSketchHair: Deep Sketch-Based 3D Hair Modeling

A Data-Driven Approach to Four-View Image-Based Hair Modeling

Neural Haircut: Prior-Guided Strand-Based Hair Reconstruction

NeuralHDHair: Automatic High-fidelity Hair Modeling from a Single Image Using Implicit Neural Representations

GroomGen: A High-Quality Generative Hair Model Using Hierarchical Latent Representations

High-quality hair modeling from a single portrait photo

Strand-accurate multi-view facial hair reconstruction and tracking

NeuWigs: A Neural Dynamic Model for Volumetric Hair Capture and Animation