Abstract:Eyelashes play a crucial part in the human facial structure and largely affect the facial attractiveness in modern cosmetic design. However, the appearance and structure of eyelashes can easily induce severe artifacts in high-fidelity multi-view 3D face reconstruction. Unfortunately it is highly challenging to remove eyelashes from portrait images using both traditional and learning-based matting methods due to the delicate nature of eyelashes and the lack of eyelash matting dataset. To this end, we present EyelashNet, the first eyelash matting dataset which contains 5,400 high-quality eyelash matting data captured from real world and 5,272 virtual eyelash matting data created by rendering avatars. Our work consists of a capture stage and an inference stage to automatically capture and annotate eyelashes instead of tedious manual efforts. The capture is based on a specifically-designed fluorescent labeling system. By coloring the eyelashes with a safe and invisible fluorescent substance, our system takes paired photos with colored and normal eyelashes by turning the equipped ultraviolet (UVA) flash on and off. We further correct the alignment between each pair of photos and use a novel alpha matte inference network to extract the eyelash alpha matte. As there is no prior eyelash dataset, we propose a progressive training strategy that progressively fuses captured eyelash data with virtual eyelash data to learn the latent semantics of real eyelashes. As a result, our method can accurately extract eyelash alpha mattes from fuzzy and self-shadow regions such as pupils, which is almost impossible by manual annotations. To validate the advantage of EyelashNet, we present a baseline method based on deep learning that achieves state-of-the-art eyelash matting performance with RGB portrait images as input. We also demonstrate that our work can largely benefit important real applications including high-fidelity personalized avatar and cosmetic design.

EyebrowNet: High-Precision Eyebrow Reconstruction and Matting

Effective Eyebrow Matting with Domain Adaptation

EMS: 3D Eyebrow Modeling from Single-view Images

APB2FACE: Audio-Guided Face Reenactment with Auxiliary Pose and Blink Signals.

EyelashNet: a Dataset and a Baseline Method for Eyelash Matting.

EyelashNet

Towards High-Fidelity 3D Face Reconstruction from In-the-Wild Images Using Graph Convolutional Networks

FreeEnricher: Enriching Face Landmarks Without Additional Cost

HairNet: Single-View Hair Reconstruction using Convolutional Neural Networks

RefFaceNet: Reference-based Face Image Generation from Line Art Drawings

High Fidelity Makeup Via 2D and 3D Identity Preservation Net

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

SketchHairSalon: Deep Sketch-based Hair Image Synthesis

E2F-Net: Eyes-to-Face Inpainting via StyleGAN Latent Space

A Fine Rendering High-Resolution Makeup Transfer network via inversion-editing strategy

GAN Prior Embedded Network for Blind Face Restoration in the Wild

BareSkinNet: De‐makeup and De‐lighting via 3D Face Reconstruction

Joint 3D facial shape reconstruction and texture completion from a single image

InverseFaceNet: Deep Monocular Inverse Face Rendering

HPG-GAN: High-Quality Prior-Guided Blind Face Restoration Generative Adversarial Network