Abstract:Casually-taken portrait photographs often suffer from unflattering lighting and shadowing because of suboptimal conditions in the environment. Aesthetic qualities such as the position and softness of shadows and the lighting ratio between the bright and dark parts of the face are frequently determined by the constraints of the environment rather than by the photographer. Professionals address this issue by adding light shaping tools such as scrims, bounce cards, and flashes. In this paper, we present a computational approach that gives casual photographers some of this control, thereby allowing poorly-lit portraits to be relit post-capture in a realistic and easily-controllable way. Our approach relies on a pair of neural networks---one to remove foreign shadows cast by external objects, and another to soften facial shadows cast by the features of the subject and to add a synthetic fill light to improve the lighting ratio. To train our first network we construct a dataset of real-world portraits wherein synthetic foreign shadows are rendered onto the face, and we show that our network learns to remove those unwanted shadows. To train our second network we use a dataset of Light Stage scans of human subjects to construct input/output pairs of input images harshly lit by a small light source, and variably softened and fill-lit output images of each face. We propose a way to explicitly encode facial symmetry and show that our dataset and training procedure enable the model to generalize to images taken in the wild. Together, these networks enable the realistic and aesthetically pleasing enhancement of shadows and lights in real-world portrait images. 1

Portrait Skin Beautification Technology Using Multiple Feature Masks

High Quality Image-Pair-based Deblurring Method Using Edge Mask and Improved Residual Deconvolution

Towards Mask-robust Face Recognition.

Facial Skin Beautification Using Adaptive Region-Aware Masks

Feature-Based Automatic Portrait Generation System

Facial Skin Beautification Using Region-Aware Mask

Image Enhancement Based on Skin-Colour Segmentation and Smoothness

Facial Skin Beautification Via Sparse Representation over Learned Layer Dictionary

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

FACE BEAUTIFICATION BASED ON ITERATED MULTISTAGE MEDIAN FILTERING

FaceMore: A Face Beautification Platform on the Cloud

Portrait Shadow Removal Using Context-Aware Illumination Restoration Network

Real-time portrait image retouching extended from DualBLN

HDR Image Processing Algorithm for Portrait Based on Multi Feature Fusion

Automatic Facial Skin Feature Detection for Everyone

Learning to Beautify Facial Image

Portrait shadow manipulation

Multiple HD Screen-Based Virtual Studio System with Learned Mask-Free Portrait Harmonization

Pores-Preserving Face Cleaning Based on Improved Empirical Mode Decomposition

A Framework for Portrait Stylization with Skin-Tone Awareness and Nudity Identification

Face Image Deblurring with Feature Correction and Fusion