Abstract: 33D-aware face generators are commonly trained on 2D real-life face image datasets. Nevertheless, existing facial recognition methods often struggle to extract face data captured from various camera angles. Furthermore, in-the-wild images with diverse body poses introduce a high-dimensional challenge for 3D-aware generators, making it difficult to utilize data that contains complete neck and shoulder regions. Consequently, these face image datasets often contain only near-frontal face data, which poses challenges for 3D-aware face generators to construct \textit{full-head} 3D portraits. To this end, we first create the dataset {$\it{360}^{\circ}$}-\textit{Portrait}-\textit{HQ} (\textit{$\it{360}^{\circ}$PHQ}), which consists of high-quality single-view real portraits annotated with a variety of camera parameters {(the yaw angles span the entire $360^{\circ}$ range)} and body poses. We then propose \textit{3DPortraitGAN}, the first 3D-aware full-head portrait generator that learns a canonical 3D avatar distribution from the body-pose-various \textit{$\it{360}^{\circ}$PHQ} dataset with body pose self-learning. Our model can generate view-consistent portrait images from all camera angles (${360}^{\circ}$) with a full-head 3D representation. We incorporate a mesh-guided deformation field into volumetric rendering to produce deformed results to generate portrait images that conform to the body pose distribution of the dataset using our canonical generator. We integrate two pose predictors into our framework to predict more accurate body poses to address the issue of inaccurately estimated body poses in our dataset. Our experiments show that the proposed framework can generate view-consistent, realistic portrait images with complete geometry from all camera angles and accurately predict portrait body pose.

3D-SSGAN: Lifting 2D Semantics for 3D-Aware Compositional Portrait Synthesis

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

Fine-grained Semantic Constraint in Image Synthesis

IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis

Freestyle 3D-Aware Portrait Synthesis Based on Compositional Generative Priors

Semantic 3D-aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Field

AgileGAN3D: Few-Shot 3D Portrait Stylization by Augmented Transfer Learning

SD-GAN: Semantic Decomposition for Face Image Synthesis with Discrete Attribute

3DFaceShop: Explicitly Controllable 3D-Aware Portrait Generation

Lifting 2D StyleGAN for 3D-Aware Face Generation

SofGAN: A Portrait Image Generator with Dynamic Styling

Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Prior

Learning Detailed Radiance Manifolds for High-Fidelity and 3D-Consistent Portrait Synthesis from Monocular Image

3D-Aware Semantic-Guided Generative Model for Human Synthesis.

Towards Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs

Learning Full-Head 3D GANs from a Single-View Portrait Dataset

SideGAN: 3D-Aware Generative Model for Improved Side-View Image Synthesis

Composition-Aided Face Photo-Sketch Synthesis.

Interpreting the Latent Space of GANs for Semantic Face Editing

DualStyle3D: Real-time Exemplar-based Artistic Portrait View Synthesis Based on Radiance Field