Abstract:We consider the problem of modifying/replacing the shape style of a real moving character with those of an arbitrary static real source character. Traditional solutions follow a pose transfer strategy, from the moving character to the source character shape, that relies on skeletal pose parametrization. In this paper, we explore an alternative approach that transfers the source shape style onto the moving character. The expected benefit is to avoid the inherently difficult pose to shape conversion required with skeletal parametrization applied on real characters. To this purpose, we consider image style transfer techniques and investigate how to adapt them to 3D human shapes. Adaptive Instance Normalisation (AdaIN) and SPADE architectures have been demonstrated to efficiently and accurately transfer the style of an image onto another while preserving the original image structure. Where AdaIN contributes with a module to perform style transfer through the statistics of the subjects and SPADE contribute with a residual block architecture to refine the quality of the style transfer. We demonstrate that these approaches are extendable to the 3D shape domain by proposing a convolutional neural network that applies the same principle of preserving the shape structure (shape pose) while transferring the style of a new subject shape. The generated results are supervised through a discriminator module to evaluate the realism of the shape, whilst enforcing the decoder to synthesise plausible shapes and improve the style transfer for unseen subjects. Our experiments demonstrate an average of $\approx 56\%$ qualitative and quantitative improvements over the baseline in shape transfer through optimization-based and learning-based methods.

3D shape creation by style transfer

Diverse Image Style Transfer Via Invertible Cross-Space Mapping

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

Diversified Patch-based Style Transfer with Shifted Style Normalization

Style Permutation for Diversified Arbitrary Style Transfer

Correlation-based and Content-Enhanced Network for Video Style Transfer

TeSTNeRF: Text-Driven 3D Style Transfer Via Cross-Modal Learning.

Artistic Style Transfer with Internal-external Learning and Contrastive Learning

Style3D: Attention-guided Multi-view Style Transfer for 3D Object Generation

3D Human Shape Style Transfer

2D Shape Blending Based on Multi-Level Feature Structures

3D Face Arbitrary Style Transfer

Semi-Supervised Co-Analysis of 3D Shape Styles from Projected Lines

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

Neural Style Transfer with Content Discrimination

Any-to-Any Style Transfer: Making Picasso and Da Vinci Collaborate

A Method for Arbitrary Instance Style Transfer

Style Transfer Based on Style Primitive Discovery.

TSSAT: Two-Stage Statistics-Aware Transformation for Artistic Style Transfer

Unified Style Transfer

Creative Birds: Self-Supervised Single-View 3D Style Transfer