Abstract:VTON (Virtual Try-ON), as an innovative visual application in e-commerce scenarios with great commercial value, has been widely studied in recent years. Due to its better robustness and realistic effect, deformation-synthesize-based VTON has become the dominant approach in this field. Existing clothing deformation techniques optimize the mapping relations between the original clothing image and the ground truth (GT) image of the worn clothing. However, there are color differences between the original and GT clothing images caused by lighting, warping, and occlusion. The color differences may lead to misaligned clothing mapping by only minimizing the cost of pixel value difference. Another drawback is that taking the parsing prediction as GT will bring alignment remnant, rooting in the processing order of parsing and deformation. Aiming above two drawbacks, we put forward SAME-VTON (Self-Adaptive clothing Mapping basEd Virtual Try-ON) for achieving realistic virtual try-on results. The core of SAME-VTON is the self-adaptive clothing mapping technique, composed of two parts: a color-adaptive clothing mapping module and a parsing-adaptive prediction process. In the color-adaptive clothing mapping module, we map each pixel of the target clothing with a combination of multiple pixel values from the original clothing image, which considers both the position and color changes. Furthermore, different combination weights are learned to increase the diversity of color mapping. In the parsing-adaptive prediction process, the color-adaptive clothing mapping module is adopted to deform clothing first, then the human parsing result is predicted under the reference of the deformed clothing, which can avoid alignment remnant. Extensive experiments demonstrate that the proposed SAME-VTON with the self-adaptive clothing mapping technique can achieve optimal mapping in the case of large color differences and obtain superior results compared with existing deformation-synthesize-based VTON.

Toward Multi-Category Garments Virtual Try-on Method by Coarse to Fine TPS Deformation

Toward Realistic Virtual Try-on Through Landmark Guided Shape Matching

PG-VTON: A Novel Image-Based Virtual Try-On Method Via Progressive Inference Paradigm

Limb-Aware Virtual Try-On Network with Progressive Clothing Warping

Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothing

StyleVTON: A multi-pose virtual try-on with identity and clothing detail preservation

VTNCT: an Image-Based Virtual Try-on Network by Combining Feature with Pixel Transformation

Multi-Pose Virtual Try-On Via Self-Adaptive Feature Filtering

Toward Characteristic-Preserving Image-based Virtual Try-On Network

A Two-stage Personalized Virtual Try-on Framework with Shape Control and Texture Guidance

GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learning

Self-Adaptive Clothing Mapping Based Virtual Try-on

M&M VTO: Multi-Garment Virtual Try-On and Editing

CS-VITON: a realistic virtual try-on network based on clothing region alignment and SPM

GraVITON: Graph based garment warping with attention guided inversion for Virtual-tryon

Significance of Anatomical Constraints in Virtual Try-On

Toward Accurate and Realistic Virtual Try-on Through Shape Matching and Multiple Warps

Better Fit: Accommodate Variations in Clothing Types for Virtual Try-on

Three stages of 3D virtual try-on network with appearance flow and shape field

LGVTON: A Landmark Guided Approach to Virtual Try-On