Abstract:Virtual try-on is a technology that enables users to preview the effect of wearing a target garment without wearing the actual garment. However, existing image-based virtual try-on methods often require additional human parsing or segmentation operations to generate intermediate representations required for garment deformation and texture fusion. These operations not only increase the computational complexity and memory consumption, but also limit the real-time and portability of virtual try-on. Additionally, inaccurate parsing results can lead to misleading final generated images. To overcome these challenges, we propose a self-supervised feature matched virtual try-on network, which can directly generate high-quality try-on results from human body images and target clothing images without any additional input. Specifically, we design an optical flow warp module, which focuses on the optical flow changes between the person image and the clothing image to achieve accurate clothing alignment and deformation. Furthermore, a feature refine warp module is designed to enhance the features of the extracted optical flow information and the original character segmentation and analysis operations, reducing the influence of background clutter features on the content, and ensuring that the wrinkles and deformation of the replacement clothes are close to the original clothes. The feature match module is developed to calculate the feature matching loss of the converted clothing and the generated results of the teacher network and the student network, and the corresponding knowledge is distilled and passed to the student network to assist in self-supervised training. We conduct experiments on the VITON dataset and show that our model can generate high quality and high resolution, and our proposed method outperforms the state-of-the-art virtual try-on methods both qualitatively and quantitatively. Graphical Abstract

CS-VITON: a realistic virtual try-on network based on clothing region alignment and SPM

Toward Realistic Virtual Try-on Through Landmark Guided Shape Matching

VITON: An Image-based Virtual Try-on Network

VTNCT: an Image-Based Virtual Try-on Network by Combining Feature with Pixel Transformation

Context-Aware Enhanced Virtual Try-On Network with Fabric Adaptive Registration

DP-VTON: Toward Detail-Preserving Image-Based Virtual Try-on Network

SP-VITON: shape-preserving image-based virtual try-on network

C-VTON: Context-Driven Image-Based Virtual Try-On Network

Self-supervised Feature Matched Virtual Try-on

VTON-SCFA: A Virtual Try-On Network Based on the Semantic Constraints and Flow Alignment

High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditions

VTON-HF: High Fidelity Virtual Try-on Network Via Semantic Adaptation

LG-VTON: Fashion Landmark Meets Image-Based Virtual Try-On

VTNFP: an Image-Based Virtual Try-On Network with Body and Clothing Feature Preservation.

Toward Characteristic-Preserving Image-based Virtual Try-On Network

StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On

High-Resolution Virtual Try-On Network with Coarse-to-Fine Strategy

PG-VTON: A Novel Image-Based Virtual Try-On Method Via Progressive Inference Paradigm

VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization

SPG-VTON: Semantic Prediction Guidance for Multi-pose Virtual Try-on