Abstract:Virtual try-on is a technology that enables users to preview the effect of wearing a target garment without wearing the actual garment. However, existing image-based virtual try-on methods often require additional human parsing or segmentation operations to generate intermediate representations required for garment deformation and texture fusion. These operations not only increase the computational complexity and memory consumption, but also limit the real-time and portability of virtual try-on. Additionally, inaccurate parsing results can lead to misleading final generated images. To overcome these challenges, we propose a self-supervised feature matched virtual try-on network, which can directly generate high-quality try-on results from human body images and target clothing images without any additional input. Specifically, we design an optical flow warp module, which focuses on the optical flow changes between the person image and the clothing image to achieve accurate clothing alignment and deformation. Furthermore, a feature refine warp module is designed to enhance the features of the extracted optical flow information and the original character segmentation and analysis operations, reducing the influence of background clutter features on the content, and ensuring that the wrinkles and deformation of the replacement clothes are close to the original clothes. The feature match module is developed to calculate the feature matching loss of the converted clothing and the generated results of the teacher network and the student network, and the corresponding knowledge is distilled and passed to the student network to assist in self-supervised training. We conduct experiments on the VITON dataset and show that our model can generate high quality and high resolution, and our proposed method outperforms the state-of-the-art virtual try-on methods both qualitatively and quantitatively. Graphical Abstract

Multi-stage Network with Garments Extraction Module to Improve Image-based Virtual Try-on

VTON-HF: High Fidelity Virtual Try-on Network Via Semantic Adaptation

Context-Aware Enhanced Virtual Try-On Network with Fabric Adaptive Registration

VTNCT: an Image-Based Virtual Try-on Network by Combining Feature with Pixel Transformation

Toward Realistic Virtual Try-on Through Landmark Guided Shape Matching

DP-VTON: Toward Detail-Preserving Image-Based Virtual Try-on Network

Towards Multi-pose Guided Virtual Try-on Network

High Fidelity Virtual Try-on Network Via Semantic Adaptation and Distributed Componentization

Virtual Try-on Network with Attribute Transformation and Local Rendering.

VTON-SCFA: A Virtual Try-On Network Based on the Semantic Constraints and Flow Alignment

Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothing

IMAGDressing-v1: Customizable Virtual Dressing

CS-VITON: a realistic virtual try-on network based on clothing region alignment and SPM

SPG-VTON: Semantic Prediction Guidance for Multi-pose Virtual Try-on

An Improved Two-stage Network for Video Virtual Try-on

High-Resolution Virtual Try-On Network with Coarse-to-Fine Strategy

PF-VTON: Toward High-Quality Parser-Free Virtual Try-On Network

Toward Characteristic-Preserving Image-based Virtual Try-On Network

Self-supervised Feature Matched Virtual Try-on

An Efficient Style Virtual Try on Network for Clothing Business Industry

Toward Accurate and Realistic Outfits Visualization with Attention to Details