C2F-CFN: Coarse-to-Fine ClothFlow Network for High-Fidelity Virtual Try-On

Yanli Bi,Lizhe Qi,Yunquan Sun
DOI: https://doi.org/10.1109/ijcnn55064.2022.9891893
2022-01-01
Abstract:Image-based virtual try-on refers to the task of transferring a target clothing item onto the corresponding area of a person. While deep generative models have made considerable progress in virtual try-on, current methods are incapable of handling the rendering of try-on details, and they generally suffer from unrealistic try-on images with artifacts due to the improper warping of clothing. In this paper, we propose a novel virtual try-on network, called C2F-CFN, which models the per-pixel appearance flow via a coarse-to-fine manner. Specifically, the affine transformation is learned first to obtain the coarse warped clothing, and then the texture and geometric details of clothing are refined through appearance flow estimation. Furthermore, the oracle flow supervision is introduced to produce more natural and reasonable flow maps. We evaluate our model on the VITON dataset, and demonstrate that our approach outperforms the state-of-the-art techniques quantitatively and qualitatively.
What problem does this paper attempt to address?