Abstract:We offer a method for one-shot mask-guided image synthesis that allows controlling manipulations of a single image by inverting a quasi-robust classifier equipped with strong regularizers. Our proposed method, entitled MAGIC, leverages structured gradients from a pre-trained quasi-robust classifier to better preserve the input semantics while preserving its classification accuracy, thereby guaranteeing credibility in the synthesis. Unlike current methods that use complex primitives to supervise the process or use attention maps as a weak supervisory signal, MAGIC aggregates gradients over the input, driven by a guide binary mask that enforces a strong, spatial prior. MAGIC implements a series of manipulations with a single framework achieving shape and location control, intense non-rigid shape deformations, and copy/move operations in the presence of repeating objects and gives users firm control over the synthesis by requiring to simply specify binary guide masks. Our study and findings are supported by various qualitative comparisons with the state-of-the-art on the same images sampled from ImageNet and quantitative analysis using machine perception along with a user survey of 100+ participants that endorse our synthesis quality. Project page at <a class="link-external link-https" href="https://mozhdehrouhsedaghat.github.io/magic.html" rel="external noopener nofollow">this https URL</a>. Code is available at <a class="link-external link-https" href="https://github.com/mozhdehrouhsedaghat/magic" rel="external noopener nofollow">this https URL</a>

Binary Mask Based Image Synthesis Method and Its Applications

A Constrained Multi-sample Texture Synthesis Algorithm Based on Random Expanding of Circular Patches

The Technology of Sampled-based Texture Synthesis

Using Texture Synthesis in Fractal Pattern Design

An Extending Dynamic Range Method Based on Digital Image Synthesis

Texture synthesis based on minimum energy cut and its applications

Fast Texture Synthesis Using Multiple Seeds As Constraints

Foreground-distortion Method for Image Synthesis.

Context-Aware Text-Based Binary Image Stylization and Synthesis

Reconstructing binary textured images by mean field technique

Texture Synthesis And Texture Mixing Using Random Lines

A Texture Synthesis Method Based on Adaptive Patches

Image-Based Synthesis of Chinese Landscape Painting.

Novel 3D-Aware Composition Images Synthesis for Object Display with Diffusion Model.

An experimental facial synthesis system using graph cut and gradient domain fusion

Example-Based Image Synthesis via Randomized Patch-Matching

Pseudo Surface-Texture Synthesis.

Text-to-image synthesis: Starting composite from the foreground content

Generation and placement technique for complex textures

MAGIC: Mask-Guided Image Synthesis by Inverting a Quasi-Robust Classifier

Binary Hologram Generation Based on Discrete Wavelet Transform