Abstract:Image-to-image translation is a topic in computer vision that has a vast range of use cases ranging from medical image translation, such as converting MRI scans to CT scans or to other MRI contrasts, to image colorization, super-resolution, domain adaptation, and generating photorealistic images from sketches or semantic maps. Image style transfer is also a widely researched application of image-to-image translation, where the goal is to synthesize an image that combines the content of one image with the style of another. Existing state-of-the-art methods often rely on complex neural networks, including diffusion models and language models, to achieve high-quality style transfer, but these methods can be computationally expensive and intricate to implement. In this paper, we propose a novel pixel shuffle method that addresses the image-to-image translation problem generally with a specific demonstrative application in style transfer. The proposed method approaches style transfer by shuffling the pixels of the style image such that the mutual information between the shuffled image and the content image is maximized. This approach inherently preserves the colors of the style image while ensuring that the structural details of the content image are retained in the stylized output. We demonstrate that this simple and straightforward method produces results that are comparable to state-of-the-art techniques, as measured by the Learned Perceptual Image Patch Similarity (LPIPS) loss for content preservation and the Fréchet Inception Distance (FID) score for style similarity. Our experiments validate that the proposed pixel shuffle method achieves competitive performance with significantly reduced complexity, offering a promising alternative for efficient image style transfer, as well as a promise in usability of the method in general image-to-image translation tasks.

Pixel shuffling is all you need: spatially aware convmixer for dense prediction tasks

ShuffleMixer: An Efficient ConvNet for Image Super-Resolution

Multi-Scale MLP-Mixer for image classification

3D Shuffle-Mixer: An Efficient Context-Aware Vision Learner of Transformer-MLP Paradigm for Dense Prediction in Medical Volume

AdaMixer: A Fast-Converging Query-Based Object Detector

Decoupled Mixup for Data-efficient Learning

An Efficient Transformer For Demosaicing Via Compressed Multi-Branch Attention Mechanism.

ModelMix: A New Model-Mixup Strategy to Minimize Vicinal Risk across Tasks for Few-scribble based Cardiac Segmentation

Dynamic Shuffle: An Efficient Channel Mixture Method

CAMixerSR: Only Details Need More "Attention"

CS-Mixer: A Cross-Scale Vision MLP Model with Spatial-Channel Mixing

An Extremely Effective Spatial Pyramid and Pixel Shuffle Upsampling Decoder for Multiscale Monocular Depth Estimation

MixConv: Mixed Depthwise Convolutional Kernels

EfficientFusion: simple and efficient learning with pixel-level fusion for semantic segmentation

Stochastic Layer-Wise Shuffle: A Good Practice to Improve Vision Mamba Training

SA-Net: Shuffle Attention for Deep Convolutional Neural Networks

MAIM: a Mixer MLP Architecture for Image Matching

PixelShuffler: A Simple Image Translation Through Pixel Rearrangement

SiamMixer: A Lightweight and Hardware-Friendly Visual Object-Tracking Network

Adaptive Frequency Filters As Efficient Global Token Mixers

Mixup Without Hesitation