Abstract:Implicit Neural Representation (INR) has become a popular method for representing visual signals (e.g., 2D images and 3D scenes), demonstrating promising results in various downstream applications. Given its potential as a medium for visual signals, exploring the development of a neural blending method that utilizes INRs is a natural progression. Neural blending involves merging two INRs to create a new INR that encapsulates information from both original representations. A direct approach involves applying traditional image editing methods to the INR rendering process. However, this method often results in blending distortions, artifacts, and color shifts, primarily due to the discretization of the underlying pixel grid and the introduction of boundary conditions for solving variational problems. To tackle this issue, we introduce the Neural Poisson Solver, a plug-and-play and universally applicable framework across different signal dimensions for blending visual signals represented by INRs. Our Neural Poisson Solver offers a variational problem-solving approach based on the continuous Poisson equation, demonstrating exceptional performance across various domains. Specifically, we propose a gradient-guided neural solver to represent the solution process of the variational problem, refining the target signal to achieve natural blending results. We also develop a Poisson equation-based loss and optimization scheme to train our solver, ensuring it effectively blends the input INR scenes while preserving their inherent structure and semantic content. The lack of dependence on additional prior knowledge makes our method easily adaptable to various task categories, highlighting its versatility. Comprehensive experimental results validate the robustness of our approach across multiple dimensions and blending tasks.

Bridging the Visual Gap: Wide-Range Image Blending

Taming Vector-Wise Quantization for Wide-Range Image Blending with Smooth Transition

Diffuse3D: Wide-Angle 3D Photography Via Bilateral Diffusion

GP-GAN: Towards Realistic High-Resolution Image Blending

Multi-Viewpoint Panorama Construction with Wide-Baseline Images

GlueGAN: Gluing Two Images As a Panorama with Adversarial Learning

Conditional GAN-based Deep Network for Seamless Large-Fov Imaging by Camera Array

Panoramic Image Inpainting With Gated Convolution And Contextual Reconstruction Loss

Image Blending with Osmosis

Panoramic Image Stitching Using Double Encoder–Decoders

Neural Poisson Solver: A Universal and Continuous Framework for Natural Signal Blending

Viewport-Oriented Panoramic Image Inpainting

Towards Reliable Image Outpainting: Learning Structure-Aware Multimodal Fusion with Depth Guidance

A General Paradigm with Detail-Preserving Conditional Invertible Network for Image Fusion

Mixed-View Panorama Synthesis using Geospatially Guided Diffusion

Hybrid Neural Rendering for Large-Scale Scenes with Motion Blur

Local-to-Global Panorama Inpainting for Locale-Aware Indoor Lighting Prediction

Merging and Splitting Diffusion Paths for Semantically Coherent Panoramas

Infrared and Visible Image Fusion via Interactive Compensatory Attention Adversarial Learning

Deep Image Harmonization by Bridging the Reality Gap