Abstract:Neural Radiance Field (NeRF) has brought revolutionary changes to the field of image synthesis with its unique ability to generate highly realistic multi-view consistent images from a neural scene representation. However, current NeRF-based methods still largely depend on multiple, precisely posed images, especially for complex or dynamic scenes, limiting their versatility. Furthermore, some recent strategies attempt to integrate simple feature extraction networks with volume rendering techniques to reduce multi-view dependence but create blurry outputs, highlighting the need for more sophisticated feature handling to unlock NeRF's full potential. In this paper, we propose an image synthesis method named FeRF, distinguished by its capacity to perform comprehensive feature extraction on individual unposed images and facilitate feature fusion at any stage. Additionally, we present an "elaborated-feature generation network" (EGN) composed of four modules, which is configured with two advanced feature extraction modules aimed at precisely refining and processing subtle, complex visual features from a single image. Given that the core objective of FeRF is the precise capture and processing of intricate features from the input images, we innovatively incorporated precisely designed attention mechanisms into the network architecture to optimize and highlight the importance of key feature attributes, thereby effectively enhancing their contribution to subsequent volume rendering processes. Extensive experimentation validates the outstanding qualitative and quantitative performance of our proposed network structure. In comparison to current image feature-based generalized image synthesis methods, it achieves superior reconstruction quality and level of detail.

Feature Radiance Fields (ferf): A Multi-level Feature Fusion Method with Deep Neural Network for Image Synthesis

NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction

Hyb-NeRF: A Multiresolution Hybrid Encoding for Neural Radiance Fields

Neural Radiance Fields From Sparse RGB-D Images for High-Quality View Synthesis

Adaptive Multi-Exposure Fusion for Enhanced Neural Radiance Fields.

Improved Neural Radiance Fields Using Pseudo-depth and Fusion

NeRF-SDP: Efficient Generalizable Neural Radiance Field with Scene Depth Perception.

NeRF synthesis with shading guidance

UHDNeRF: Ultra-High-Definition Neural Radiance Fields

Enhancing Neural Radiance Fields with Adaptive Multi-Exposure Fusion: A Bilevel Optimization Approach for Novel View Synthesis

MMNeRF: Multi-Modal and Multi-View Optimized Cross-Scene Neural Radiance Fields

Neural Radiance Fields (NeRFs): A Review and Some Recent Developments

TransNeRF: Multi-View Optimization for General Neural Radiance Fields Across Scenes

GenPower-NeRF: A Neural Radiance Field Method with Powerful Generalization

Learning Neural Duplex Radiance Fields for Real-Time View Synthesis

IE-NeRF: Inpainting Enhanced Neural Radiance Fields in the Wild

NeFF: Neural Feature Fields for Few-Shot View Synthesis Addressing the Shape-Radiance Ambiguity

NeRF-Texture: Synthesizing Neural Radiance Field Textures

NeRF-SR++: Towards Higher Quality Supersampled Neural Radiation Fields

Combine Neural Radiance Fields in Different Reference Coordinates

Improving Neural Radiance Fields with Depth-aware Optimization for Novel View Synthesis