Abstract:The emergence of the generalized neural radiance field models has greatly expanded the applicability of novel view synthesis task. However, existing methods primarily rely on 2D features obtained from neighboring views to assist the rendering, which often leads to degradation in unseen viewpoints. Some approaches introduce cost volumes in the model to provide geometric priors, but such coarse geometric information fails to constrain the model effectively, resulting in rendered images with abundant artifacts. In this work, we propose to provide the model with hierarchical geometry constraints to achieve better rendering results. We introduce cascaded MVSNet to provide hierarchical scene structural features for inferring the underlying scene geometry. It constrains the model’s rendering under unseen viewpoints. Also, the hierarchical features provide fine representations that helps the reconstruction of details. Additionally, we utilize the hierarchical depth maps generated by cascade MVSNet to constrain the sampling process, ensuring that the sampled points are concentrated near the scene surface. Such sampling strategy filtering out numerous useless sampling points and improving both the sampling efficiency and rendering quality. Unlike previous generalized methods, we employ a new weight function proposed by Neus to eliminate inherent biases in the density field, disentangling the prediction of color and density with a signed distance field. Extensive experiments have demonstrated that our proposed method significantly improves the rendering quality and outperforms previous methods.

A Hierarchical Generative Model For Overcomplete Topographic Representations In Natural Images

A Hierarchical Generative ModelforOvercomplete Topographic Representations Innatural Images

Image Denoising Based on Overcomplete Topographic Sparse Coding.

Statistically Adaptive Image Denoising Based on Overcomplete Topographic Sparse Coding.

Learning Topographic Sparse Coding through Similarity Function

Overcomplete Topographic Independent Component Analysis

Topographic product models applied to natural scene statistics

A Hierarchical Latent Topic Model Based on Sparse Coding

Hierarchical Sparse Learning with Spectral-Spatial Information for Hyperspectral Imagery Denoising.

Inducing Hierarchical Compositional Model by Sparsifying Generator Network

Mixed Poisson-Gaussian Noise Model Based Sparse Denoising for Hyperspectral Imagery.

Learning a Model-Based Deep Hyperspectral Denoiser from a Single Noisy Hyperspectral Image.

Hierarchical Sparse Coding from a Bayesian Perspective.

Hierarchical Superpixel Relation Graph Combined with Convolutional Sparse Coding for Self-Supervised Hyperspectral Image Denoising

Generative Hierarchical Learning of Sparse FRAME Models

Unsupervised learning of compositional sparse code for natural image representation

Hierarchical Gaussianization for Image Classification

Generalizable Neural Radiance Field with Hierarchical Geometry Constraint.

Unsupervised Monocular Depth Estimation Based on Hierarchical Feature-Guided Diffusion

Bayesian Sparse Hierarchical Model for Image Denoising.