Abstract: Numerous diffusion models have recently been applied to image synthesis and editing. However, editing 3D scenes is still in its early stages. It poses various challenges, such as the requirement to design specific methods for different editing types, retraining new models for various 3D scenes, and the absence of convenient human interaction during editing. To tackle these issues, we introduce a text-driven editing method, termed DN2N, which allows for the direct acquisition of a NeRF model with universal editing capabilities, eliminating the requirement for retraining. Our method employs off-the-shelf text-based editing models of 2D images to modify the 3D scene images, followed by a filtering process to discard poorly edited images that disrupt 3D consistency. We then consider the remaining inconsistency as a problem of removing noise perturbation, which can be solved by generating training data with similar perturbation characteristics for training. We further propose cross-view regularization terms to help the generalized NeRF model mitigate these perturbations. Our text-driven method allows users to edit a 3D scene with their desired description, which is more friendly, intuitive, and practical than prior works. Empirical results show that our method achieves multiple editing types, including but not limited to appearance editing, weather transition, material changing, and style transfer. Most importantly, our method generalizes well with editing abilities shared among a set of model parameters without requiring a customized editing model for some specific scenes, thus inferring novel views with editing effects directly from user input. The project website is available at http://sk-fun.fun/DN2N

SpaceEditing: Integrating Human Knowledge into Deep Neural Networks via Interactive Latent Space Editing

LatentEditor: Text Driven Local Editing of 3D Scenes

NeuMesh: Learning Disentangled Neural Mesh-Based Implicit Field for Geometry and Texture Editing.

Learning from AI: An Interactive Learning Method Using a DNN Model Incorporating Expert Knowledge as a Teacher

The two-way knowledge interaction interface between humans and neural networks

Learning Naturally Aggregated Appearance for Efficient 3D Editing

Edit3D: Elevating 3D Scene Editing with Attention-Driven Multi-Turn Interactivity

DeltaSpace: A Semantic-aligned Feature Space for Flexible Text-guided Image Editing

CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization

DesignEdit: Multi-Layered Latent Decomposition and Fusion for Unified & Accurate Image Editing

Neural Face Editing with Intrinsic Image Disentangling

ED-NeRF: Efficient Text-Guided Editing of 3D Scene with Latent Space NeRF

NeuralSI: Neural Design of Semantic Interaction for Interactive Deep Learning

Deep Recursive Embedding for High-Dimensional Data

Latent Subspace Clustering based on Deep Neural Networks

Learning to Infer Semantic Parameters for 3D Shape Editing

Text-driven Editing of 3D Scenes without Retraining

GSEditPro: 3D Gaussian Splatting Editing with Attention‐based Progressive Localization

Efficient Integration of Neural Representations for Dynamic Humans

How to Explain Neural Networks: A perspective of data space division

Interpretable Latent Spaces for Learning from Demonstration