Abstract:The creation of 3D scenes has traditionally been both labor-intensive and costly, requiring designers to meticulously configure 3D assets and environments. Recent advancements in generative AI, including text-to-3D and image-to-3D methods, have dramatically reduced the complexity and cost of this process. However, current techniques for editing complex 3D scenes continue to rely on generally interactive multi-step, 2D-to-3D projection methods and diffusion-based techniques, which often lack precision in control and hamper real-time performance. In this work, we propose 3DSceneEditor, a fully 3D-based paradigm for real-time, precise editing of intricate 3D scenes using Gaussian Splatting. Unlike conventional methods, 3DSceneEditor operates through a streamlined 3D pipeline, enabling direct manipulation of Gaussians for efficient, high-quality edits based on input <a class="link-external link-http" href="http://prompts.The" rel="external noopener nofollow">this http URL</a> proposed framework (i) integrates a pre-trained instance segmentation model for semantic labeling; (ii) employs a zero-shot grounding approach with CLIP to align target objects with user prompts; and (iii) applies scene modifications, such as object addition, repositioning, recoloring, replacing, and deletion directly on Gaussians. Extensive experimental results show that 3DSceneEditor achieves superior editing precision and speed with respect to current SOTA 3D scene editing approaches, establishing a new benchmark for efficient and interactive 3D scene customization.

A General Design Pattern for Programs of Scene Graph and its Application in a Simulation Instance

An Integrated Method of 3D Garment Design

PENCIL: A Framework for Expressing Free-Hand Sketching in 3D

Implementation of 3D Graphical Simulation of Robot

Application of Design Patterns in Data Acquisition System

DIScene: Object Decoupling and Interaction Modeling for Complex Scene Generation

Building High Performance DVR Via HLA, Scene Graph and Parallel Rendering.

The Bare Necessities: Designing Simple, Effective Open-Vocabulary Scene Graphs

DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Sampling

DAG Pattern Reuse Technology for Parallel Application Programs

An Object-Oriented Framework for Designing Reusable and Maintainable DEVS Models using Design Patterns

Sketch2Scene: Automatic Generation of Interactive 3D Game Scenes from User's Casual Sketches

The Research of Design Patterns on the Development of GIS Software

3DSceneEditor: Controllable 3D Scene Editing with Gaussian Splatting

DPVO: Design Pattern Detection Using Vertex Ordering a Case Study in JHotDraw with Documentation to Improve Reusability

Visual-perception-driven Urban Three-dimensional Scene Data Scheduling Method

Distributed Pipeline Programming Framework for State-Based Pattern

Design of 3D Real-Time Visualization Simulation System Based on STK

Design and Implementation of Object-Oriented 3D Graphics Engine

Improving Usability of Interactive Graphics Specification and Implementation with Picking Views and Inverse Transformations

Data Parallel Program Design