Abstract:As consumer Virtual Reality (VR) and Mixed Reality (MR) technologies gain momentum, there's a growing focus on the development of engagements with 3D virtual content. Unfortunately, traditional techniques for content creation, editing, and interaction within these virtual spaces are fraught with difficulties. They tend to be not only engineering-intensive but also require extensive expertise, which adds to the frustration and inefficiency in virtual object manipulation. Our proposed VR-GS system represents a leap forward in human-centered 3D content interaction, offering a seamless and intuitive user experience. By developing a physical dynamics-aware interactive Gaussian Splatting in a Virtual Reality setting, and constructing a highly efficient two-level embedding strategy alongside deformable body simulations, VR-GS ensures real-time execution with highly realistic dynamic responses. The components of our Virtual Reality system are designed for high efficiency and effectiveness, starting from detailed scene reconstruction and object segmentation, advancing through multi-view image in-painting, and extending to interactive physics-based editing. The system also incorporates real-time deformation embedding and dynamic shadow casting, ensuring a comprehensive and engaging virtual experience.Our project page is available at:

Research on 3D Simulation Software Based on OpenGVS

Simulation on Robot Assembly Based on OpenGL

Real-time Simulation System of Satellite and Outer Space Scene

Visualization Simulation of Mission Planning Schemes for Remote Sensing Satellites

Implementation of 3D Graphical Simulation of Robot

Research and Exploitation of NC Manufacturing 3D Simulation System Based on OpenGL

Research and Development of OpenGL-based Construction Virtual Simulation Platform

Development of the 3D Simulation System of Hushan based on OpenGVS

A GIS-based 3D Visual Simulation System for Flood Protection

Research on the Modeling Methods for Visual Simulation System Based on Multigen Creator

3D visual simulation in traffic simulation

Research of Simulation Missile Defense System Based on Vega

VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality

Design of Computer Simulation Graphic User Interface Program Using OpenGL in the Missile 3D Model

Study on Modeling of the Common Three-Dimension Visual System of Railway Simulation

Research on real-time scene driving based on dual-engine of Open Inventor

Script-based 3D Flight Simulation Technology and Its Application in Mineral Resources Management

3D battlefield modeling and simulation of war games

Study on Special Effects Simulation in Virtual Battlefield Environment

Construction of Interactive Virtual 3D Accident Scene Based O OpenGL

Realization of Virtual Instruments Based on OpenGVS