Abstract:Volumetric video streaming offers immersive 3D experiences but faces significant challenges due to high bandwidth requirements and latency issues in transmitting detailed content in real time. Traditional methods like point cloud streaming compromise visual quality when zoomed in, and neural rendering techniques are too computationally intensive for real-time use. Though mesh-based streaming stands out by preserving surface detail and connectivity, offering a more refined representation for 3D content, traditional mesh streaming methods typically transmit data on a per-frame basis, failing to take full advantage of temporal redundancies across frames. This results in inefficient bandwidth usage and poor adaptability to fluctuating network conditions. We introduce Deformation-based Adaptive Volumetric Video Streaming, a novel framework that enhances volumetric video streaming performance by leveraging the inherent deformability of mesh-based representations. DeformStream uses embedded deformation to reconstruct subsequent frames from inter-frame motion, significantly reducing bandwidth usage while ensuring visual coherence between frames. To address frame reconstruction overhead and network adaptability, we formulate a new QoE model that accounts for client-side deformation latency and design a dynamic programming algorithm to optimize the trade-off between visual quality and bandwidth consumption under varying network conditions. Our evaluation demonstrates that Deformation-based Adaptive Volumetric Video Streaming outperforms existing mesh-based streaming systems in both bandwidth efficiency and visual quality, offering a robust solution for real-time volumetric video applications.

Streaming transmission of point-sampled geometry based on view-dependent level-of-detail

Efficient Streaming of Point-Based Models for Interactive 3-D Geometry Transmission

Large-Scale Model Rendering System Based on Network Streaming

A Novel Pre-Process Method of Raw Point Data for Real-Time Complex Scenes Rendering

Progressive streaming of massive terrain data

Progressive transmission of point set surfaces based on geometry image representation.

Efficient screen space approach for high complex dynamic scenes in real-time rendering

Image Transmission Method Based on Prediction Reconstruction and Progressive Remote Rendering

An Easy Viewer for Out-of-Core Visualization of Huge Point-Sampled Models

Rendering of Huge Point-Sampled Geometry Based on LOD Control and Out-of-Core Techniques

High Quality Real-Time Rendering of Large Scale Point Model

Interactive Transmission of Highly Detailed Surfaces.

View-Dependent Progressive Transmission Method for 3D Building Models

View-Dependent Progressive Transmission of Highly Detailed Surfaces

Progressive Frame Patching for FoV-based Point Cloud Video Streaming

Balancing Cpu And Gpu: Real-Time Visualization Of Large Scale 3d Scanning Models

Structure-Level 3D Building Model Encoding Method for Progressive Transmission

DeformStream: Deformation-based Adaptive Volumetric Video Streaming

Adaptive voxels: interactive rendering of massive 3D models

Instant Reality: Gaze-Contingent Perceptual Optimization for 3D Virtual Reality Streaming

Progressive transmission of GIS vector spatial data over Internet