Abstract:Generating multi-view images based on text or single-image prompts is a critical capability for the creation of 3D content. Two fundamental questions on this topic are what data we use for training and how to ensure multi-view consistency. This paper introduces a novel framework that makes fundamental contributions to both questions. Unlike leveraging images from 2D diffusion models for training, we propose a dense consistent multi-view generation model that is fine-tuned from off-the-shelf video generative models. Images from video generative models are more suitable for multi-view generation because the underlying network architecture that generates them employs a temporal module to enforce frame consistency. Moreover, the video data sets used to train these models are abundant and diverse, leading to a reduced train-finetuning domain gap. To enhance multi-view consistency, we introduce a 3D-Aware Denoising Sampling, which first employs a feed-forward reconstruction module to get an explicit global 3D model, and then adopts a sampling strategy that effectively involves images rendered from the global 3D model into the denoising sampling loop to improve the multi-view consistency of the final images. As a by-product, this module also provides a fast way to create 3D assets represented by 3D Gaussians within a few seconds. Our approach can generate 24 dense views and converges much faster in training than state-of-the-art approaches (4 GPU hours versus many thousand GPU hours) with comparable visual quality and consistency. By further fine-tuning, our approach outperforms existing state-of-the-art methods in both quantitative metrics and visual effects. Our project page is

AutoView: an Autonomous Materialized View Management System with Encoder-Reducer

An Autonomous Materialized View Management System with Deep Reinforcement Learning.

Automatic View Generation with Deep Learning and Reinforcement Learning.

Graph-Attention-Network-Based Cost Estimation Model in Materialized View Environment

Incremental Materialized View Maintenance On Distributed Log-Structured Merge-Tree

Multi-view Video Coding Based on View Prediction

Multilevel MVU Models with Localized Construction for Monitoring Processes with Large Scale Data

CAMVR: Context-Adaptive Multi-View Representation Learning for Dense Retrieval

MV2MAE: Multi-View Video Masked Autoencoders

Self-Supervised Multi-View Learning via Auto-Encoding 3D Transformations

MV4PG: Materialized Views for Property Graphs

Optimized Design of Materialized Views in a Real-Life Data Warehousing Environment

Materialized View Replacement using Markovs Analysis

Research on Materialized View Selection: Research on Materialized View Selection

Extended Derivation Cube Based View Materialization Selection in Distributed Data Warehouse

Data Mining-based Materialized View and Index Selection in Data Warehouses

MV-Map: Offboard HD-Map Generation with Multi-view Consistency

VideoMV: Consistent Multi-View Generation Based on Large Video Generative Model

Design and Selection of Materialized Views in a Data Warehousing Environment: a Case Study

MV-VVQA: Multi-View Learning for No-Reference Volumetric Video Quality Assessment