GS-Blur: A 3D Scene-Based Dataset for Realistic Image Deblurring

Dongwoo Lee,Joonkyu Park,Kyoung Mu Lee

2024-10-31

Abstract:To train a deblurring network, an appropriate dataset with paired blurry and sharp images is essential. Existing datasets collect blurry images either synthetically by aggregating consecutive sharp frames or using sophisticated camera systems to capture real blur. However, these methods offer limited diversity in blur types (blur trajectories) or require extensive human effort to reconstruct large-scale datasets, failing to fully reflect real-world blur scenarios. To address this, we propose GS-Blur, a dataset of synthesized realistic blurry images created using a novel approach. To this end, we first reconstruct 3D scenes from multi-view images using 3D Gaussian Splatting (3DGS), then render blurry images by moving the camera view along the randomly generated motion trajectories. By adopting various camera trajectories in reconstructing our GS-Blur, our dataset contains realistic and diverse types of blur, offering a large-scale dataset that generalizes well to real-world blur. Using GS-Blur with various deblurring methods, we demonstrate its ability to generalize effectively compared to previous synthetic or real blur datasets, showing significant improvements in deblurring performance.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the lack of data sets in single - image deblurring. Existing deblurring data sets are mainly generated by two methods: synthetic methods and real - world methods. Synthetic methods usually simulate motion blur by aggregating consecutive clear frames, but the blurred images generated by this method are quite different from the blurs in the real world and are difficult to generalize to practical applications. Real - world methods use complex camera systems to capture real blurred images. Although the generated blurs are closer to the real situation, these methods rely on specific camera models and require a great deal of manual effort to reconstruct large - scale data sets, which limits their diversity and generalization ability.

To overcome these limitations, the authors propose a new data set named GS - Blur. GS - Blur is generated through the following steps:

1. **3D Scene Reconstruction**: Reconstruct the 3D scene using multi - view images and 3D Gaussian Splatting (3DGS) technology.
2. **Blurred Image Rendering**: From the reconstructed 3D scene, render blurred images by moving the camera view along randomly generated motion trajectories. Specifically, the camera view at a fixed position is used to generate clear images, while the camera view at a moving position is used to generate blurred images.
3. **Diversified Blur Trajectories**: By adopting a variety of camera motion trajectories, the GS - Blur data set contains diversified blur types, covering blurs of different lengths and directions.

Through these steps, the GS - Blur data set not only provides large - scale pairs of blurred images, but also can better reflect the blurring situation in the real world, thereby improving the generalization ability and performance of the deblurring model. Experimental results show that the deblurring model trained with GS - Blur performs well on multiple benchmark data sets, especially when dealing with real - world blurred images.