A Dataset and Model for Realistic License Plate Deblurring

Haoyan Gong,Yuzheng Feng,Zhenrong Zhang,Xianxu Hou,Jingxin Liu,Siqi Huang,Hongbin Liu

2024-04-23

Abstract:Vehicle license plate recognition is a crucial task in intelligent traffic management systems. However, the challenge of achieving accurate recognition persists due to motion blur from fast-moving vehicles. Despite the widespread use of image synthesis approaches in existing deblurring and recognition algorithms, their effectiveness in real-world scenarios remains unproven. To address this, we introduce the first large-scale license plate deblurring dataset named License Plate Blur (LPBlur), captured by a dual-camera system and processed through a post-processing pipeline to avoid misalignment issues. Then, we propose a License Plate Deblurring Generative Adversarial Network (LPDGAN) to tackle the license plate deblurring: 1) a Feature Fusion Module to integrate multi-scale latent codes; 2) a Text Reconstruction Module to restore structure through textual modality; 3) a Partition Discriminator Module to enhance the model's perception of details in each letter. Extensive experiments validate the reliability of the LPBlur dataset for both model training and testing, showcasing that our proposed model outperforms other state-of-the-art motion deblurring methods in realistic license plate deblurring scenarios. The dataset and code are available at

Computer Vision and Pattern Recognition,Image and Video Processing

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper aims to address the issue of motion blur in vehicle license plate recognition. Specifically, motion blur caused by high-speed vehicles makes it difficult to accurately recognize license plates, especially under low-light conditions or adverse weather. Existing image synthesis methods do not perform well in real-world scenarios. Therefore, the paper proposes a large-scale real license plate deblurring dataset (LPBlur) and a novel license plate deblurring generative adversarial network (LPDGAN) to improve the effectiveness of license plate deblurring in practical scenarios.

### Main Contributions

1. **Dataset**: Constructed a large-scale real license plate deblurring dataset named LPBlur, containing 10,288 pairs of paired images. These images were collected in various real road scenarios and corrected through a post-processing pipeline.
2. **Model**: Proposed a novel license plate deblurring generative adversarial network (LPDGAN). This model combines multi-scale feature fusion modules, text reconstruction modules, and partition discriminator modules to improve the quality and readability of deblurred images.
3. **Experimental Results**: Extensive experiments validated the effectiveness of the LPBlur dataset and the superior performance of the LPDGAN model. Particularly in real-world license plate deblurring tasks, the model significantly outperformed other state-of-the-art deblurring methods.

### Solutions

1. **Data Collection**: Used a dual-camera system, where one camera was set with a shorter exposure time to capture clear images, and the other camera was set with a longer exposure time to capture blurred images. A synchronizer ensured that both cameras started exposure simultaneously to avoid color deviation.
2. **Data Post-Processing**: Included steps such as denoising, geometric alignment, and license plate cropping to ensure the accuracy of the image pairs.
3. **Model Design**:
- **Multi-Scale Feature Extraction and Fusion Module**: Utilized Swin Transformer blocks to extract multi-scale features and fused them through Spatial Feature Transform (SFT).
- **Decoder and Discriminator**: The decoder generated clear images, while the global discriminator and partition discriminator enhanced overall image quality and character information, respectively.
- **Text Reconstruction Module**: Combined intermediate features from the decoder and fused latent codes to generate vectors for recognizing text through convolutional and linear layers. These vectors were compared with real text vectors extracted by a pre-trained CRNN model.

### Experimental Results

- **Quantitative Evaluation**: Under normal and low-light conditions, LPDGAN outperformed other state-of-the-art deblurring methods in multiple metrics, including Perceptual Loss (PerL), Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index (SSIM), and Text Levenshtein Distance (TLD).
- **Visual Comparison**: Under normal light conditions, LPDGAN effectively restored license plates severely affected by motion blur, accurately generating and reconstructing characters and numbers. Under low-light conditions, the details generated by LPDGAN were significantly better than those of other models.

### Conclusion

By constructing a large-scale real license plate deblurring dataset and proposing a novel generative adversarial network model, the paper effectively addresses the issue of motion blur in license plate recognition, with particularly outstanding performance under low-light conditions. This provides strong support for license plate recognition in intelligent traffic management systems.