Abstract:License plate detection (LPD) is the first and key step in license plate recognition. State-of-the-art object-detection algorithms based on deep learning provide a promising form of LPD. However, there still exist two main challenges. First, existing methods often enclose objects with horizontal rectangles. However, horizontal rectangles are not always suitable since license plates in images are multi-oriented, reflected by rotation and perspective distortion. Second, the scale of license plates often varies, leading to the difficulty of multi-scale detection. To address the aforementioned problems, we propose a novel method of multi-oriented and scale-invariant license plate detection (MOSI-LPD) based on convolutional neural networks. Our MOSI-LPD tightly encloses the multi-oriented license plates with bounding parallelograms, regardless of the license plate scales. To obtain bounding parallelograms, we first parameterize the edge points of license plates by relative positions. Next, we design mapping functions between oriented regions and horizontal proposals. Then, we enforce the symmetry constraints in the loss function and train the model with a multi-task loss. Finally, we map region proposals to three edge points of a nearby license plate, and infer the fourth point to form bounding parallelograms. To achieve scale invariance, we first design anchor boxes based on inherent shapes of license plates. Next, we search different layers to generate region proposals with multiple scales. Finally, we up-sample the last layer and combine proposal features extracted from different layers to recognize true license plates. Experimental results have demonstrated that the proposed method outperforms existing approaches in terms of detecting license plates with different orientations and multiple scales.

Local Tiled Deep Networks for Recognition of Vehicle Make and Model

Efficient but Lightweight Network for Vehicle Re-Identification with Center-Constraint Loss

Vehicle Behavior Recognition using Multi-Stream 3D Convolutional Neural Network

Category-consistent Deep Network Learning for Accurate Vehicle Logo Recognition

Framework for Vehicle Make and Model Recognition-A New Large-Scale Dataset and an Efficient Two-Branch-Two-Stage Deep Learning Architecture

Fine-grained Vehicle Recognition Using Lightweight Convolutional Neural Network with Combined Learning Strategy

Fine-Grained Vehicle Model Recognition Using A Coarse-to-Fine Convolutional Neural Network Architecture

Unsupervised Feature Learning Toward a Real-time Vehicle Make and Model Recognition

LR-CNN: Local-aware Region CNN for Vehicle Detection in Aerial Imagery

CNN-RNN Based Method for License Plate Recognition.

A Multilayer Pyramid Network Based on Learning for Vehicle Logo Recognition

Recognition of vehicle license plates in highway scenes with deep fusion network and connectionist temporal classification

Vehicle re-identification for a parking lot toll system using convolutional neural networks

Real time mobile based license plate recognition system with neural networks

A CNN-Based Approach for Automatic License Plate Recognition in the Wild

Toward End-to-End Car License Plate Detection and Recognition with Deep Neural Networks.

Robust Korean License Plate Recognition Based on Deep Neural Networks

Fine-grained vehicle type classification using lightweight convolutional neural network with feature optimization and joint learning strategy

Applying Ternion Stream DCNN for Real-Time Vehicle Re-Identification and Tracking across Multiple Non-Overlapping Cameras

Multi-Oriented and Scale-Invariant License Plate Detection Based on Convolutional Neural Networks

Reading Car License Plates Using Deep Convolutional Neural Networks and LSTMs