Abstract:Reading dirty license plates accurately in moving vehicles is challenging for automatic license plate recognition systems. Moreover, license plates are often intentionally tampered with a malicious intent to avoid police apprehension. Usually, such groups and individuals know how to fool the existing recognition systems by making minor unnoticeable plate changes. Designing and developing deep learning methods resilient to such real-world 'attack' practices remains an active research problem. As a solution, this work develops a resilient method to recognize license plate characters. Extracting 1057 character images from 160 Nepalese vehicles, as the first step, we trained several standard deep convolutional neural networks to obtain 99.5% character classification accuracy. On adversarial images generated to simulate malicious tampering, however, our model's accuracy dropped to 25%. Next, we enriched our dataset by generating and adding geometrically masked images, retrained our models, and investigated the models' predictions. The proposed approach of training with generated adversarial images helped our adversarial attack-aware license plate character recognition (AA-LPCR) model achieves an accuracy of 99.7%. This near-perfect accuracy demonstrates that the proposed idea of random geometric masking is highly effective for improving the accuracy of license plate recognition models. Furthermore, by performing interpretability studies to understand why our models work, we identify and highlight attack-prone regions in the input character images. In sum, although Nepal's embossed license plate detection systems are vulnerable to malicious attacks, our findings suggest that these systems can be upgraded to close to 100% resilience.

RoLMA: A Practical Adversarial Attack Against Deep Learning-Based LPR Systems.

Spot evasion attacks: Adversarial examples for license plate recognition systems with convolutional neural networks

PLA-LiDAR: Physical Laser Attacks Against LiDAR-based 3D Object Detection in Autonomous Vehicle.

Laser-Based LiDAR Spoofing: Effects Validation, Capability Quantification, and Countermeasures

Adversarial Robustness Analysis of LiDAR-included Models in Autonomous Driving

Leveraging Model Poisoning Attacks on License Plate Recognition Systems

Robust Roadside Physical Adversarial Attack Against Deep Learning in Lidar Perception Modules

Adversarial sample generation and training using geometric masks for accurate and resilient license plate character recognition

Adversarial Objects Against LiDAR-Based Autonomous Driving Systems

Building Towards "Invisible Cloak": Robust Physical Adversarial Attack on YOLO Object Detector

You Can't See Me: Physical Removal Attacks on LiDAR-based Autonomous Vehicles Driving Frameworks

Stealthy and Effective Physical Adversarial Attacks in Autonomous Driving

Robust Korean License Plate Recognition Based on Deep Neural Networks

RFLA: A Stealthy Reflected Light Adversarial Attack in the Physical World

Towards Robust LiDAR-based Perception in Autonomous Driving: General Black-box Adversarial Sensor Attack and Countermeasures

Security of Deep Learning based Lane Keeping System under Physical-World Adversarial Attack

Towards Robust Physical-world Backdoor Attacks on Lane Detection

Rolling Colors: Adversarial Laser Exploits against Traffic Light Recognition

ADoPT: LiDAR Spoofing Attack Detection Based on Point-Level Temporal Consistency

Adversarial Laser Spot: Robust and Covert Physical-World Attack to DNNs

Less is More: A Stealthy and Efficient Adversarial Attack Method for DRL-based Autonomous Driving Policies