Abstract:With the widespread use of mobile Internet, mobile payment has become a part of daily life, and bank card recognition in natural scenes has become a hot topic. Although printed character recognition has achieved remarkable success in recent years, bank card recognition is not limited to traditional printed character recognition. There are two types of bank cards: unembossed bank cards, such as most debit cards which usually use printed characters, and embossed bank cards, such as most credit cards which mainly use raised characters. Recognition of raised characters is very challenging due to its own characteristics, and there is a lack of fast and good methods to handle it. To better recognize raised characters, we propose an effective method based on deep learning to detect and recognize bank cards in complex natural scenes. The method can accurately recognize the card number characters on embossed and unembossed bank cards. First, to break the limitation that YOLOv3 algorithm is usually used for object detection, we propose a novel approach that enables YOLOv3 to be used not only for bank card detection and classification, but also for character recognition. The CANNYLINES algorithm is used for rectification and the Scharr operator is introduced to locate the card number region. The proposed method can satisfy bank card detection, classification and character recognition in complex natural scenes, such as complex backgrounds, distorted card surfaces, uneven illumination, and characters with the same or similar color to the background. To further improve the recognition accuracy, a printed character recognition model based on ResNet-32 is proposed for the unembossed bank cards. According to the color and morphological characteristics of embossed bank cards, raised character recognition model combining traditional morphological methods and LeNet-5 convolutional neural network is proposed for the embossed bank cards. The experimental results on the collected bank card dataset and bank card number dataset show that our proposed method can effectively detect and identify different types of bank cards. The accuracy of the detection and classification of bank cards reaches 100%. The accuracy of the raised characters recognition on the embossed bank card is 99.31%, and the accuracy of the printed characters recognition on the unembossed bank card reaches 100%.

Overview of Currency Recognition Using Deep Learning

Currency Detection and Recognition Based on Deep Learning

Banknote Serial Number Recognition Using Deep Learning

Visual Watermark Identification From the Transparent Window of Currency by Using Deep Learning

An empirical approach for currency identification

Real-Time Recognition Of Series Seven New Zealand Banknotes

Fast‐moving Coin Recognition Using Deep Learning

The State-of-the-Art Technology of Currency Identification

BankNote-Net: Open dataset for assistive universal currency recognition

An empirical approach for digital currency forensics

Deep Learning-Based Multinational Banknote Type and Fitness Classification with the Combined Images by Visible-Light Reflection and Infrared-Light Transmission Image Sensors

Real-time Yemeni Currency Detection

The State-of-the-Art Technology of Currency Identification: A Comparative Study.

A Deep Learning Based Bank Card Detection and Recognition Method in Complex Scenes

Banknote Recognition for Visually Impaired People (Case of Ethiopian note)

A survey of deep learning applications in cryptocurrency

Deep Learning Approach Combining Lightweight CNN Architecture with Transfer Learning: An Automatic Approach for the Detection and Recognition of Bangladeshi Banknotes

BANK NOTE VALUE CHECKER BASED ON IMAGE RECOGNITION

Deep Learning For Optical Character Recognition And Its Application To Vat Invoice Recognition

Currency image recognition combining high-order statistics and local geometric characteristics

Automatic Recognition of Serial Numbers in Bank Notes