Understanding movie poster: transfer-deep learning approach for graphic-rich text recognition

Mridul Ghosh,Sayan Saha Roy,Himadri Mukherjee,Sk Md Obaidullah,K. C. Santosh,Kaushik Roy
DOI: https://doi.org/10.1007/s00371-021-02094-6
IF: 2.835
2021-03-26
The Visual Computer
Abstract:Graphic-rich texts are common in posters. In a movie poster, information, such as movie title, tag lines, and names of the actors, director, and production house, is available. Graphic-rich texts in movie titles represent not only sentiments but also their genre. Understanding the poster requires graphic-rich text recognition. Prior to that, one requires text localization, so background and foreground graffiti can be well segmented. In this paper, we propose a transfer learning-based approach for graphic-rich text localization, which was tuned by introducing reverse augmentation and rotated/inclined rectangle drawing technique. A convolution neural network-based model is then applied to identify their corresponding scripts. In our experiments, on a newly developed dataset (available upon request) that is composed of movie posters with multiple scripts of 1154 images, we achieved an average accuracy of 99.30%. Our results outperformed previously developed tools that are relying on handcrafted features.
computer science, software engineering
What problem does this paper attempt to address?