Abstract:Video text spotting (VTS) aims to simultaneously localize, recognize and track text instances in videos. To address the limited recognition capability of end-to-end methods, recent methods track the zero-shot results of state-of-the-art image text spotters directly, and achieve impressive performance. However, owing to the domain gap between different datasets, these methods usually obtain limited tracking trajectories on extreme dataset. Fine-tuning transformer-based text spotters on specific datasets could yield performance enhancements, albeit at the expense of considerable training resources. In this paper, we propose a Language Collaboration and Glyph Perception Model, termed LOGO, an innovative framework designed to enhance the performance of conventional text spotters. To achieve this goal, we design a language synergy classifier (LSC) to explicitly discern text instances from background noise in the recognition stage. Specially, the language synergy classifier can output text content or background code based on the legibility of text regions, thus computing language scores. Subsequently, fusion scores are computed by taking the average of detection scores and language scores, and are utilized to re-score the detection results before tracking. By the re-scoring mechanism, the proposed LSC facilitates the detection of low-resolution text instances while filtering out text-like regions. Moreover, the glyph supervision is introduced to enhance the recognition accuracy of noisy text regions. In addition, we propose the visual position mixture module, which can merge the position information and visual features efficiently, and acquire more discriminative tracking features. Extensive experiments on public benchmarks validate the effectiveness of the proposed method.

A Robust Method for TV Logo Tracking in Video Streams

Automatic TV logo detection, tracking and removal in broadcast video

Automatic video logo detection and removal

Automatic location and removal of video logos

Spatial HOG based TV logo detection

A Reliable Logo and Replay Detector for Sports Video

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

Video Logo Retrieval based on local Features

TV station logo training method and identification method

Mutual Enhancement For Detection Of Multiple Logos In Sports Videos

Multi-features Guided Robust Visual Tracking.

An adaptive representation algorithm for Multi-scale logo detection

Logo Detection Based on Spatial-Spectral Saliency and Partial Spatial Context

Tracking in Multimedia Data Via Robust Reweighted Local Multi-Task Sparse Representation for Transportation Surveillance

Erasing Video Logos Based On Image Inpainting

Video Identification Using Spatio-temporal Salient Points

Robust Commercial Retrieval in Video Streams

Deep Learning for Logo Detection: A Survey

A Multimodal Scheme for Program Segmentation and Representation in Broadcast Video Streams.

An Effective and Robust Detector for Logo Detection

LOGO: Video Text Spotting with Language Collaboration and Glyph Perception Model