Abstract:Tags are pivotal in facilitating the effective distribution of multimedia content in various applications in the contemporary Internet era, such as search engines and recommendation systems. Recently, large language models (LLMs) have demonstrated impressive capabilities across a wide range of tasks. In this work, we propose TagGPT, a fully automated system capable of tag extraction and multimodal tagging in a completely zero-shot fashion. Our core insight is that, through elaborate prompt engineering, LLMs are able to extract and reason about proper tags given textual clues of multimodal data, e.g., OCR, ASR, title, etc. Specifically, to automatically build a high-quality tag set that reflects user intent and interests for a specific application, TagGPT predicts large-scale candidate tags from a series of raw data via prompting LLMs, filtered with frequency and semantics. Given a new entity that needs tagging for distribution, TagGPT introduces two alternative options for zero-shot tagging, i.e., a generative method with late semantic matching with the tag set, and another selective method with early matching in prompts. It is well noticed that TagGPT provides a system-level solution based on a modular framework equipped with a pre-trained LLM (GPT-3.5 used here) and a sentence embedding model (SimCSE used here), which can be seamlessly replaced with any more advanced one you want. TagGPT is applicable for various modalities of data in modern social media and showcases strong generalization ability to a wide range of applications. We evaluate TagGPT on publicly available datasets, i.e., Kuaishou and <a class="link-external link-http" href="http://Food.com" rel="external noopener nofollow">this http URL</a>, and demonstrate the effectiveness of TagGPT compared to existing hashtags and off-the-shelf taggers. Project page: <a class="link-external link-https" href="https://github.com/TencentARC/TagGPT" rel="external noopener nofollow">this https URL</a>.

A Light Sliding-Window Part-of-Speech Tagger for the Apertium Free/Open-Source Machine Translation Platform

Incorporating External POS Tagger for Punctuation Restoration

Recent advances in Apertium, a free/open-source rule-based machine translation platform for low-resource languages

Research on Annotation Rules and Recognition Algorithm Based on Phrase Window

A Modality Lexicon and its use in Automatic Tagging

Towards Accurate and Efficient Chinese Part-of-Speech Tagging.

Assessing the potential of LLM-assisted annotation for corpus-based pragmatics and discourse analysis: The case of apology

Capturing Paradigmatic and Syntagmatic Lexical Relations: Towards Accurate Chinese Part-of-Speech Tagging.

Part of speech tagging of grammatical features related to L2 Chinese development: A case analysis of Stanza in the L2 writing context

Exploiting Lexical Information for Function Tag Labeling

A preliminary study of lexical density for the development of xml-based discourse structure tagger

A Multi-input Chinese Part of Speech Tagging System Based on Cascaded Finite State Automaton

Embedded Machine Learning Systems For Robust Spoken Language Parsing

SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation

AE TextSpotter: Learning Visual and Linguistic Representation for Ambiguous Text Spotting

TagGPT: Large Language Models are Zero-shot Multimodal Taggers

A unified framework for text analysis in chinese TTS

The equilibrium shape of InAs quantum dots grown on a GaAs(001) substrate

Transition-Based Disfluency Detection Using LSTMs.

A Model with Length-Variable Attention for Spoken Language Understanding

Unveiling the Potential of LLM-Based ASR on Chinese Open-Source Datasets