Abstract:Tags are pivotal in facilitating the effective distribution of multimedia content in various applications in the contemporary Internet era, such as search engines and recommendation systems. Recently, large language models (LLMs) have demonstrated impressive capabilities across a wide range of tasks. In this work, we propose TagGPT, a fully automated system capable of tag extraction and multimodal tagging in a completely zero-shot fashion. Our core insight is that, through elaborate prompt engineering, LLMs are able to extract and reason about proper tags given textual clues of multimodal data, e.g., OCR, ASR, title, etc. Specifically, to automatically build a high-quality tag set that reflects user intent and interests for a specific application, TagGPT predicts large-scale candidate tags from a series of raw data via prompting LLMs, filtered with frequency and semantics. Given a new entity that needs tagging for distribution, TagGPT introduces two alternative options for zero-shot tagging, i.e., a generative method with late semantic matching with the tag set, and another selective method with early matching in prompts. It is well noticed that TagGPT provides a system-level solution based on a modular framework equipped with a pre-trained LLM (GPT-3.5 used here) and a sentence embedding model (SimCSE used here), which can be seamlessly replaced with any more advanced one you want. TagGPT is applicable for various modalities of data in modern social media and showcases strong generalization ability to a wide range of applications. We evaluate TagGPT on publicly available datasets, i.e., Kuaishou and <a class="link-external link-http" href="http://Food.com" rel="external noopener nofollow">this http URL</a>, and demonstrate the effectiveness of TagGPT compared to existing hashtags and off-the-shelf taggers. Project page: <a class="link-external link-https" href="https://github.com/TencentARC/TagGPT" rel="external noopener nofollow">this https URL</a>.

TAGIFY: LLM-powered Tagging Interface for Improved Data Findability on OGD portals

TagNetLens: multiscale visualization of knowledge structures in social tags

TagGPT: Large Language Models are Zero-shot Multimodal Taggers

An Integrated Usability Framework for Evaluating Open Government Data Portals: Comparative Analysis of EU and GCC Countries

Bridging the Gap: Unravelling Local Government Data Sharing Barriers in Estonia and Beyond

From an Integrated Usability Framework to Lessons on Usability and Performance of Open Government Data Portals: A Comparative Study of European Union and Gulf Cooperation Council Countries

Challenges of Linking Organizational Information in Open Government Data to Knowledge Graphs

Upper Tag Ontology (UTO) For Integrating Social Tagging Data

A Connector for Integrating NGSI-LD Data into Open Data Portals

Ontology-Based Semantic Search for Open Government Data

GEDIT: Geographic-Enhanced and Dependency-Guided Tagging for Joint POI and Accessibility Extraction at Baidu Maps

Automating the Identification of High-Value Datasets in Open Government Data Portals

#InsTag: Instruction Tagging for Analyzing Supervised Fine-tuning of Large Language Models

ProcTag: Process Tagging for Assessing the Efficacy of Document Instruction Data

Optimizing Text Clustering Efficiency through Flexible Latent Dirichlet Allocation Method: Exploring the Impact of Data Features and Threshold Modification

TAGLAS: An atlas of text-attributed graph datasets in the era of large graph and language models

Know Your RAG: Dataset Taxonomy and Generation Strategies for Evaluating RAG Systems

CurateGPT: A flexible language-model assisted biocuration tool

Complete Semantics to empower Touristic Service Providers

A State-of-the-Art Analysis of the Current Public Data Landscape from a Functional, Semantic and Technical Perspective