Abstract:Large Language Models (LLMs) have demonstrated remarkable performance across various natural language processing (NLP) tasks. However, their practical usability is often compromised by a propensity to generate toxic content, such as insults, threats, and profanity, particularly in response to adversarial prompts. Several fine-tuning and decoding approaches have been employed to address this challenge to mitigate toxicity. Nevertheless, these methods typically necessitate additional resources, such as high-quality training data or auxiliary models, thereby incurring extra costs. In this paper, we propose a novel detoxification framework, Fine-Grained Detoxification via Instance-Level Prefixes (FGDILP), which effectively mitigates the generation of toxic text without incurring additional training costs. Specifically, FGDILP leverages contextualized representations in attention space by contrasting a positive prefix-prepended prompt against multiple negative prefix-prepended prompts at the instance level. This methodology facilitates the construction of fine-grained subtoxicity vectors, which are subsequently fused to adjust the original generation pathway when responding to raw prompts. Our results demonstrate that FGDILP enables controlled text generation concerning detoxification at both the utterance and context levels. While our method slightly impacts generation fluency and diversity, it significantly outperforms prompt-based baselines regarding detoxification effectiveness. Our code is available at https://github.com/xinykou/FGDILP .

Multilingual Text Detoxification Using Google Cloud Translation and Post-Processing

Exploring Methods for Cross-lingual Text Style Transfer: The Case of Text Detoxification

A Multilingual Text Detoxification Method Based on Few-shot Learning and CO-STAR Framework

Exploring Cross-lingual Textual Style Transfer with Large Multilingual Language Models

SmurfCat at PAN 2024 TextDetox: Alignment of Multilingual Transformers for Text Detoxification

GPT-DETOX: An In-Context Learning-Based Paraphraser for Text Detoxification

MultiParaDetox: Extending Text Detoxification with Parallel Data to New Languages

DetoxLLM: A Framework for Detoxification with Explanations

Text Detoxification as Style Transfer in English and Hindi

Methods for Detoxification of Texts for the Russian Language

Fine-grained detoxification framework via instance-level prefixes for large language models

Text Detoxification using Large Pre-trained Neural Models

Detoxifying Text with MaRCo: Controllable Revision with Experts and Anti-Experts

A Study of Multilingual Toxic Text Detection Approaches under Imbalanced Sample Distribution

DiffuDetox: A Mixed Diffusion Model for Text Detoxification

Challenges in Detoxifying Language Models

Mitigating Text Toxicity with Counterfactual Generation

Self-Detoxifying Language Models via Toxification Reversal

Russian Texts Detoxification with Levenshtein Editing

CMD: a framework for Context-aware Model self-Detoxification

Simple Text Detoxification by Identifying a Linear Toxic Subspace in Language Model Embeddings