Abstract:Every natural text is written in some style. Style is formed by a complex combination of different stylistic factors, including formality markers, emotions, metaphors, etc. One cannot form a complete understanding of a text without considering these factors. The factors combine and co-vary in complex ways to form styles. Studying the nature of the co-varying combinations sheds light on stylistic language in general, sometimes called cross-style language understanding. This paper provides the benchmark corpus (xSLUE) that combines existing datasets and collects a new one for sentence-level cross-style language understanding and evaluation. The benchmark contains text in 15 different styles under the proposed four theoretical groupings: figurative, personal, affective, and interpersonal groups. For valid evaluation, we collect an additional diagnostic set by annotating all 15 styles on the same text. Using xSLUE, we propose three interesting cross-style applications in classification, correlation, and generation. First, our proposed cross-style classifier trained with multiple styles together helps improve overall classification performance against individually-trained style classifiers. Second, our study shows that some styles are highly dependent on each other in human-written text. Finally, we find that combinations of some contradictive styles likely generate stylistically less appropriate text. We believe our benchmark and case studies help explore interesting future directions for cross-style research. The preprocessed datasets and code are publicly available.

Does It Capture STEL? A Modular, Similarity-based Linguistic Style Evaluation Framework

UATST: Towards Unpaired Arbitrary Text-Guided Style Transfer with Cross-Space Modulation

Evaluate and Improve the Quality of Neural Style Transfer.

Low-Level Linguistic Controls for Style Transfer and Content Preservation

Same Author or Just Same Topic? Towards Content-Independent Style Representations

Style is NOT a single variable: Case Studies for Cross-Style Language Understanding

PSST: A Benchmark for Evaluation-driven Text Public-Speaking Style Transfer

Text Style Transfer Evaluation Using Large Language Models

Style Transfer in Text: Exploration and Evaluation

LMStyle Benchmark: Evaluating Text Style Transfer for Chatbots

Interacting with Literary Style through Computational Tools

A Comparative Study on Textual Saliency of Styles from Eye Tracking, Annotations, and Language Models

Latent representation discretization for unsupervised text style generation

Language Style Transfer from Non-Parallel Text with Arbitrary Styles

PROTOTYPE-TO-STYLE: Dialogue Generation with Style-Aware Editing on Retrieval Memory

Multidimensional Evaluation for Text Style Transfer Using ChatGPT

How Sequence-to-Sequence Models Perceive Language Styles?

SCAR: Efficient Instruction-Tuning for Large Language Models via Style Consistency-Aware Response Ranking

StyleStudio: Text-Driven Style Transfer with Selective Control of Style Elements

SC2: Towards Enhancing Content Preservation and Style Consistency in Long Text Style Transfer

Memory-enhanced text style transfer with dynamic style learning and calibration