Abstract:Large language models (LLMs) have transformed human writing by enhancing grammar correction, content expansion, and stylistic refinement. However, their widespread use raises concerns about authorship, originality, and ethics, even potentially threatening scholarly integrity. Existing detection methods, which mainly rely on single-feature analysis and binary classification, often fail to effectively identify LLM-generated text in academic contexts. To address these challenges, we propose a novel Multi-level Fine-grained Detection (MFD) framework that detects LLM-generated text by integrating low-level structural, high-level semantic, and deep-level linguistic features, while conducting sentence-level evaluations of lexicon, grammar, and syntax for comprehensive analysis. To improve detection of subtle differences in LLM-generated text and enhance robustness against paraphrasing, we apply two mainstream evasion techniques to rewrite the text. These variations, along with original texts, are used to train a text encoder via contrastive learning, extracting high-level semantic features of sentence to boost detection generalization. Furthermore, we leverage advanced LLM to analyze the entire text and extract deep-level linguistic features, enhancing the model's ability to capture complex patterns and nuances while effectively incorporating contextual information. Extensive experiments on public datasets show that the MFD model outperforms existing methods, achieving an MAE of 0.1346 and an accuracy of 88.56%. Our research provides institutions and publishers with an effective mechanism to detect LLM-generated text, mitigating risks of compromised authorship. Educators and editors can use the model's predictions to refine verification and plagiarism prevention protocols, ensuring adherence to standards.

The HaLLMark Effect: Supporting Provenance and Transparent Use of Large Language Models in Writing with Interactive Visualization

Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writers

HoLLMwood: Unleashing the Creativity of Large Language Models in Screenwriting via Role Playing

GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency

DataTales: Investigating the use of Large Language Models for Authoring Data-Driven Articles

Evaluating Large Language Model Creativity from a Literary Perspective

Secret Keepers: The Impact of LLMs on Linguistic Markers of Personal Traits

Can Large Language Models Identify Authorship?

Large Language Model in Creative Work: The Role of Collaboration Modality and User Expertise

Neural Authorship Attribution: Stylometric Analysis on Large Language Models

Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation

"It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Models

The LLM Effect: Are Humans Truly Using LLMs, or Are They Being Influenced By Them Instead?

Under the Surface: Tracking the Artifactuality of LLM-Generated Data

Mark My Words: Analyzing and Evaluating Language Model Watermarks

LLM Attributor: Interactive Visual Attribution for LLM Generation

Unveiling Large Language Models Generated Texts: A Multi-Level Fine-Grained Detection Framework

Developing a framework to re-design writing assignment assessment for the era of Large Language Models

Towards Full Authorship with AI: Supporting Revision with AI-Generated Views

Watermarking Large Language Models and the Generated Content: Opportunities and Challenges

Facilitating Human-LLM Collaboration through Factuality Scores and Source Attributions