Abstract:Fake news production, accessibility, and consumption have all increased with the rise of internet-connected gadgets and social media platforms. A good fake news detection system is essential because the news readers receive can affect their opinions. Several works on fake news detection have been done using machine learning and deep learning approaches. Recently, the deep learning approach has been preferred over machine learning because of its ability to comprehend the intricacies of textual data. The introduction of transformer architecture changed the NLP paradigm and distinguished itself from recurrent models by enabling the processing of sentences as a whole rather than word by word. The attention mechanisms introduced in Transformers allowed them to understand the relationship between far-apart tokens in a sentence. Numerous deep learning works on fake news detection have been published by focusing on different features to determine the authenticity of a news source. We performed an extensive analysis of the comprehensive NELA-GT 2020 dataset, which revealed that the title and content of a news source contain discernible information critical for determining its integrity. To this objective, we introduce 'FakeNews Transformer' — a specialized Transformer-based architecture that considers the news story's title and content to assess its veracity. Our proposed work achieved an accuracy of 74.0% on a subset of the NELA-GT 2020 dataset. To our knowledge, FakeNews Transformer is the first published work that considers both title and content for evaluating a news article; thus, we compare the performance of our work against two BERT and two LSTM models working independently on title and content. Our work outperformed the BERT and LSTM models working independently on title by 7.6% and 9.6%, while performing better than the BERT and LSTM models working independently on content by 8.9% and 10.5%, respectively.

Experiments in News Bias Detection with Pre-Trained Neural Transformers

A Domain-adaptive Pre-training Approach for Language Bias Detection in News

BiasScanner: Automatic Detection and Classification of News Bias to Strengthen Democracy

Transformer-Based Language Model Fine-Tuning Methods for COVID-19 Fake News Detection

Detecting COVID-19 Conspiracy Theories with Transformers and TF-IDF

A transformer-based architecture for fake news classification

An Interdisciplinary Approach for the Automated Detection and Visualization of Media Bias in News Articles

Testing the Generalization of Neural Language Models for COVID-19 Misinformation Detection

Taking a Stance on Fake News: Towards Automatic Disinformation Assessment via Deep Bidirectional Transformer Language Models for Stance Detection

Fake News Detectors are Biased against Texts Generated by Large Language Models

The Dark Side of the Language: Pre-trained Transformers in the DarkNet

NewB: 200,000+ Sentences for Political Bias Detection

Understanding Transformers for Bot Detection in Twitter

Exposing Bias in Online Communities through Large-Scale Language Models

From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Models

Bias and Cyberbullying Detection and Data Generation Using Transformer Artificial Intelligence Models and Top Large Language Models

Fake news detection using a deep learning transformer based encoder-decoder architecture

Ensemble Techniques for Robust Fake News Detection: Integrating Transformers, Natural Language Processing, and Machine Learning

A Novel Fake News Detection Model for Context of Mixed Languages Through Multiscale Transformer

Balancing Transparency and Accuracy: A Comparative Analysis of Rule-Based and Deep Learning Models in Political Bias Classification

From Deception to Detection: The Dual Roles of Large Language Models in Fake News