Abstract:In the current era of social media and generative AI, an ability to automatically assess the credibility of online social media content is of tremendous importance. Credibility assessment is fundamentally based on aggregating credibility signals, which refer to small units of information, such as content factuality, bias, or a presence of persuasion techniques, into an overall credibility score. Credibility signals provide a more granular, more easily explainable and widely utilizable information in contrast to currently predominant fake news detection, which utilizes various (mostly latent) features. A growing body of research on automatic credibility assessment and detection of credibility signals can be characterized as highly fragmented and lacking mutual interconnections. This issue is even more prominent due to a lack of an up-to-date overview of research works on automatic credibility assessment. In this survey, we provide such systematic and comprehensive literature review of 175 research papers while focusing on textual credibility signals and Natural Language Processing (NLP), which undergoes a significant advancement due to Large Language Models (LLMs). While positioning the NLP research into the context of other multidisciplinary research works, we tackle with approaches for credibility assessment as well as with 9 categories of credibility signals (we provide a thorough analysis for 3 of them, namely: 1) factuality, subjectivity and bias, 2) persuasion techniques and logical fallacies, and 3) claims and veracity). Following the description of the existing methods, datasets and tools, we identify future challenges and opportunities, while paying a specific attention to recent rapid development of generative AI.

Validity of Machine Learning in Assessing Large Texts Through Sustainability Indicators

Temporal Sustainability Efficiency Analysis of Urban Areas Via Data Envelopment Analysis and the Hypervolume Indicator: Application to London Boroughs

Measuring a Texts Fairness Dimensions Using Machine Learning Based on Social Psychological Factors

Using Large Language Models for a standard assessment mapping for sustainable communities

Air quality and urban sustainable development: the application of machine learning tools

Measuring Fairness of Text Classifiers via Prediction Sensitivity

Testing the reliability of an AI-based large language model to extract ecological information from the scientific literature

Machine learning to detect invalid text responses: Validation and comparison to existing detection methods

Machine Learning Technologies for Sustainability in Smart Cities in the Post-COVID Era

Text mining policy: Classifying forest and landscape restoration policy agenda with neural information retrieval

Technical report: Impact of evaluation metrics and sampling on the comparison of machine learning methods for biodiversity indicators prediction

The Validity of Sentiment Analysis: Comparing Manual Annotation, Crowd-Coding, Dictionary Approaches, and Machine Learning Algorithms

Fairness Evaluation in Text Classification: Machine Learning Practitioner Perspectives of Individual and Group Fairness

Evaluating the performance of state-of-the-art esg domain-specific pre-trained large language models in text classification against existing models and traditional machine learning techniques

A hybrid deep learning method for identifying topics in large-scale urban text data: Benefits and trade-offs

Surveying (Dis)Parities and Concerns of Compute Hungry NLP Research

Creating a Systematic ESG (Environmental Social Governance) Scoring System Using Social Network Analysis and Machine Learning for More Sustainable Company Practices

A Survey on Automatic Credibility Assessment of Textual Credibility Signals in the Era of Large Language Models

Analysis of Biomass Sustainability Indicators from a Machine Learning Perspective

Machine learning to support citizen science in urban environmental management

A Comparative Study of Machine Learning Algorithms for Anomaly Detection in Industrial Environments: Performance and Environmental Impact