Abstract:This systematic literature review comprehensively examines the application of Large Language Models (LLMs) in forecasting and anomaly detection, highlighting the current state of research, inherent challenges, and prospective future directions. LLMs have demonstrated significant potential in parsing and analyzing extensive datasets to identify patterns, predict future events, and detect anomalous behavior across various domains. However, this review identifies several critical challenges that impede their broader adoption and effectiveness, including the reliance on vast historical datasets, issues with generalizability across different contexts, the phenomenon of model hallucinations, limitations within the models' knowledge boundaries, and the substantial computational resources required. Through detailed analysis, this review discusses potential solutions and strategies to overcome these obstacles, such as integrating multimodal data, advancements in learning methodologies, and emphasizing model explainability and computational efficiency. Moreover, this review outlines critical trends that are likely to shape the evolution of LLMs in these fields, including the push toward real-time processing, the importance of sustainable modeling practices, and the value of interdisciplinary collaboration. Conclusively, this review underscores the transformative impact LLMs could have on forecasting and anomaly detection while emphasizing the need for continuous innovation, ethical considerations, and practical solutions to realize their full potential.

Research on Anomaly Detection Methodology Combining Large Language Models

Anomaly Detection Algorithm Based on Electric Equipment

Large Language Models for Anomaly and Out-of-Distribution Detection: A Survey

AnomalyLLM: Few-shot Anomaly Edge Detection for Dynamic Graphs using Large Language Models

Equipment anomaly detection method under cloud-edge collaboration model based bi-directional long short-term memory and variational autoencoder

VL4AD: Vision-Language Models Improve Pixel-wise Anomaly Detection

Large Language Models for Forecasting and Anomaly Detection: A Systematic Literature Review

Towards Generic Anomaly Detection and Understanding: Large-scale Visual-linguistic Model (GPT-4V) Takes the Lead

An Unsupervised Anomaly Detection Scheme Based on Memory Mechanism in Cloud-edge Collaboration Scenario

Large Language Models for Anomaly Detection in Computational Workflows: from Supervised Fine-Tuning to In-Context Learning

Large Language Models can Deliver Accurate and Interpretable Time Series Anomaly Detection

Research of Anomaly detection based on Dynamic Anomaly Detection Enhancement Framework

Vision-Language Models Assisted Unsupervised Video Anomaly Detection

Simulation Research on Anomaly Detection in Large Data Environment

Semantic Anomaly Detection with Large Language Models

Semi-Supervised Anomaly Detection via Neural Process

Learning Competitive and Discriminative Reconstructions for Anomaly Detection

MonitorAssistant: Simplifying Cloud Service Monitoring Via Large Language Models

Anomaly Detection by Adapting a pre-trained Vision Language Model

Situation-Aware Multivariate Time Series Anomaly Detection Through Active Learning and Contrast VAE-Based Models in Large Distributed Systems

Anomaly Detection of Tabular Data Using LLMs