The hospital management of community acquired pneumonia in adults.

G. Town,S. Chambers

Abstract:

What problem does this paper attempt to address?

Are Concept Drift Detectors Reliable Alarming Systems? -- A Comparative Study

Lorena Poenaru-Olaru,Luis Cruz,Arie van Deursen,Jan S. Rellermeyer

DOI: https://doi.org/10.48550/arXiv.2211.13098

2022-11-24

Abstract:As machine learning models increasingly replace traditional business logic in the production system, their lifecycle management is becoming a significant concern. Once deployed into production, the machine learning models are constantly evaluated on new streaming data. Given the continuous data flow, shifting data, also known as concept drift, is ubiquitous in such settings. Concept drift usually impacts the performance of machine learning models, thus, identifying the moment when concept drift occurs is required. Concept drift is identified through concept drift detectors. In this work, we assess the reliability of concept drift detectors to identify drift in time by exploring how late are they reporting drifts and how many false alarms are they signaling. We compare the performance of the most popular drift detectors belonging to two different concept drift detector groups, error rate-based detectors and data distribution-based detectors. We assess their performance on both synthetic and real-world data. In the case of synthetic data, we investigate the performance of detectors to identify two types of concept drift, abrupt and gradual. Our findings aim to help practitioners understand which drift detector should be employed in different situations and, to achieve this, we share a list of the most important observations made throughout this study, which can serve as guidelines for practical usage. Furthermore, based on our empirical results, we analyze the suitability of each concept drift detection group to be used as alarming system.

Machine Learning,Artificial Intelligence
Concept Drift Detection in Federated Networked Systems

Dimitrios Michael Manias,Ibrahim Shaer,Li Yang,Abdallah Shami

DOI: https://doi.org/10.1109/GLOBECOM46510.2021.9685083

2021-09-14

Abstract:As next-generation networks materialize, increasing levels of intelligence are required. Federated Learning has been identified as a key enabling technology of intelligent and distributed networks; however, it is prone to concept drift as with any machine learning application. Concept drift directly affects the model's performance and can result in severe consequences considering the critical and emergency services provided by modern networks. To mitigate the adverse effects of drift, this paper proposes a concept drift detection system leveraging the federated learning updates provided at each iteration of the federated training process. Using dimensionality reduction and clustering techniques, a framework that isolates the system's drifted nodes is presented through experiments using an Intelligent Transportation System as a use case. The presented work demonstrates that the proposed framework is able to detect drifted nodes in a variety of non-iid scenarios at different stages of drift and different levels of system exposure.

Machine Learning,Networking and Internet Architecture
Autoregressive based Drift Detection Method

Mansour Zoubeirou A Mayaki,Michel Riveill

DOI: https://doi.org/10.1109/IJCNN55064.2022.9892066

2023-06-11

Abstract:In the classic machine learning framework, models are trained on historical data and used to predict future values. It is assumed that the data distribution does not change over time (stationarity). However, in real-world scenarios, the data generation process changes over time and the model has to adapt to the new incoming data. This phenomenon is known as concept drift and leads to a decrease in the predictive model's performance. In this study, we propose a new concept drift detection method based on autoregressive models called ADDM. This method can be integrated into any machine learning algorithm from deep neural networks to simple linear regression model. Our results show that this new concept drift detection method outperforms the state-of-the-art drift detection methods, both on synthetic data sets and real-world data sets. Our approach is theoretically guaranteed as well as empirical and effective for the detection of various concept drifts. In addition to the drift detector, we proposed a new method of concept drift adaptation based on the severity of the drift.

Machine Learning
A novel framework for concept drift detection using autoencoders for classification problems in data streams

Usman Ali,Tariq Mahmood

DOI: https://doi.org/10.1007/s13042-024-02223-2

2024-06-05

International Journal of Machine Learning and Cybernetics

Abstract:In streaming data environments, data characteristics and probability distributions are likely to change over time, causing a phenomenon called concept drift, which poses challenges for machine learning models to predict accurately. In such non-stationary environments, there is a need to detect concept drift and update the model to maintain an acceptable predictive performance. Existing approaches to drift detection have inherent problems like requirements of truth labels in supervised detection methods and high false positive rate in case of unsupervised drift detection. In this paper, we propose a semi-supervised Autoencoder based Drift Detection Method (AEDDM) aimed at detecting drift without the need of truth labels, yet with a high confidence that the detected drift is real. In a binary classification setting, AEDDM uses two autoencoders in a layered architecture, trained on labelled data and uses a thresholding mechanism based on reconstruction error to signal the presence of drift. The proposed method has been evaluated on four synthetic and four real world datasets with different drifting scenarios. In case of real-world datasets, the induced and detected drifts have been evaluated from classifier's performance viewpoint using seven mostly used batch classifiers as well as from adaptation perspective in an online learning environment using Hoeffding Tree classifier. The results show that AEDDM affectively detects the distributional changes in data which are most likely to impact the classifier's performance (real drift) while ignoring the virtual drift thus considerably reducing the false alarms with an ability to adapt in terms of classification performance.

computer science, artificial intelligence
Automatic Learning to Detect Concept Drift

Hang Yu,Tianyu Liu,Jie Lu,Guangquan Zhang

DOI: https://doi.org/10.48550/arXiv.2105.01419

2021-05-04

Abstract:Many methods have been proposed to detect concept drift, i.e., the change in the distribution of streaming data, due to concept drift causes a decrease in the prediction accuracy of algorithms. However, the most of current detection methods are based on the assessment of the degree of change in the data distribution, cannot identify the type of concept drift. In this paper, we propose Active Drift Detection with Meta learning (Meta-ADD), a novel framework that learns to classify concept drift by tracking the changed pattern of error rates. Specifically, in the training phase, we extract meta-features based on the error rates of various concept drift, after which a meta-detector is developed via a prototypical neural network by representing various concept drift classes as corresponding prototypes. In the detection phase, the learned meta-detector is fine-tuned to adapt to the corresponding data stream via stream-based active learning. Hence, Meta-ADD uses machine learning to learn to detect concept drifts and identify their types automatically, which can directly support drift understand. The experiment results verify the effectiveness of Meta-ADD.

Artificial Intelligence
You are out of context!

Giancarlo Cobino,Simone Farci

2024-11-04

Abstract:This research proposes a novel drift detection methodology for machine learning (ML) models based on the concept of ''deformation'' in the vector space representation of data. Recognizing that new data can act as forces stretching, compressing, or twisting the geometric relationships learned by a model, we explore various mathematical frameworks to quantify this deformation. We investigate measures such as eigenvalue analysis of covariance matrices to capture global shape changes, local density estimation using kernel density estimation (KDE), and Kullback-Leibler divergence to identify subtle shifts in data concentration. Additionally, we draw inspiration from continuum mechanics by proposing a ''strain tensor'' analogy to capture multi-faceted deformations across different data types. This requires careful estimation of the displacement field, and we delve into strategies ranging from density-based approaches to manifold learning and neural network methods. By continuously monitoring these deformation metrics and correlating them with model performance, we aim to provide a sensitive, interpretable, and adaptable drift detection system capable of distinguishing benign data evolution from true drift, enabling timely interventions and ensuring the reliability of machine learning systems in dynamic environments. Addressing the computational challenges of this methodology, we discuss mitigation strategies like dimensionality reduction, approximate algorithms, and parallelization for real-time and large-scale applications. The method's effectiveness is demonstrated through experiments on real-world text data, focusing on detecting context shifts in Generative AI. Our results, supported by publicly available code, highlight the benefits of this deformation-based approach in capturing subtle drifts that traditional statistical methods often miss. Furthermore, we present a detailed application example within the healthcare domain, showcasing the methodology's potential in diverse fields. Future work will focus on further improving computational efficiency and exploring additional applications across different ML domains.

Machine Learning,Artificial Intelligence
Time to Retrain? Detecting Concept Drifts in Machine Learning Systems

Tri Minh Triet Pham,Karthikeyan Premkumar,Mohamed Naili,Jinqiu Yang

2024-10-12

Abstract:With the boom of machine learning (ML) techniques, software practitioners build ML systems to process the massive volume of streaming data for diverse software engineering tasks such as failure prediction in AIOps. Trained using historical data, such ML models encounter performance degradation caused by concept drift, i.e., data and inter-relationship (concept) changes between training and production. It is essential to use concept rift detection to monitor the deployed ML models and re-train the ML models when needed. In this work, we explore applying state-of-the-art (SOTA) concept drift detection techniques on synthetic and real-world datasets in an industrial setting. Such an industrial setting requires minimal manual effort in labeling and maximal generality in ML model architecture. We find that current SOTA semi-supervised methods not only require significant labeling effort but also only work for certain types of ML models. To overcome such limitations, we propose a novel model-agnostic technique (CDSeer) for detecting concept drift. Our evaluation shows that CDSeer has better precision and recall compared to the state-of-the-art while requiring significantly less manual labeling. We demonstrate the effectiveness of CDSeer at concept drift detection by evaluating it on eight datasets from different domains and use cases. Results from internal deployment of CDSeer on an industrial proprietary dataset show a 57.1% improvement in precision while using 99% fewer labels compared to the SOTA concept drift detection method. The performance is also comparable to the supervised concept drift detection method, which requires 100% of the data to be labeled. The improved performance and ease of adoption of CDSeer are valuable in making ML systems more reliable.

Machine Learning
Unsupervised Concept Drift Detection from Deep Learning Representations in Real-time

Salvatore Greco,Bartolomeo Vacchetti,Daniele Apiletti,Tania Cerquitelli

2024-06-25

Abstract:Concept Drift is a phenomenon in which the underlying data distribution and statistical properties of a target domain change over time, leading to a degradation of the model's performance. Consequently, models deployed in production require continuous monitoring through drift detection techniques. Most drift detection methods to date are supervised, i.e., based on ground-truth labels. However, true labels are usually not available in many real-world scenarios. Although recent efforts have been made to develop unsupervised methods, they often lack the required accuracy, have a complexity that makes real-time implementation in production environments difficult, or are unable to effectively characterize drift. To address these challenges, we propose DriftLens, an unsupervised real-time concept drift detection framework. It works on unstructured data by exploiting the distribution distances of deep learning representations. DriftLens can also provide drift characterization by analyzing each label separately. A comprehensive experimental evaluation is presented with multiple deep learning classifiers for text, image, and speech. Results show that (i) DriftLens performs better than previous methods in detecting drift in $11/13$ use cases; (ii) it runs at least 5 times faster; (iii) its detected drift value is very coherent with the amount of drift (correlation $\geq 0.85$); (iv) it is robust to parameter changes.

Machine Learning,Artificial Intelligence
A Neighbor-Searching Discrepancy-based Drift Detection Scheme for Learning Evolving Data

Feng Gu,Jie Lu,Zhen Fang,Kun Wang,Guangquan Zhang

2024-05-23

Abstract:Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of classification performance deterioration. However, accurately detecting real concept drift remains challenging because the theoretical foundations of existing drift detection methods - two-sample distribution tests and monitoring classification error rate, both suffer from inherent limitations such as the inability to distinguish virtual drift (changes not affecting the classification boundary, will introduce unnecessary model maintenance), limited statistical power, or high computational cost. Furthermore, no existing detection method can provide information on the trend of the drift, which could be invaluable for model maintenance. This work presents a novel real concept drift detection method based on Neighbor-Searching Discrepancy, a new statistic that measures the classification boundary difference between two samples. The proposed method is able to detect real concept drift with high accuracy while ignoring virtual drift. It can also indicate the direction of the classification boundary change by identifying the invasion or retreat of a certain class, which is also an indicator of separability change between classes. A comprehensive evaluation of 11 experiments is conducted, including empirical verification of the proposed theory using artificial datasets, and experimental comparisons with commonly used drift handling methods on real-world datasets. The results show that the proposed theory is robust against a range of distributions and dimensions, and the drift detection method outperforms state-of-the-art alternative methods.

Machine Learning
A comprehensive analysis of concept drift locality in data streams

Gabriel J. Aguiar,Alberto Cano

DOI: https://doi.org/10.48550/arXiv.2311.06396

2023-12-09

Abstract:Adapting to drifting data streams is a significant challenge in online learning. Concept drift must be detected for effective model adaptation to evolving data properties. Concept drift can impact the data distribution entirely or partially, which makes it difficult for drift detectors to accurately identify the concept drift. Despite the numerous concept drift detectors in the literature, standardized procedures and benchmarks for comprehensive evaluation considering the locality of the drift are lacking. We present a novel categorization of concept drift based on its locality and scale. A systematic approach leads to a set of 2,760 benchmark problems, reflecting various difficulty levels following our proposed categorization. We conduct a comparative assessment of 9 state-of-the-art drift detectors across diverse difficulties, highlighting their strengths and weaknesses for future research. We examine how drift locality influences the classifier performance and propose strategies for different drift categories to minimize the recovery time. Lastly, we provide lessons learned and recommendations for future concept drift research. Our benchmark data streams and experiments are publicly available at <a class="link-external link-https" href="https://github.com/gabrieljaguiar/locality-concept-drift" rel="external noopener nofollow">this https URL</a>.

Machine Learning
Research on Web Robot Detection Technology for Concept Drift

Xue Chen,Yang Song,Wei Xiong,Yutao Lu,Xingen Wang

DOI: https://doi.org/10.1088/1742-6596/2010/1/012161

2021-01-01

Journal of Physics Conference Series

Abstract:Web robots have long been significant participants of the internet and the detection is deemed to be essential. Contemporary web robot detection techniques lack the ability to detect when the characteristics of web robots drastically change over time, namely a phenomenon called concept drift. Such change of web robot’s behavior may lead to the deterioration of detection model performance. In order to maintain high detection performance over time, in this paper, we propose a novel web robot detection framework that consists of a model pool, a reinforcement learning algorithm integrating all the models and a concept drift detection module. First, we employ reinforcement learning to integrate a number of detection models that targets different types of web robots, by dynamically adjusting model weights. Then we apply the drift detection method (DDM) to monitor concept drift and identify the need to retrain the model over time. Experiments are conducted using real website datasets under concept drift. The results demonstrate that our model significantly outperforms the state-of-the-art approaches.
Online Semi-Supervised Concept Drift Detection with Density Estimation

Chang How Tan,Vincent CS Lee,Mahsa Salehi

DOI: https://doi.org/10.48550/arXiv.1909.11251

2019-11-11

Abstract:Concept drift is formally defined as the change in joint distribution of a set of input variables X and a target variable y. The two types of drift that are extensively studied are real drift and virtual drift where the former is the change in posterior probabilities p(y|X) while the latter is the change in distribution of X without affecting the posterior probabilities. Many approaches on concept drift detection either assume full availability of data labels, y or handle only the virtual drift. In a streaming environment, the assumption of full availability of data labels, y is questioned. On the other hand, approaches that deal with virtual drift failed to address real drift. Rather than improving the state-of-the-art methods, this paper presents a semi-supervised framework to deal with the challenges above. The objective of the proposed framework is to learn from streaming environment with limited data labels, y and detect real drift concurrently. This paper proposes a novel concept drift detection method utilizing the densities of posterior probabilities in partially labeled streaming environments. Experimental results on both synthetic and realworld datasets show that our proposed semi-supervised framework enables the detection of concept drift in such environment while achieving comparable prediction performance to the state-of-the-art methods.

Machine Learning
Concept Drift Detection Based on Typicality and Eccentricity

Yuri Thomas P. Nunes,Luiz Affonso Guedes

DOI: https://doi.org/10.1109/access.2024.3355959

IF: 3.9

2024-02-03

IEEE Access

Abstract:Many applications and fields produce a vast quantity of time-relevant or continuously changing data which may represent new phenomena. This data stream behavior is known as Concept Drift. The need to efficiently and accurately process online data streams is a current need in many areas. Concept drift is a cause of performance degradation of classical machine learning approaches. It is necessary to address the concept drift to deploy real-world applications fed by data streams. This work presents a perspective of Concept Drift Detector (CDD) application to empower a data stream classifier in a real-world scenario followed by the proposal of Concept Drift Detector based on Typicality and Eccentricity Data Analytics (TEDA-CDD). Our method employs two models in monitoring the data stream in order to keep the information of a previous concept whereas monitoring the emergence of a new concept. The models are considered to represent two distinct concepts when the intersection of data samples are significantly low, described by the Jaccard Index. TEDA-CDD is compared to known methods from literature in experiments using synthetic and real-world datasets simulating real-world applications. In these experiments, TEDA-CDD performs comparably in terms of accuracy against well-established algorithms whereas presenting higher memory efficiency.

computer science, information systems,telecommunications,engineering, electrical & electronic
Learn to Adapt: Robust Drift Detection in Security Domain

Aditya Kuppa,Nhien-An Le-Khac

DOI: https://doi.org/10.48550/arXiv.2206.07581

2022-06-15

Abstract:Deploying robust machine learning models has to account for concept drifts arising due to the dynamically changing and non-stationary nature of data. Addressing drifts is particularly imperative in the security domain due to the ever-evolving threat landscape and lack of sufficiently labeled training data at the deployment time leading to performance degradation. Recently proposed concept drift detection methods in literature tackle this problem by identifying the changes in feature/data distributions and periodically retraining the models to learn new concepts. While these types of strategies should absolutely be conducted when possible, they are not robust towards attacker-induced drifts and suffer from a delay in detecting new attacks. We aim to address these shortcomings in this work. we propose a robust drift detector that not only identifies drifted samples but also discovers new classes as they arrive in an on-line fashion. We evaluate the proposed method with two security-relevant data sets -- network intrusion data set released in 2018 and APT Command and Control dataset combined with web categorization data. Our evaluation shows that our drifting detection method is not only highly accurate but also robust towards adversarial drifts and discovers new classes from drifted samples.

Cryptography and Security
Towards Computational Performance Engineering for Unsupervised Concept Drift Detection -- Complexities, Benchmarking, Performance Analysis

Elias Werner,Nishant Kumar,Matthias Lieber,Sunna Torge,Stefan Gumhold,Wolfgang E. Nagel

2024-06-10

Abstract:Concept drift detection is crucial for many AI systems to ensure the system's reliability. These systems often have to deal with large amounts of data or react in real-time. Thus, drift detectors must meet computational requirements or constraints with a comprehensive performance evaluation. However, so far, the focus of developing drift detectors is on inference quality, e.g. accuracy, but not on computational performance, such as runtime. Many of the previous works consider computational performance only as a secondary objective and do not have a benchmark for such evaluation. Hence, we propose and explain performance engineering for unsupervised concept drift detection that reflects on computational complexities, benchmarking, and performance analysis. We provide the computational complexities of existing unsupervised drift detectors and discuss why further computational performance investigations are required. Hence, we state and substantiate the aspects of a benchmark for unsupervised drift detection reflecting on inference quality and computational performance. Furthermore, we demonstrate performance analysis practices that have proven their effectiveness in High-Performance Computing, by tracing two drift detectors and displaying their performance data.

Machine Learning,Performance
On the Reliable Detection of Concept Drift from Streaming Unlabeled Data

Tegjyot Singh Sethi,Mehmed Kantardzic

DOI: https://doi.org/10.48550/arXiv.1704.00023

2017-04-01

Abstract:Classifiers deployed in the real world operate in a dynamic environment, where the data distribution can change over time. These changes, referred to as concept drift, can cause the predictive performance of the classifier to drop over time, thereby making it obsolete. To be of any real use, these classifiers need to detect drifts and be able to adapt to them, over time. Detecting drifts has traditionally been approached as a supervised task, with labeled data constantly being used for validating the learned model. Although effective in detecting drifts, these techniques are impractical, as labeling is a difficult, costly and time consuming activity. On the other hand, unsupervised change detection techniques are unreliable, as they produce a large number of false alarms. The inefficacy of the unsupervised techniques stems from the exclusion of the characteristics of the learned classifier, from the detection process. In this paper, we propose the Margin Density Drift Detection (MD3) algorithm, which tracks the number of samples in the uncertainty region of a classifier, as a metric to detect drift. The MD3 algorithm is a distribution independent, application independent, model independent, unsupervised and incremental algorithm for reliably detecting drifts from data streams. Experimental evaluation on 6 drift induced datasets and 4 additional datasets from the cybersecurity domain demonstrates that the MD3 approach can reliably detect drifts, with significantly fewer false alarms compared to unsupervised feature based drift detectors. The reduced false alarms enables the signaling of drifts only when they are most likely to affect classification performance. As such, the MD3 approach leads to a detection scheme which is credible, label efficient and general in its applicability.

Machine Learning,Artificial Intelligence
Concept Drift Detection and Adaptation with Weak Supervision on Streaming Unlabeled Data

Abhijit Suprem

DOI: https://doi.org/10.48550/arXiv.1910.01064

2019-10-03

Abstract:Concept drift in learning and classification occurs when the statistical properties of either the data features or target change over time; evidence of drift has appeared in search data, medical research, malware, web data, and video. Drift adaptation has not yet been addressed in high dimensional, noisy, low-context data such as streaming text, video, or images due to the unique challenges these domains present. We present a two-fold approach to deal with concept drift in these domains: a density-based clustering approach to deal with virtual concept drift (change in statistical properties of features) and a weak-supervision step to deal with real concept drift (change in statistical properties of target). Our density-based clustering avoids problems posed by the curse of dimensionality to create an evolving 'map' of the live data space, thereby addressing virtual drift in features. Our weak-supervision step leverages high-confidence labels (oracle or heuristic labels) to generate weighted training sets to generalize and update existing deep learners to adapt to changing decision boundaries (real drift) and create new deep learners for unseen regions of the data space. Our results show that our two-fold approach performs well with >90% precision in 2018, four years after initial deployment in 2014, without any human intervention.

Machine Learning
A Scalable Approach to Covariate and Concept Drift Management via Adaptive Data Segmentation

Vennela Yarabolu,Govind Waghmare,Sonia Gupta,Siddhartha Asthana

DOI: https://doi.org/10.1145/3703323.3703337

2024-11-24

Abstract:In many real-world applications, continuous machine learning (ML) systems are crucial but prone to data drift, a phenomenon where discrepancies between historical training data and future test data lead to significant performance degradation and operational inefficiencies. Traditional drift adaptation methods typically update models using ensemble techniques, often discarding drifted historical data, and focus primarily on either covariate drift or concept drift. These methods face issues such as high resource demands, inability to manage all types of drifts effectively, and neglecting the valuable context that historical data can provide. We contend that explicitly incorporating drifted data into the model training process significantly enhances model accuracy and robustness. This paper introduces an advanced framework that integrates the strengths of data-centric approaches with adaptive management of both covariate and concept drift in a scalable and efficient manner. Our framework employs sophisticated data segmentation techniques to identify optimal data batches that accurately reflect test data patterns. These data batches are then utilized for training on test data, ensuring that the models remain relevant and accurate over time. By leveraging the advantages of both data segmentation and scalable drift management, our solution ensures robust model accuracy and operational efficiency in large-scale ML deployments. It also minimizes resource consumption and computational overhead by selecting and utilizing relevant data subsets, leading to significant cost savings. Experimental results on classification task on real-world and synthetic datasets show our approach improves model accuracy while reducing operational costs and latency. This practical solution overcomes inefficiencies in current methods, providing a robust, adaptable, and scalable approach.

Machine Learning
DriftSurf: A Risk-competitive Learning Algorithm under Concept Drift

Ashraf Tahmasbi,Ellango Jothimurugesan,Srikanta Tirthapura,Phillip B. Gibbons

DOI: https://doi.org/10.48550/arXiv.2003.06508

2020-08-02

Abstract:When learning from streaming data, a change in the data distribution, also known as concept drift, can render a previously-learned model inaccurate and require training a new model. We present an adaptive learning algorithm that extends previous drift-detection-based methods by incorporating drift detection into a broader stable-state/reactive-state process. The advantage of our approach is that we can use aggressive drift detection in the stable state to achieve a high detection rate, but mitigate the false positive rate of standalone drift detection via a reactive state that reacts quickly to true drifts while eliminating most false positives. The algorithm is generic in its base learner and can be applied across a variety of supervised learning problems. Our theoretical analysis shows that the risk of the algorithm is competitive to an algorithm with oracle knowledge of when (abrupt) drifts occur. Experiments on synthetic and real datasets with concept drifts confirm our theoretical analysis.

Machine Learning
Roadmap of Concept Drift Adaptation in Data Stream Mining, Years Later

Osama A. Mahdi,Nawfal Ali,Eric Pardede,Ammar Alazab,Tahsien Al-Quraishi,Bhagwan Das

DOI: https://doi.org/10.1109/access.2024.3358817

IF: 3.9

2024-02-13

IEEE Access

Abstract:As machine learning models are increasingly applied to real-world scenarios, it is essential to consider the possibility of changes in the data distribution over time. Concept drift detection and adaptation refers to the process of identifying and tracking these changes and updating the model accordingly. Researchers have devoted significant efforts to develop various techniques and tools for concept drift detection and adaptation, as this paper provides a generic roadmap and review of the field. In this paper, we begin by reviewing the background of data stream classification and its assumptions and requirements. Then, we explore the historical development of concept drift detection and adaptation and highlight the key points of approaches that have emerged over time. Next, we summarize the major findings, challenges, and limitations of past research, and provide insights into potential future directions of the field. The paper can benefit researchers and practitioners who seek to navigate the challenges and opportunities in concept drift detection and adaptation.

computer science, information systems,telecommunications,engineering, electrical & electronic

The hospital management of community acquired pneumonia in adults.

Are Concept Drift Detectors Reliable Alarming Systems? -- A Comparative Study

Concept Drift Detection in Federated Networked Systems

Autoregressive based Drift Detection Method

A novel framework for concept drift detection using autoencoders for classification problems in data streams

Automatic Learning to Detect Concept Drift

You are out of context!

Time to Retrain? Detecting Concept Drifts in Machine Learning Systems

Unsupervised Concept Drift Detection from Deep Learning Representations in Real-time

A Neighbor-Searching Discrepancy-based Drift Detection Scheme for Learning Evolving Data

A comprehensive analysis of concept drift locality in data streams

Research on Web Robot Detection Technology for Concept Drift

Online Semi-Supervised Concept Drift Detection with Density Estimation

Concept Drift Detection Based on Typicality and Eccentricity

Learn to Adapt: Robust Drift Detection in Security Domain

Towards Computational Performance Engineering for Unsupervised Concept Drift Detection -- Complexities, Benchmarking, Performance Analysis

On the Reliable Detection of Concept Drift from Streaming Unlabeled Data

Concept Drift Detection and Adaptation with Weak Supervision on Streaming Unlabeled Data

A Scalable Approach to Covariate and Concept Drift Management via Adaptive Data Segmentation

DriftSurf: A Risk-competitive Learning Algorithm under Concept Drift

Roadmap of Concept Drift Adaptation in Data Stream Mining, Years Later