Abstract:Streaming data refers to a dynamic data set that grows infinitely over time. And the streaming data set of load lacks historical data due to difficult data collection or short running time. Therefore, it is very difficult to ensure the accuracy of streaming data forecasting results. To solve the problem, this paper proposes a quantile prediction model for streaming data based on the adversarial transfer bidirectional long short-term memory (ATLSTM) networks. The model can be divided into two parts. In the pre-training model based on domain adversarial network, the adversarial mechanism is introduced based on the bidirectional long short-term memory (Bi-LSTM) architecture to train. In this paper, streaming data is used as the target domain data. And data with high similarity to streaming data is used as source domain data. By minimizing the prediction loss and maximizing the domain classification loss, the model extracts the common features of the target domain and the source domain. In the migration training model based on parameter fine-tuning, a simple model is constructed by importing part of the network of the pre-training model. On this basis, the optimization training is carried out through the data of the target domain to extract the deep features. And the quantile fitting can not only solve the situation of outliers in the data, but also obtain the load forecasting curve under different confidence conditions. The experimental results show that the accuracy, efficiency, and stability of the proposed model are better than the traditional deep learning model.

Data Stream Prediction in Distributed Stream Processing Environment

A nodes scheduling model based on Markov chain prediction for big streaming data analysis

Big Data Quality Prediction in the Process Industry: A Distributed Parallel Modeling Framework

Data Stream Prediction Based on Rule Antecedent Occurrence Tree Matching

Online Anomaly Prediction for Real-Time Stream Processing.

Performance Prediction Method for Stream Computing Platform Based on Time Series

Predictive Queries Algorithm Based on Probability Model over Data Streams

A Study on Prediction Models for Massive Data Processing

Processing Algorithms for Predictive Aggregate Queries over Data Streams

A New Framework for Network Flow Queuing Delay Prediction Based on Stream Computing.

Performance-sensitive Data Distribution Method for Distributed Stream Processing Systems

QoS Prediction Method for Data Supply Chain Based on Context

Research on Prediction and Classification over Data Streams

High-Performance Data Distribution Algorithm on Distributed Stream Systems

Quantile Load Forecasting on Streaming Data and Adversarial Transfer Bi-LSTM Networks

Network-Aware Grouping in Distributed Stream Processing Systems.

An Algorithm for Predictive Queries over Data Stream Based on Energy and Frequent Pattern

Streaming Data Oriented Galloping Prediction

Research on Novel Algorithm for Host Load Prediction

Resource Estimation in Distributed Data Stream Processing Systems

A Probability Distribution and Location-aware ResNet Approach for QoS Prediction