Abstract:We investigate the problem of stochastic network optimization in the presence of imperfect state prediction and non-stationarity. Based on a novel distribution-accuracy curve prediction model, we develop the predictive learning-aided control (PLC) algorithm, which jointly utilizes historic and predicted network state information for decision making. PLC is an online algorithm that requires zero a-prior system statistical information, and consists of three key components, namely sequential distribution estimation and change detection, dual learning, and online queue-based control.Specifically, we show that PLC simultaneously achieves good long-term performance, short-term queue size reduction, accurate change detection, and fast algorithm convergence. In particular, for stationary networks, PLC achieves a near-optimal [O(epsilon), O( log(1/epsilon)(2))] utility-delay tradeoff. For non-stationary networks, PLC obtains an [O(epsilon), O(log(2) (1/epsilon) + min(epsilon(c/2-1), e(w)/epsilon))] utility-backlog tradeo. for distributions that last Theta(max(epsilon(-c),e(w)(-2))/epsilon(1+a)) time, where e(w) is the prediction accuracy and a = Theta(1) > 0 is a constant (the Backpressue algorithm [1] requires an O(epsilon(-2)) length for the same utility performance with a larger backlog). Moreover, PLC detects distribution change O(w) slots faster with high probability (w is the prediction size) and achieves an O(min(epsilon(-1+c/2), e(w)/epsilon) + log(2) (1/epsilon)) convergence time, which is faster than Backpressure and other algorithms. Our results demonstrate that state prediction (even imperfect) can help (i) achieve faster detection and convergence, and (ii) obtain be.er utility-delay tradeo.s..ey also quantify the bene.ts of prediction in four important performance metrics, i.e., utility (e.ciency), delay (quality-of-service), detection (robustness), and convergence (adaptability), and provide new insight for joint prediction, learning and optimization in stochastic networks.

The Approximation of the Projection Pursuit Learning Networks for Non-linear Time Series

Application of Projection Pursuit Learning Networks in Dynamic System Modeling

Nonlinear Projection to Latent Structures Method and Its Applications

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

Projection Pursuit Learning Networks Applying for Eliminating Noises of Fiber Optic Gyroscope

Analyzing and Improving Supervised Nonlinear Dynamical Probabilistic Latent Variable Model for Inferential Sensors

Similarity Based Robust Probability Latent Variable Regression Model and Its Kernel Extension for Process Monitoring

Learning Fast Approximations of Sparse Nonlinear Regression

An efficient and robust varying-parameter projection neural network for sparse signal reconstruction

Neural Network Boundary Approximation for Uncertain Nonlinear Spatiotemporal Systems and Its Application of Tracking Control

A Time Series Forecasting Approach Based on Nonlinear Spiking Neural Systems

Nonlinear Functions Approximation Using Fast Wavelet Neural Network

Multivariate time series forecasting method based on nonlinear spiking neural P systems and non-subsampled shearlet transform

A projected nonlinear state-space model for forecasting time series signals

Information Granules-Based Long-Term Forecasting of Time Series Via BPNN under Three-Way Decision Framework

TLNets: Transformation Learning Networks for long-range time-series prediction

Approximation and Optimization Theory for Linear Continuous-Time Recurrent Neural Networks

Learning-aided Stochastic Network Optimization with Imperfect State Prediction.

Design of Hierarchical Neural Networks Using Deep LSTM and Self-organizing Dynamical Fuzzy-Neural Network Architecture

Inverse Approximation Theory for Nonlinear Recurrent Neural Networks

Approximation And Inverse Control Of Nonlinear System Using Standard Continuous Piecewise Linear Neural Networks