Abstract:Kernel regression is a popular non-parametric fitting technique. It aims at learning a function which estimates the targets for test inputs as precise as possible. Generally, the function value for a test input is estimated by a weighted average of the surrounding training examples. The weights are typically computed by a distance-based kernel function and they strongly depend on the distances between examples. In this paper, we first review the latest developments of sparse metric learning and kernel regression. Then a novel kernel regression method involving sparse metric learning, which is called kernel regression with sparse metric learning (KR$\_$SML), is proposed. The sparse kernel regression model is established by enforcing a mixed $(2,1)$-norm regularization over the metric matrix. It learns a Mahalanobis distance metric by a gradient descent procedure, which can simultaneously conduct dimensionality reduction and lead to good prediction results. Our work is the first to combine kernel regression with sparse metric learning. To verify the effectiveness of the proposed method, it is evaluated on 19 data sets for regression. Furthermore, the new method is also applied to solving practical problems of forecasting short-term traffic flows. In the end, we compare the proposed method with other three related kernel regression methods on all test data sets under two criterions. Experimental results show that the proposed method is much more competitive.

Kernel Regression with a Mahalanobis Metric for Short-Term Traffic Flow Forecasting

Sparse Kernel Regression For Traffic Flow Forecasting

K-Nearest Neighbor Model Based Short-Term Traffic Flow Prediction Method

Improved K nearest neighbor nonparametric regression and its application in short-term traffic flow forecasting

The Conditional Probability of Travel Speed and Its Application to Short-Term Prediction

Fuzzy Hybrid Framework with Dynamic Weights for Short‐term Traffic Flow Prediction by Mining Spatio‐temporal Correlations

Application Improvement of Nonparametric Regression to Traffic Flow Forecast

Kernel Regression with Sparse Metric Learning

Locally kernel regression adapting with data distribution in prediction of traffic flow

The Combined Short-Term Forecasting Approach to Traffic Flow Based on Non-Parametric Regression

Nonparametric Regression for the Short-Term Traffic Flow Forecasting

The Application of Nonparametric Regressive Algorithm for Short-Term Traffic Flow Forecast

A Short-term Traffic Flow Forecasting Method Based on Combination of Fuzzy C-mean Clustering and Neural Network

Hybrid Multi-Metric K-Nearest Neighbor Regression for Traffic Flow Prediction

Using support vector regression and K-nearest neighbors for short-term traffic flow prediction based on maximal information coefficient

A Novel Hybrid Model for Short-Term Traffic Flow Prediction Based on Extreme Learning Machine and Improved Kernel Density Estimation

Short-Term Traffic Flow Forecasting by Selecting Appropriate Predictions Based on Pattern Matching

Short-Term Traffic Flow Forecasting Model Based on Support Vector Machine Regression

Learning Common Metrics for Homogenous Tasks in Traffic Flow Prediction

Short-term Traffic Flow Prediction based on Data-Driven Knearest neighbour Nonparametric Regression

Hybrid machine learning algorithm and statistical time series model for network-wide traffic forecast