Abstract:Locally weighted projection regression (LWPR) is a new algorithm for incremental nonlinear function approximation in high-dimensional spaces with redundant and irrelevant input dimensions. At its core, it employs nonparametric regression with locally linear models. In order to stay computationally efficient and numerically robust, each local model performs the regression analysis with a small number of univariate regressions in selected directions in input space in the spirit of partial least squares regression. We discuss when and how local learning techniques can successfully work in high-dimensional spaces and review the various techniques for local dimensionality reduction before finally deriving the LWPR algorithm. The properties of LWPR are that it (1) learns rapidly with second-order learning methods based on incremental training, (2) uses statistically sound stochastic leave-one-out cross validation for learning without the need to memorize training data, (3) adjusts its weighting kernels based on only local information in order to minimize the danger of negative interference of incremental learning, (4) has a computational complexity that is linear in the number of inputs, and (5) can deal with a large number of-possibly redundant-inputs, as shown in various empirical evaluations with up to 90 dimensional data sets. For a probabilistic interpretation, predictive variance and confidence intervals are derived. To our knowledge, LWPR is the first truly incremental spatially localized learning method that can successfully and efficiently operate in very high-dimensional spaces.

Incremental LLE Based on Back Propagation Neural Network

Locally Linear Embedding algorithm based on OMP for incremental learning

An Iterative Locally Linear Embedding Algorithm

Incremental Laplacian Eigenmaps by Preserving Adjacent Information Between Data Points

Locally Linear Embedding Preserving Local Neighborhood

Locally Linear Embedding Based on Neiderreit Sequence Initialized Pelican Optimization Algorithm

Local Linear Embedding with Adaptive Neighbors.

Application of Fast Incremental Lle to Bearing Fault Feature Dimension Reduction

NNNPE: non-neighbourhood and neighbourhood preserving embedding

Locality Preserving Projection Via Deep Neural Network.

Robust Integrated Locally Linear Embedding

Incremental updating method for big data feature learning

Neighbor line-based locally linear embedding

Discriminant Graph Based Linear Embedding.

A modified local linear embedding algorithm based on neighbour selection.

Local Linear Transformation Embedding

Nonlinear Predictive Coding For Images By Using Back Propagation Network Trained By Levenberg-Marquardt Algorithm

Relative Distance-Based Laplacian Eigenmaps

Small World Neighborhood Optimized Local Linear Embedding Algorithm

Incremental online learning in high dimensions

Improvement and Application on Back Propagation Network Based on Partial Least-squares Algorithm