Abstract:When the technique of boosting regression is applied to near-infrared spectroscopy, the full spectrum of samples are generally used to perform partial least squares (PLS) modeling. However, there is a large amount of redundant information and noise contained in the full spectrum. This not only increases the complexity of the model, but also reduces its predictive performance. In addition, the boosting method is sensitive to data noise. When the data are mixed with too much noise, the generalization performance of boosting will decrease, and the prediction error and the variance of PLS will be relatively large. To solve these problems, a gradient descent boosting ensemble method combined with backward interval PLS (GD-Boosting-BiPLS) is proposed in this paper. BiPIS is used to select the effective variables for the boosting base model, and each base model is trained sequentially by resampling. The spectral segmentation parameter of BiPLS and the iteration parameter of boosting are fused, and the weight of each base model is distributed by the gradient descent strategy. This leads to a new ensemble model (forward additive model) in the direction of reduced residuals. The final model is the ensemble model that obtains the minimum root mean square error of prediction (RMSEP). The proposed method is applied to the quantitative prediction of ethanol concentrations. Over iterations 1-50, the average correlation coefficients of the calibration and validation sets are 0.9628 and 0.9388, and the average RMSE of cross-validation and RMSEP are 0.0732 and 0.0675, respectively. The overall performance of the proposed GD-Boosting-BiPLS method is compared with those of various ensemble strategies and 4 kinds of state-of-the-art spectral modeling methods. The experimental results reveal that the proposed method has the best generalization performance and stability. (C) 2015 Published by Elsevier B.V.

Boosting The Pls Algorithm For Regressive Modelling

Boosting the Partial Least Square Algorithm for Regression Modelling

Analysis of NIR Using Boosting Algorithm

A Boosting-Partial Least Squares Method For Ultraviolet Spectroscopic Analysis Of Water Quality

A Gradient Descent Boosting Spectrum Modeling Method Based on Back Interval Partial Least Squares.

Subsampling for Partial Least-Squares Regression Via an Influence Function

SPLBoost: An Improved Robust Boosting Algorithm Based on Self-Paced Learning

An improved boosting partial least squares method for near-infrared spectroscopic quantitative analysis.

Boosting: An Ensemble Learning Tool for Compound Classification and QSAR Modeling

A Regression Algorithm Based on AdaBoost

Online Regression Algorithm Based on Boosting

Robust boosting for regression problems

Logistic Boosting Regression for Label Distribution Learning

NGBoost: Natural Gradient Boosting for Probabilistic Prediction

Automatic piecewise linear regression

Churn Prediction with Linear Discriminant Boosting Algorithm

Towards Optimization of Boosting Models for Formation Lithology Identification

Boosting algorithms for uplift modeling

The boosting: A new idea of building models

QBoost: Predicting quantiles with boosting for regression and binary classification

A Geometric Conversion Approach for Boosting Regression Problem