Abstract:Moving window smoothing ensemble CARS (MWS-ECARS) is a stable algorithm for extracting characteristic variables. Based on the previous studies, two improved MWS-ECARS are proposed to reduce the dimension of black tea spectrum based on different window smoothing algorithms in this paper, and compared with the original MWS-ECARS, the commonly used successive projections algorithm (SPA) , the competitive adaptive reweighting algorithm (CARS) and the moving window partial least squares method (MWPLS). A partial least square regression model (PLSR) was established to select the best black tea grade discrimination model. Two improved MWS-ECARS methods are Gaussian filter ECARS (GF-ECARS) and Median filter smoothing ECARS (MF-ECARS), respectively. The CARS algorithm runs n times (n=1 000 in this paper). The wavelength and its corresponding selected frequency are sorted out and different window smoothing algorithms are used to smooth the selection frequency. The window widths are all 3 similar to 31, and the window step sizes are all 2. The threshold is set through the selection frequency smoothed by different window widths and smoothing algorithm, and the starting threshold and step size are both 20. Finally, the wavelength whose selection frequency is higher than the threshold is selected and the PLSR model is established. The correlation coefficient of prediction set (R-p(2)) is taken as the judgment factor. The closer R-p(2), is to 1, the more accurate the established model is. The results show that the black tea grade discrimination model established by the extracted characteristic variables with the improved GF-ECARS algorithm is the best. The R-p(2) reaches 0. 969 2. The reason is that the amplitude difference of each point on the curve will become smaller in the window Gaussian filtering smoothing algorithm as the window width increases. In the weighted average process of Gaussian algorithm, it is not easy to associate the low frequency wavelength with the high weight. In practical applications, the selection frequency of effective band is often low, which can be smoothed by selecting a Gaussian filter with narrow window width. In addition, due to the characteristics of the Gaussian curve, the Gaussian filtering algorithm can well protect the details of the window edge image. Although the modeling result of the MF-ECARS algorithm is slightly worse than the original MWS-ECARS, its M still reaches over 0. 96. This shows that the improved algorithm can improve the prediction ability of the original model. MWS-ECARS extraction feature variables are different based on different window smoothing algorithms. However, as the smoothing window width increases, the continuity of the extracted characteristic variables is enhanced and the number of extracted characteristic variables is reduced. The R-p(2), of the three MWS-ECARS algorithms all show that they are more effective and stable than the commonly SPA, CARS and MWPRS algorithms. This study can provide ideas for selective dimensionality reduction of spectral data.

Moving Window Smoothing on the Ensemble of Competitive Adaptive Reweighted Sampling Algorithm

Stability competitive adaptive reweighted sampling (SCARS) and its applications to multivariate calibration of NIR spectra

A Variable Informative Criterion Based on Weighted Voting Strategy Combined with LASSO for Variable Selection in Multivariate Calibration

Variable Selection by Double Competitive Adaptive Reweighted Sampling for Calibration Transfer of Near Infrared Spectra

A Modified Moving-Window Partial Least-Squares Method by Coupling with Sampling Error Profile Analysis for Variable Selection in Near-Infrared Spectral Analysis.

A novel variable selection method based on combined moving window and intelligent optimization algorithm for variable selection in chemical modeling

An Variable Selection Method of the Significance Multivariate Correlation Competitive Population Analysis for Near-Infrared Spectroscopy in Chemical Modeling

Application of Different Smoothing Ensemble CARS Algorithm in Spectral Discrimination of Black Tea Grade

Broadening the Scope of Food Quality Control: a Calibration Transfer Strategy for Minimizing External Influences on Spectral Analysis

Comparison of several variable selection methods for quantitative analysis and monitoring of the Yangxinshi tablet process using near-infrared spectroscopy

A variable importance criterion for variable selection in near-infrared spectral analysis

A New Strategy of Least Absolute Shrinkage and Selection Operator Coupled with Sampling Error Profile Analysis for Wavelength Selection

Feature Variable Selection for Near‐Infrared Spectroscopy Based on Simulated Annealing Bee Colony Algorithm

Improving Raman-Based Models for Real-Time Monitoring the CHO Cell Culture Process with Effective Variable Selection Strategies

Soft variable selection combining partial least squares and attention mechanism for multivariable calibration

Moving Window Sparse Partial Least Squares Method and Its Application in Spectral Data

Moving Window Cross Validation: a New Cross Validation Method for the Selection of a Rational Number of Components in a Partial Least Squares Calibration Model.

A novel hybrid variable selection strategy with application to molecular spectroscopic analysis

Uninformation Variable Elimination and Successive Projections Algorithm in Mid-Infrared Spectral Wavenumber Selection

Improving The Creditability And Reproducibility Of Variables Selected From Near Infrared Spectra

Cross-Scene Hyperspectral Feature Selection Via Hybrid Whale Optimization Algorithm with Simulated Annealing