Abstract:The near-infrared spectral data is highly high dimensional and contains redundant information, it is necessary to identify the most representative characteristic wavelengths before modeling to improve model accuracy and reliability. At present, there are many methods for selecting the characteristic wavelengths of NIR spectroscopy, but the collinearity among wavelengths is still a main issue that leads to poor model effects. Therefore, this study proposes a three-stage wavelength selection algorithm (Stage III) to reduce redundancy in NIR spectral data and collinearity between wavelength variables, resulting in a simpler and more accurate predictive model. The research uses a public NIR data set of corn samples as its subject. Initially, the wavelengths with the higher correlation coefficients are chosen after calculating the relationship coefficients between every wavelength vector and the concentration vector. On this basis, the correlation coefficients between the vectors of each wavelength point are calculated, and those wavelength points with smaller correlation coefficients with other wavelength points are selected. Ultimately, the stepwise regression analysis selects the wavelengths that provide substantial value to the model as the variables for modeling, leading to the development of a multiple linear regression model. The results show that the model using the three-stage wavelength selection algorithm outperforms those using the full spectrum, Stages I and Stage II, and the coefficient of determination of the test set of the Stage III-MLR model achieved an accuracy of 0.9360. Instead of the successive projections algorithm (SPA), uninformative variable elimination (UVE), and competitive adaptive reweighted sampling (CARS), Stage III is better in the model prediction accuracy. Therefore, the three-stage wavelength selection algorithm is an effective wavelength selection algorithm that can effectively model NIR spectroscopy, reduce the collinearity between the wavelength variables, simplify the complexity of the model, and improve the prediction precision of the model.

Improvement of NIR model by fractional order Savitzky–Golay derivation (FOSGD) coupled with wavelength selection

Spectral-information-divergence based local pls modeling algorithm in near infrared spectroscopy

Pretreating Near Infrared Spectra with Fractional Order Savitzky–Golay Differentiation（fosgd）

[A Simple and Convenient Standardization Algorithm of NIR Spectra].

Near-infrared spectroscopy soft-sensing method by combining partial least squares discriminant analysis and support vector machine

A local pre-processing method for near-infrared spectra, combined with spectral segmentation and standard normal variate transformation

Improvement of NIR Models for Quality Parameters of Leech and Earthworm Medicines Using Outlier Multiple Diagnoses

The Near Infrared Spectral Bands Optimal Selection in the Application of Liquor Fermented Grains Composition Analysis]

Piecewise Preprocessing of Near-Infrared Spectra for Improving Prediction Ability of a PLS Model

Key Variables Screening of Near-Infrared Models for Simultaneous Determination of Quality Parameters in Traditional Chinese Food “Fuzhu”

Comparison of several variable selection methods for quantitative analysis and monitoring of the Yangxinshi tablet process using near-infrared spectroscopy

Determination of Total Organic Carbon and Soluble Solids Contents in Tanreqing Injection Intermediates with NIR Spectroscopy and Chemometrics

New approach for near-infrared wavelength selection using a combination of MIC and firefly evolution

On-Line Monitoring of Extraction Process of Flos Lonicerae Japonicae Using Near Infrared Spectroscopy Combined with Synergy Interval Pls and Genetic Algorithm

Frequency self deconvolution in the quantitative analysis of near infrared spectra

Online updating of NIR model and its industrial application via adaptive wavelength selection and local regression strategy

Characteristic wavelength optimization for partial least squares regression using improved flower pollination algorithm

Pretreatment and Wavelength Selection Method for Near-Infrared Spectra Signal Based on Improved CEEMDAN Energy Entropy and Permutation Entropy.

Near-Infrared Wavelength-Selection Method Based on Joint Mutual Information and Weighted Bootstrap Sampling

A three-stage wavelength selection algorithm for near-infrared spectroscopy calibration

Application of a Fractional Order Differential to the Hyperspectral Inversion of Soil Iron Oxide