Abstract:The near-infrared spectral data is highly high dimensional and contains redundant information, it is necessary to identify the most representative characteristic wavelengths before modeling to improve model accuracy and reliability. At present, there are many methods for selecting the characteristic wavelengths of NIR spectroscopy, but the collinearity among wavelengths is still a main issue that leads to poor model effects. Therefore, this study proposes a three-stage wavelength selection algorithm (Stage III) to reduce redundancy in NIR spectral data and collinearity between wavelength variables, resulting in a simpler and more accurate predictive model. The research uses a public NIR data set of corn samples as its subject. Initially, the wavelengths with the higher correlation coefficients are chosen after calculating the relationship coefficients between every wavelength vector and the concentration vector. On this basis, the correlation coefficients between the vectors of each wavelength point are calculated, and those wavelength points with smaller correlation coefficients with other wavelength points are selected. Ultimately, the stepwise regression analysis selects the wavelengths that provide substantial value to the model as the variables for modeling, leading to the development of a multiple linear regression model. The results show that the model using the three-stage wavelength selection algorithm outperforms those using the full spectrum, Stages I and Stage II, and the coefficient of determination of the test set of the Stage III-MLR model achieved an accuracy of 0.9360. Instead of the successive projections algorithm (SPA), uninformative variable elimination (UVE), and competitive adaptive reweighted sampling (CARS), Stage III is better in the model prediction accuracy. Therefore, the three-stage wavelength selection algorithm is an effective wavelength selection algorithm that can effectively model NIR spectroscopy, reduce the collinearity between the wavelength variables, simplify the complexity of the model, and improve the prediction precision of the model.

Weighted Fusion of Multiple Models for Wavelength Selection

[Spectral Wavelength Selection Based on PLS Projection Analysis].

Multi-way Partial Least Squares Modeling for Three-Dimensional Fluorescence Spectrometry

Improved Weighted Least Squares Support Vector Machines Algorithm And Its Applications In Spectroscopic Quantitative Analysis

Application Of Partial Least Squares Support Vector Machines (Pls-Svm) In Spectroscopy Quantitative Analysis

Multi-frequency Data Fusion Via Joint Weighted Deconvolution for Resolution Enhancement

Simultaneous wavelength selection and outlier detection in multivariate regression of near-infrared spectra

Near-Infrared Wavelength-Selection Method Based on Joint Mutual Information and Weighted Bootstrap Sampling

Subspace Partial Least Squares Model for Multivariate Spectroscopic Calibration

An Objective Wavelength Selection Method Based on Moving Window Partial Least Squares for Near-Infrared Spectroscopy.

A three-stage wavelength selection algorithm for near-infrared spectroscopy calibration

Soft variable selection combining partial least squares and attention mechanism for multivariable calibration

High-level Fusion Coupled with Mahalanobis Distance Weighted (MDW) Method for Multivariate Calibration

Method of Wavelength Selection for Partial Least Squares

New approach for near-infrared wavelength selection using a combination of MIC and firefly evolution

Hyperspectral-Multispectral Image Fusion with Weighted LASSO

Physiology of Canine Intraventricular Conduction and Endocardial Excitation

Multi-sensor weighted data fusion method using LMS algorithm

Jones, R.L., Somerville, C.R., Walbot, V. (ed.): Annual Review of Plant Physiology and Plant Molecular Biology. Vol. 49, 1998

A novel hybrid variable selection strategy with application to molecular spectroscopic analysis

Weight Scope Alignment: A Frustratingly Easy Method for Model Merging