Abstract:The near-infrared spectral data is highly high dimensional and contains redundant information, it is necessary to identify the most representative characteristic wavelengths before modeling to improve model accuracy and reliability. At present, there are many methods for selecting the characteristic wavelengths of NIR spectroscopy, but the collinearity among wavelengths is still a main issue that leads to poor model effects. Therefore, this study proposes a three-stage wavelength selection algorithm (Stage III) to reduce redundancy in NIR spectral data and collinearity between wavelength variables, resulting in a simpler and more accurate predictive model. The research uses a public NIR data set of corn samples as its subject. Initially, the wavelengths with the higher correlation coefficients are chosen after calculating the relationship coefficients between every wavelength vector and the concentration vector. On this basis, the correlation coefficients between the vectors of each wavelength point are calculated, and those wavelength points with smaller correlation coefficients with other wavelength points are selected. Ultimately, the stepwise regression analysis selects the wavelengths that provide substantial value to the model as the variables for modeling, leading to the development of a multiple linear regression model. The results show that the model using the three-stage wavelength selection algorithm outperforms those using the full spectrum, Stages I and Stage II, and the coefficient of determination of the test set of the Stage III-MLR model achieved an accuracy of 0.9360. Instead of the successive projections algorithm (SPA), uninformative variable elimination (UVE), and competitive adaptive reweighted sampling (CARS), Stage III is better in the model prediction accuracy. Therefore, the three-stage wavelength selection algorithm is an effective wavelength selection algorithm that can effectively model NIR spectroscopy, reduce the collinearity between the wavelength variables, simplify the complexity of the model, and improve the prediction precision of the model.

A Progressive Combined Variable Selection Method for Near-Infrared Spectral Analysis Based on Three-Step Hybrid Strategy

Quantitative analysis of soil potassium by near-infrared (NIR) spectroscopy combined with a three-step progressive hybrid variable selection strategy

Combination of heuristic optimal partner bands for variable selection in near-infrared spectral analysis: Variable selection for near infrared spectral analysis

A Near Infrared Wavelength Selection Method Based on the Variable Stability and Population Analysis

A hybrid variable selection method combining Fisher's linear discriminant combined population analysis and an improved binary cuckoo search algorithm

A Hybrid Variable Selection Strategy Based on Continuous Shrinkage of Variable Space in Multivariate Calibration

Feasibility Study Of Near Infrared Spectroscopy With Variable Selection For Non-Destructive Determination Of Quality Parameters In Shell-Intact Cottonseed

Research Advance of Variable Selection Algorithms in Near Infrared Spectroscopy Analysis

Application of Near Infrared Spectroscopy Combined with Particle Swarm Optimization Based Least Square Support Vactor Machine to Rapid Quantitative Analysis of Corni Fructus

An Overview of Variable Selection Methods in Multivariate Analysis of Near-Infrared Spectra

An efficient variable selection method based on variable permutation and model population analysis for multivariate calibration of NIR spectra

Comparison of several variable selection methods for quantitative analysis and monitoring of the Yangxinshi tablet process using near-infrared spectroscopy

Near Infrared System Coupled Chemometric Algorithms for the Variable Selection and Prediction of Baicalin in Three Different Processes.

A three-stage wavelength selection algorithm for near-infrared spectroscopy calibration

Quantitative Analysis of Soil Nitrogen, Organic Carbon, Available Phosphorous, and Available Potassium Using Near-Infrared Spectroscopy Combined with Variable Selection

Determination of Soil Nitrogen and Organic Carbon from Near-infrared Reflectance with Variable Selection

Feature Variable Selection for Near‐Infrared Spectroscopy Based on Simulated Annealing Bee Colony Algorithm

An Variable Selection Method of the Significance Multivariate Correlation Competitive Population Analysis for Near-Infrared Spectroscopy in Chemical Modeling

A variable importance criterion for variable selection in near-infrared spectral analysis

Near Infrared Spectral Variable Optimization by Final Complexity Adapted Models Combined with Uninformative Variables Elimination-a Validation Study

Non-Invasive Detection of Protein Content in Corn Distillers Dried Grains with Solubles: Method for Selecting Spectral Variables to Construct High-Performance Calibration Model Using Near Infrared Reflectance Spectroscopy