Abstract:The near-infrared spectral data is highly high dimensional and contains redundant information, it is necessary to identify the most representative characteristic wavelengths before modeling to improve model accuracy and reliability. At present, there are many methods for selecting the characteristic wavelengths of NIR spectroscopy, but the collinearity among wavelengths is still a main issue that leads to poor model effects. Therefore, this study proposes a three-stage wavelength selection algorithm (Stage III) to reduce redundancy in NIR spectral data and collinearity between wavelength variables, resulting in a simpler and more accurate predictive model. The research uses a public NIR data set of corn samples as its subject. Initially, the wavelengths with the higher correlation coefficients are chosen after calculating the relationship coefficients between every wavelength vector and the concentration vector. On this basis, the correlation coefficients between the vectors of each wavelength point are calculated, and those wavelength points with smaller correlation coefficients with other wavelength points are selected. Ultimately, the stepwise regression analysis selects the wavelengths that provide substantial value to the model as the variables for modeling, leading to the development of a multiple linear regression model. The results show that the model using the three-stage wavelength selection algorithm outperforms those using the full spectrum, Stages I and Stage II, and the coefficient of determination of the test set of the Stage III-MLR model achieved an accuracy of 0.9360. Instead of the successive projections algorithm (SPA), uninformative variable elimination (UVE), and competitive adaptive reweighted sampling (CARS), Stage III is better in the model prediction accuracy. Therefore, the three-stage wavelength selection algorithm is an effective wavelength selection algorithm that can effectively model NIR spectroscopy, reduce the collinearity between the wavelength variables, simplify the complexity of the model, and improve the prediction precision of the model.

Online updating of NIR model and its industrial application via adaptive wavelength selection and local regression strategy

Local Regression Algorithm Based on Net Analyte Signal and Its Application in Near Infrared Spectral Analysis

A Novel Adaptive Algorithm with Near-Infrared Spectroscopy and Its Application in Online Gasoline Blending Processes

Application of Near Infrared Spectroscopy Combined with Competitive Adaptive Reweighted Sampling Partial Least Squares for On-Line Monitoring of the Concentration Process of Wangbi Tablets

Semi-Supervised Machine Learning Algorithm in Near Infrared Spectral Calibration: A Case Study on Diesel Fuels

A Comparative Study of Representative Subset Selection for NIR Model Updating

A New Sample-Selection and Modeling Method Based on Near-Infrared Spectroscopy and Its Industrial Application

Near-Infrared Wavelength-Selection Method Based on Joint Mutual Information and Weighted Bootstrap Sampling

A New Local Modelling Approach Based On Predicted Errors For Near-Infrared Spectral Analysis

Novel Adaptive Sample Space Expansion Approach of NIR Model for In-Situ Measurement of Gasoline Octane Number in Online Gasoline Blending Processes

Near-infrared spectroscopy for the concurrent quality prediction and status monitoring of gasoline blending

NIR Spectroscopy As a Process Analytical Technology (PAT) Tool for On-Line and Real-Time Monitoring of an Extraction Process

A three-stage wavelength selection algorithm for near-infrared spectroscopy calibration

Near infrared spectroscopy in combination with chemometrics as a process analytical technology (PAT) tool for on-line quantitative monitoring of alcohol precipitation.

Determination of Total Organic Carbon and Soluble Solids Contents in Tanreqing Injection Intermediates with NIR Spectroscopy and Chemometrics

A Strategy for Enhancing the Reliability of Near-Infrared Spectral Analysis

Weighted incremental minimax probability machine-based method for quality prediction in gasoline blending process

Laplacian Regularized Least Squares Regression and Its Dynamic Parameter Optimization for Near Infrared Spectroscopy Modeling

A Novel Adaptive Robust NIR Modeling Method Based on Sparse Bayesian Learning

Application of Intelligent Optimization Algorithms to Wavelength Selection of Near-Infrared Spectroscopy

Application of Nonlinear Correction Algorithm in Near Infrared Spectra Analysis During On-Site Quick Detection