Abstract:Fourier transform near-infrared (FT-NIR) spectroscopy is a versatile and non-destructive analytical tool widely utilized in industries such as food, pharmaceuticals, and agriculture. While traditional FT-NIR instruments pose limitations in terms of cost and complexity, the advent of portable and affordable systems like NeoSpectra Scanners has broadened accessibility. Partial Least Squares Regression (PLSR) stands as an industry-standard method in Chemometrics for analyzing chemical compositions. This work addresses optimizing PLSR models in FT-NIR spectroscopy, focusing on enhancing accuracy and adaptability in material analysis. Unlike traditional PLSR models which often rely on grid searching a limited number of parameters, such as latent variables, the presented approach effectively expands the parameter space. A novel framework combining Bayesian search and stacking techniques is introduced to enable more customization while ensuring time and performance efficiency, along with automation in model development. Bayesian search efficiently explores hyperparameters space, enabling faster convergence to optimal model settings without exhaustive exploration. The proposed stacked model leverages learned knowledge from the top-performing PLSR models optimized through Bayesian methods, amalgamating a unified and potent body of knowledge. Bayesian-stacked models are compared with PLSR models that use grid search for a limited parameter set. Findings show a marked improvement in model performance: a 51.5 % reduction in Root Mean Square Error (RMSE) for the training dataset and a 26.1 % reduction for the testing dataset, alongside a 10.9 % increase in the correlation coefficient square (R 2 ) for the training dataset and a 10.4 % increase for the testing dataset. Notably, Bayesian search reduces the model optimization time by approximately 90% compared with the grid search. Furthermore, when addressing instrumental variations, the models demonstrate an additional improvement, evident in the average reduction of 24.1 % in the mean range of prediction. Overall, results demonstrate that the presented approach not only increases the prediction accuracy but also offers a more efficient, automated and robust solution for diverse spectroscopic applications.

Calibration modeling by partial least-squares and principal component regression and its optimization using an improved leverage correction for prediction testing

Maximum Likelihood Estimators in a Two Step Model for PLS

Support vector machine classification and regression based hybrid modeling method and its application in Raman spectral analysis

Estimating the influence of experimental parameters on the prediction error of PLS calibration models based on Raman spectra

Comparison of least square support vector machine-based calibration methods in diesel property analysis by near infrared spectroscopy

Robust Local Pcr and Its Application in Nir Spectral Quantitative Analysis

[Near-Infrared Spectral Quantitative Analysis by Combining Classification with Local PLS].

Calibration of a Multi-Beam LIDAR by Using Linear Instrumental Error Model

Systematic prediction error correction: A novel strategy for maintaining the predictive abilities of multivariate calibration models

Subspace Partial Least Squares Model for Multivariate Spectroscopic Calibration

Calibration Transfer From Pharmaceutical Powder Mixtures To Compacts Using The Prediction Augmented Classical Least Squares (Pacls) Method

Evaluation of principal component selection methods to form a global prediction model by principal component regression

A Sparse Piecewise Calibration Method for Potentiometer with Inherent Nonlinearity: A Comparison Study

Two-Level Independent Component Regression Model for Multivariate Spectroscopic Calibration

Semi-Supervised Machine Learning Algorithm in Near Infrared Spectral Calibration: A Case Study on Diesel Fuels

Variance constrained partial least squares

Laplacian Regularized Least Squares Regression and Its Dynamic Parameter Optimization for Near Infrared Spectroscopy Modeling

Unbiased prediction errors for partial least squares regression models: Choosing a representative error estimator for process monitoring

Advancing near-infrared spectroscopy: A synergistic approach through Bayesian optimization and model stacking

Improvement of PLS model transferability by robust wavelength selection

A correlation principal component regression analysis of NIR data