Abstract:Calibration regression models based on visible and near-infrared (Vis/NIR) spectroscopy are now widely used in the rapid non-destructive prediction of agricultural products' quality parameters. However, the distributions of products' quality parameters and spectral responses are different in various batches of products, so a calibration regression model built on one dataset might be ineffective when tested in another. How to improve the generalization ability of models is a crucial problem and is formulated as 'Calibration Transfer'. Calibration transfer was firstly proposed to eliminate the difference of spectral responses between spectrometers, but now it has been applied in the transfer between different domains of spectral samples or different components. In this paper, we proposed two robust models with great generalization ability in the calibration transfer task, respectively using dimension reduction and transfer learning, namely SPRS (Standard normal variate, Partial least squares dimension reduction, Ridge regression, Slope/bias) and SNV-based Aug-TrAdaBoost.R2. We tested the two models in spectral datasets of tea leaves to predict the moisture content of samples, it was found that SPRS and SNV-based Aug-TrAdaBoost.R2 can reach great performance over both source and target domains across different batches, different varieties, and different classes of tea leaf samples. SPRS and SNV-based Aug-TrAdaBoost.R2 achieved R2 values of 0.9314 and 0.9895 in cross-tea-class prediction whereas traditional calibration method PLSR + S/B only achieved 0.4874. SPRS had low computation complexity and was more robust while SNV-based Aug-TrAdaBoost.R2 had higher accuracy in target domain prediction but was computationconsuming. The two proposed models showed the potentials of online automatic quality parameters prediction and high-accuracy prediction across domains of various samples.

Parallel Calibration Revisited: the Second Direction for Shrinkage Estimation of Regression Coefficients Can Be As Natural and Necessary As the Traditional One.

Local Regression Algorithm Based on Net Analyte Signal and Its Application in Near Infrared Spectral Analysis

Subspace Partial Least Squares Model for Multivariate Spectroscopic Calibration

The Application of Piecewise Direct Standardization with Snv in Calibration Transfer of Raman Spectra

Broadening the Scope of Food Quality Control: a Calibration Transfer Strategy for Minimizing External Influences on Spectral Analysis

Comparison of least square support vector machine-based calibration methods in diesel property analysis by near infrared spectroscopy

Support vector machine classification and regression based hybrid modeling method and its application in Raman spectral analysis

Eliminating Material Dependency in Spectra Measurement Via Non‐neighbouring Band Regression

Application Of Partial Least Squares Support Vector Machines (Pls-Svm) In Spectroscopy Quantitative Analysis

On Multivariate Calibration Problems

Two-Level Independent Component Regression Model for Multivariate Spectroscopic Calibration

Sampling Error Profile Analysis for Calibration Transfer in Multivariate Calibration

A New Strategy of Least Absolute Shrinkage and Selection Operator Coupled with Sampling Error Profile Analysis for Wavelength Selection

A Sparse Piecewise Calibration Method for Potentiometer with Inherent Nonlinearity: A Comparison Study

Optical Coefficient‐based Multivariate Calibration on Near‐infrared Spectroscopy

Semi-Supervised Machine Learning Algorithm in Near Infrared Spectral Calibration: A Case Study on Diesel Fuels

Weighted SPXY Method for Calibration Set Selection for Composition Analysis Based on Near-Infrared Spectroscopy

PFCE2: A versatile parameter-free calibration enhancement framework for near-infrared spectroscopy

Comparative study of linear and nonlinear calibration algorithm for extrapolation problem of near infrared spectroscopy quantitative analysis

Calibration modeling by partial least-squares and principal component regression and its optimization using an improved leverage correction for prediction testing

Boosting the Generalization Ability of Vis-NIR-spectroscopy-based Regression Models Through Dimension Reduction and Transfer Learning.