Abstract:An essential step in the application of near infrared spectroscopy technology is the spectrum preprocessing. A reasonable implementation of it ensures that the effective spectral information is correctly extracted and, also that the model's accuracy is increased. However, some analysts' research still uses the manual approach of trial and error, particularly those less skilled ones. Previous papers have provided preprocessing optimization algorithms for NIR, but there are still some problems that need to be resolved, such as the unwieldy sequence determination of preprocessing method or, the fluctuated optimization outcomes or, lack of sufficient statistical information. This research suggests a spectrum auto-analysis methodology named self-expansion full information optimization strategy, a new powerful open-source technique for concurrently addressing all of these above issues simultaneously. For the first time in the field of chemometrics, this algorithm offers a reliable and effective automatic near infrared auto-modelling method based on the statistical informatics. With the aid of its built-in modules, such as information generators, spectrum processors, etc., it is able to fully search the common preprocessing techniques, which is determined by Monte Carlo cross validation. Then the final ensemble calibration model is built by employing the optimized preprocessing schemes, along with the wavelength variables screening algorithm. The optimization strategy can offer the user objective useful statistics information created throughout the modeling process to further examine the model's effectiveness. The results demonstrate that the suggested method can easily and successfully extract spectrum information and develop calibration models by putting it to the test on two groups of actual near-infrared spectral data. Additionally, this optimization strategy can also be applied to other spectrum analysis areas, such Raman spectroscopy or infrared spectroscopy, by changing a few of its parameters, and has extraordinary application value.

A robust calibration modeling strategy for analysis of interference-subject spectral data

Spectra Data Analysis and Calibration Modeling Method Using Spectra Subspace Separation and Multiblock Independent Component Regression Strategy

Raman spectral quantitative analysis based on peaks-decomposition

Broadening the Scope of Food Quality Control: a Calibration Transfer Strategy for Minimizing External Influences on Spectral Analysis

Modified Indirect Hard Modeling for Non-invasive Raman Measurements Containing Surface Interference

Multiset independent component regression (MsICR) based statistical data analysis and calibration modeling

Spectra Calibration Modeling and Statistical Analysis for Cumulative Quality Interpretation and Prediction

A New Method for Recognition of Independent Noise Sources of Complex System under Strong Noisy Environment

Support vector machine classification and regression based hybrid modeling method and its application in Raman spectral analysis

Two-Level Independent Component Regression Model for Multivariate Spectroscopic Calibration

Analysis of Terahertz Time Domain Spectroscopy of Mixtures Based on Indirect Hard Modeling Method

Sensitivity and Uncertainty Analysis of Nonideal Calibration Standards for 16-Term Error Model

Phase-Based Joint Modeling and Spectroscopy Analysis for Batch Processes Monitoring

An Improved Statistical Modeling Strategy by Spectroscopy for Online Monitoring and Diagnosis of Batch Processes

Subspace Partial Least Squares Model for Multivariate Spectroscopic Calibration

Multiblock-Based Qualitative and Quantitative Spectral Calibration Analysis

Optical Coefficient‐based Multivariate Calibration on Near‐infrared Spectroscopy

Mrf-Ica Mixture Model for Hyperspectral Imagery Unmixing

Self-expansion full information optimization strategy: Convenient and efficient method for near infrared spectrum auto-analysis

An improved independent component regression modeling and quantitative calibration procedure

Blind source separation of coexisting background in Raman spectra