Influence of data preprocessing on NIRS analysis for oil yield of oil shale

WANG Zhi-hong,LIU Jie,WANG Jing-ru,SUN Yu-yang,YU Yong,LIN Jun
DOI: https://doi.org/10.7964/jdxbgxb201304028
2013-01-01
Abstract:An appropriate data pre-processing method is needed to improve the modeling precision for oil yield analysis of oil shale in situ by the near infrared spectroscopy(NIRS)analysis technique.With nature and proportioning samples,the spectra preprocessing and Partial Least Square(PLS) modeling experiments were carried out by two ways(spectra and matrix) of data preprocessing.Results show that the appropriate spectra preprocessing(including first derivative,auto-scaling,mean centralization and some combined methods,such as adding mean centralization after smoothing,denoising and de-baseline,respectively) can enhance the spectrum identity of the same sample.Three combined data preprocessing methods(including combined mean centralization or first derivative spectra preprocessing with auto-scaling matrix preprocessing) can improve the precision of NIRS analysis of PLS model for oil yield from proportioning samples.
What problem does this paper attempt to address?