Abstract:This work provides a performance comparison of four different machine learning classifiers: multinomial logistic regression with ridge estimators (MLR) classifier, k-nearest neighbours (KNN), support vector machine (SVM) and naïve Bayes (NB) as applied to terahertz (THz) transient time domain sequences associated with pixelated images of different powder samples. The six substances considered, although have similar optical properties, their complex insertion loss at the THz part of the spectrum is significantly different because of differences in both their frequency dependent THz extinction coefficient as well as differences in their refractive index and scattering properties. As scattering can be unquantifiable in many spectroscopic experiments, classification solely on differences in complex insertion loss can be inconclusive. The problem is addressed using two-dimensional (2-D) cross-correlations between background and sample interferograms, these ensure good noise suppression of the datasets and provide a range of statistical features that are subsequently used as inputs to the above classifiers. A cross-validation procedure is adopted to assess the performance of the classifiers. Firstly the measurements related to samples that had thicknesses of 2mm were classified, then samples at thicknesses of 4mm, and after that 3mm were classified and the success rate and consistency of each classifier was recorded. In addition, mixtures having thicknesses of 2 and 4mm as well as mixtures of 2, 3 and 4mm were presented simultaneously to all classifiers. This approach provided further cross-validation of the classification consistency of each algorithm. The results confirm the superiority in classification accuracy and robustness of the MLR (least accuracy 88.24%) and KNN (least accuracy 90.19%) algorithms which consistently outperformed the SVM (least accuracy 74.51%) and NB (least accuracy 56.86%) classifiers for the same number of feature vectors across all studies. The work establishes a general methodology for assessing the performance of other hyperspectral dataset classifiers on the basis of 2-D cross-correlations in far-infrared spectroscopy or other parts of the electromagnetic spectrum. It also advances the wider proliferation of automated THz imaging systems across new application areas e.g., biomedical imaging, industrial processing and quality control where interpretation of hyperspectral images is still under development.

Comparative study of Discrete Wavelet Transforms and Wavelet Tensor Train decomposition to feature extraction of FTIR data of medicinal plants

An Overview of Infrared Spectroscopy Based on Continuous Wavelet Transform Combined with Machine Learning Algorithms: Application to Chinese Medicines, Plant Classification, and Cancer Diagnosis

Data mining of near and middle infrared spectroscopy for determination of dry matter content of tea based on wavelet packet transform

Wavelet-Based Classification and Influence Matrix Analysis Method for the Fast Discrimination of Chinese Herbal Medicines According to the Geographical Origins with Near Infrared Spectroscopy

Application of Wavelet Transform in Improving Resolution of Two-Dimensional Infrared Correlation Spectroscopy

A Study on the TM Classification of Vegetation Feature Based on Two-Dimensional Wavelet Transformation

Recognition of breast cancer subtypes using FTIR hyperspectral data

Application of Segmented Transformer Feature Extraction in Near Infrared Spectral Data Classification

A Novel Use of Discrete Wavelet Transform Features in the Prediction of Epileptic Seizures from EEG Data

The Impact of Preprocessing Methods for a Successful Prostate Cell Lines Discrimination Using Partial Least Squares Regression and Discriminant Analysis Based on Fourier Transform Infrared Imaging

Filter-processing-assisted Fourier transform Raman spectroscopy for forensic discrimination lubricant machinery oils

Expert System for Fourier Transform Infrared Spectra Recognition Based on a Convolutional Neural Network With Multiclass Classification

Discriminant Analysis Based on Wavelet Transform in Metabolomics Liquid Chromatography Data

Classification of THz pulse signals using two-dimensional cross-correlation feature extraction and non-linear classifiers

Feature extraction for functional time series: Theory and application to NIR spectroscopy data

A novel machine learning scheme for classification of medicinal herbs based on 2D-FTIR fingerprints

A novel two‐phase near‐infrared and midinfrared wavelength selection framework for sample classification

Application of Wavelet Transform in the Prediction of Chemical Composition of Sunflower Seeds by Near Infrared Reflectance Spectroscopy

Intelligent Extraction of Salient Feature From Electroencephalogram Using Redundant Discrete Wavelet Transform

The Application Of Fourier Transform Infrared Spectroscopy On The Quality Control Of Traditional Chinese Medicine Formula Particles

Infrared Images Spectra Multi-class Classification Model Based on Deep Learning