Abstract:This work provides a performance comparison of four different machine learning classifiers: multinomial logistic regression with ridge estimators (MLR) classifier, k-nearest neighbours (KNN), support vector machine (SVM) and naïve Bayes (NB) as applied to terahertz (THz) transient time domain sequences associated with pixelated images of different powder samples. The six substances considered, although have similar optical properties, their complex insertion loss at the THz part of the spectrum is significantly different because of differences in both their frequency dependent THz extinction coefficient as well as differences in their refractive index and scattering properties. As scattering can be unquantifiable in many spectroscopic experiments, classification solely on differences in complex insertion loss can be inconclusive. The problem is addressed using two-dimensional (2-D) cross-correlations between background and sample interferograms, these ensure good noise suppression of the datasets and provide a range of statistical features that are subsequently used as inputs to the above classifiers. A cross-validation procedure is adopted to assess the performance of the classifiers. Firstly the measurements related to samples that had thicknesses of 2mm were classified, then samples at thicknesses of 4mm, and after that 3mm were classified and the success rate and consistency of each classifier was recorded. In addition, mixtures having thicknesses of 2 and 4mm as well as mixtures of 2, 3 and 4mm were presented simultaneously to all classifiers. This approach provided further cross-validation of the classification consistency of each algorithm. The results confirm the superiority in classification accuracy and robustness of the MLR (least accuracy 88.24%) and KNN (least accuracy 90.19%) algorithms which consistently outperformed the SVM (least accuracy 74.51%) and NB (least accuracy 56.86%) classifiers for the same number of feature vectors across all studies. The work establishes a general methodology for assessing the performance of other hyperspectral dataset classifiers on the basis of 2-D cross-correlations in far-infrared spectroscopy or other parts of the electromagnetic spectrum. It also advances the wider proliferation of automated THz imaging systems across new application areas e.g., biomedical imaging, industrial processing and quality control where interpretation of hyperspectral images is still under development.

Improved fuzzy C-means clustering algorithm based on t-SNE for terahertz spectral recognition

Target detection of THz images based on C-means of fuzzy local information

Classification and Identification of Human Colon Cancer Cell Line in Terahertz Domain Using T-Sne

Concise Cascade Methods for Transgenic Rice Seed Discrimination Using Spectral Phenotyping

A novel technology for rapid identification of hemp fibers by terahertz spectroscopy

Interval-based sparse ensemble multi-class classification algorithm for terahertz data

Classification of tea based on terahertz time domain spectroscopy

THz Spectroscopic Decomposition and Analysis in Mixture Inspection Using Soft Modeling Methods

Classification and Identification of Amino Acids Based on Thz Spectroscopy

Application of Terahertz Time Domain Spectroscopy in Identification of Textile Fiber

Analysis of Terahertz Time Domain Spectroscopy of Mixtures Based on Indirect Hard Modeling Method

Application of terahertz time-domain spectroscopy combined with support vector machine to determine tea and pesticide samples

Research on Discrimination Method of Absorption Peak in Terahertz Regime

Classification of THz pulse signals using two-dimensional cross-correlation feature extraction and non-linear classifiers

Preliminary study on discrimination of transgenic cotton seeds using terahertz time‐domain spectroscopy

Study on Glycoprotein Terahertz Time-Domain Spectroscopy Based on Composite Multiscale Entropy Feature Extraction Method.

Component Spectra Extraction from Terahertz Measurements of Unknown Mixtures.

Topological Organization for Hybrid Rice Growth Stages Phenotype Based on Contrastive Clustering

Discrimination of Transgenic Rice containing the Cry1Ab Protein using Terahertz Spectroscopy and Chemometrics

Fingerprint terahertz spectroscopy combined with machine learning for multicomponent mixture analysis

Comparison of Spectral Clustering, K-clustering and Hierarchical Clustering on E-Nose Datasets: Application to the Recognition of Material Freshness, Adulteration Levels and Pretreatment Approaches for Tomato Juices