Abstract:In data mining and pattern classification, feature extraction and representation methods are a very important step since the extracted features have a direct and significant impact on the classification accuracy. In literature, numbers of novel feature extraction and representation methods have been proposed. However, many of them only focus on specific domain problems. In this article, we introduce a novel distance-based feature extraction method for various pattern classification problems. Specifically, two distances are extracted, which are based on (1) the distance between the data and its intra-cluster center and (2) the distance between the data and its extra-cluster centers. Experiments based on ten datasets containing different numbers of classes, samples, and dimensions are examined. The experimental results using naïve Bayes, k -NN, and SVM classifiers show that concatenating the original features provided by the datasets to the distance-based features can improve classification accuracy except image-related datasets. In particular, the distance-based features are suitable for the datasets which have smaller numbers of classes, numbers of samples, and the lower dimensionality of features. Moreover, two datasets, which have similar characteristics, are further used to validate this finding. The result is consistent with the first experiment result that adding the distance-based features can improve the classification performance.

A novel feature extraction algorithm

Statistical Probability Based Algorithm for Extracting Feature Points in 2-Dimensional Image

A Novel Pca Improved Algorithm

Information Feature Analysis and Improved Algorithm of PCA

Supervised Feature Extraction Algorithm Based on Improved Polynomial Entropy

MODIFIED KERNEL-BASED NONLINEAR FEATURE EXTRACTION

A Novel Feature Extraction Method Based on Feature Integration

A Supervised Feature Extraction Algorithm for Multi-class

Feature Selection Based on Quality of Information.

Combining Feature Selection With Extraction: Unsupervised Feature Selection Based On Principal Component Analysis

Efficient Kpca-Based Feature Extraction: A Novel Algorithm And Experiments

A Survey on Feature Extraction for Pattern Recognition

ICA and PCA Integrated Feature Extraction for Classification

On Improvement of Feature Extraction Algorithms for Discriminative Pattern Classification.

An Intrusion Detection Feature Extraction Method Based on Information Theory Model

Distance-based Features in Pattern Classification

A Combined Feature Selection Method Based on Clustering in Intrusion Detection

Effective Feature Extraction Algorithm for Iris Recognition

A New Supervised Feature Selection Method for Pattern Classification.

Ipcc: a Novel Feature Extraction Method for Accurate Disease Class Discovery and Prediction

A novel graph-embedding feature extraction method based on local and global inter-class graph