Abstract:To tackle the challenges in genomic data analysis caused by their tens of thousands of dimensions while having a small number of examples and unbalanced examples between classes, the technique of unsupervised feature selection based on standard deviation and cosine similarity is proposed in this paper. We refer to this idea as SCFS (Standard deviation and Cosine similarity based Feature Selection). It defines the discernibility and independence of a feature to value its distinguishable capability between classes and its redundancy to other features, respectively. A 2-dimensional space is constructed using discernibility as x-axis and independence as y-axis to represent all features where the upper right corner features have both comparatively high discernibility and independence. The importance of a feature is defined as the product of its discernibility and its independence (i.e., the area of the rectangular enclosed by the feature’s coordinate lines and axes). The upper right corner features are by far the most important, comprising the optimal feature subset. Based on different definitions of independence using cosine similarity, there are three feature selection algorithms derived from SCFS. These are SCEFS (Standard deviation and Exponent Cosine similarity based Feature Selection), SCRFS (Standard deviation and Reciprocal Cosine similarity based Feature Selection) and SCAFS (Standard deviation and Anti-Cosine similarity based Feature Selection), respectively. The KNN and SVM classifiers are built based on the optimal feature subsets detected by these feature selection algorithms, respectively. The experimental results on 18 genomic datasets of cancers demonstrate that the proposed unsupervised feature selection algorithms SCEFS, SCRFS and SCAFS can detect the stable biomarkers with strong classification capability. This shows that the idea proposed in this paper is powerful. The functional analysis of these biomarkers show that the occurrence of the cancer is closely related to the biomarker gene regulation level. This fact will benefit cancer pathology research, drug development, early diagnosis, treatment and prevention.

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

FG-HFS: A feature filter and group evolution hybrid feature selection algorithm for high-dimensional gene expression data

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

A novel ensemble-based wrapper method for feature selection using extreme learning machine and genetic algorithm

Fuzzy clustering decomposition of genetic algorithm-based instance selection for regression problems

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

An Approximate Markov Blanket Feature Selection Algorithm

A novel community detection based genetic algorithm for feature selection

Gene Selection Algorithm Based on Correlation Analysis

A Surrogate-Assisted Evolutionary Feature Selection Algorithm with Parallel Random Grouping for High-Dimensional Classification

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

The Unsupervised Feature Selection Algorithms Based on Standard Deviation and Cosine Similarity for Genomic Data Analysis

Multi-Label Feature Selection Method Combining Unbiased Hilbert-Schmidt Independence Criterion With Controlled Genetic Algorithm

Feature selection based on run covering

A Two-Phase Feature Selection Method Using Both Filter and Wrapper

A Tribe Competition-Based Genetic Algorithm for Feature Selection in Pattern Classification

A problem-specific non-dominated sorting genetic algorithm for supervised feature selection

Feature selection based on artificial bee colony and gradient boosting decision tree

An information-theoretic feature selection method based on estimation of Markov blanket

A novel feature selection method for data mining tasks using hybrid Sine Cosine Algorithm and Genetic Algorithm