Abstract:Semi-supervised learning targets the common situation where labeled data are scarce but unlabeled data are abundant. It uses unlabeled data to help supervised learning tasks. In practice, it may make sense to utilize active learning in conjunction with semi-supervised learning. That is, we might allow the learning algorithm to pick a set of unlabeled instances to be labeled by a domain expert, which will then be used as the labeled data set. However, existing approaches are computationally expensive and require searching through an entire unlabeled dataset, which may contain redundant instances that provide no instructive information to the classifier and can decrease the performance. To address this optimization problem, a hybrid system that combines active learning (AL) and particle swarm optimization (PSO) algorithms is proposed to reduce the cost of labeling while building a more efficient classifier. The novelty of this work resides in the integration of a bio-inspired optimization algorithm in the machine learning strategy. Furthermore, a novel uncertainty measure was integrated into the particle swarm optimization algorithm as an objective function to select from massive amounts of medical instances those that are deemed most informative. To evaluate the effectiveness of the proposed approach, eighteen (18) benchmark datasets were used and compared against three best-known classifiers with different learning paradigms: AL–NB an active learning algorithm using Naïve Base classifier and Margin Sampling strategy, SVM (Support Vector Machine), ELM (Extreme Learning Machine) with supervised learning, and TSVM (Transductive Support Vector Machine) with the semi-supervised learning. Experiments showed that the proposed approach is effective in reducing the efforts required by experts for medical data annotation to produce an accurate classifier. The active learning approach has been utilized to optimize the expensive task of labeling. Based on a novel uncertainty measure, the nature-inspired algorithm PSO attempts to select from massive amounts of unlabeled medical instances those considered informative, at the same time improving the classifier performance. The experiments carried out confirm that the proposed strategy significantly enhances the performance of the AL algorithm compared with the commonly used uncertainty strategies. It achieves a performance similar to that of fully supervised and semi-supervised algorithms while requiring much less labeling. As a future extension of this work, it would be interesting to integrate other evolutionary optimization algorithms and compare them with our approach. In addition, it is beneficial to test the impact of using other variants of PSO algorithm in our approach. Also, it is aimed to test more classification algorithms in the experimentation process.

SA-PSO-GK++: A New Hybrid Clustering Approach for Analyzing Medical Data

A Novel Hybrid Clustering Based on Adaptive ACO and PSO

A Novel Hybrid PSO-K-Means Clustering Algorithm Using Gaussian Estimation of Distribution Method and Lévy Flight

Clustering Multidimensional Data with PSO based Algorithm

Automatic Data Clustering Based on Hybrid Atom Search Optimization and Sine-Cosine Algorithm.

Canonical PSO Based k-Means Clustering Approach for Real Datasets

An Effective Clustering Method Using a Discrete Particle Swarm Optimization Algorithm-Based Hybrid Approach

A Novel Hybrid K-harmonic Means and Gravitational Search Algorithm Approach for Clustering

Accelerated Two-Stage Particle Swarm Optimization for Clustering Not-Well-Separated Data

An Efficient Hybrid Approach Based on PSO, ABC and K-Means for Cluster Analysis

A Novel Particle Swarm Optimization Approach for Patient Clustering from Emergency Departments

A New Particle Swarm Optimization Algorithm For Clustering

A hybrid PSO-GSA strategy for high-dimensional optimization and microarray data clustering

A mixed clustering algorithm combining improved particle swarm optimization and K-harmonic means

ParSymG: a Parallel Clustering Approach for Unsupervised Classification of Remotely Sensed Imagery

Two-Step Hybrid PSO-Based Clustering Algorithm

Automatic Data Clustering by Hybrid Enhanced Firefly and Particle Swarm Optimization Algorithms

Bio-inspired weighed quantum particle swarm optimization and smooth support vector machine ensembles for identification of abnormalities in medical data

A Fast Hybrid Feature Selection Method Based on Dynamic Clustering and Improved Particle Swarm Optimization for High-Dimensional Health Care Data

A Population-Based Clustering Technique Using Particle Swarm Optimization and K-Means.

Particle Swarm Optimization Based Swarm Intelligence for Active Learning Improvement: Application on Medical Data Classification