Abstract:Medical data includes clinical trials and clinical data such as patient-generated health data, laboratory results, medical imaging, and different signals coming from continuous health monitoring. Some commonly used data analysis techniques are text mining, big data analytics, and data mining. These techniques can be used for classification, clustering, and machine learning tasks. Machine learning could be described as an automatic learning process derived from concepts and knowledge without deliberate system coding. However, finding a suitable machine learning architecture for a specific task is still an open problem. In this work, we propose a machine learning model for the multi-class classification of medical data. This model is comprised of two components—a restricted Boltzmann machine and a classifier system. It uses a discriminant pruning method to select the most salient neurons in the hidden layer of the neural network, which implicitly leads to a selection of features for the input patterns that feed the classifier system. This study aims to investigate whether information-entropy measures may provide evidence for guiding discriminative pruning in a neural network for medical data processing, particularly cancer research, by using three cancer databases: Breast Cancer, Cervical Cancer, and Primary Tumour. Our proposal aimed to investigate the post-training neuronal pruning methodology using dissimilarity measures inspired by the information-entropy theory; the results obtained after pruning the neural network were favourable. Specifically, for the Breast Cancer dataset, the reported results indicate a 10.68% error rate, while our error rates range from 10% to 15%; for the Cervical Cancer dataset, the reported best error rate is 31%, while our proposal error rates are in the range of 4% to 6%; lastly, for the Primary Tumour dataset, the reported error rate is 20.35%, and our best error rate is 31%.

Neural Network Ensemble Pruning Using Sensitivity Measure in Web Applications

Class-Aware Pruning for Efficient Neural Networks

Sensitivity Pruner: Filter-Level Compression Algorithm for Deep Neural Networks

Small Contributions, Small Networks: Efficient Neural Network Pruning Based on Relative Importance

Beyond Pruning Criteria: The Dominant Role of Fine-Tuning and Adaptive Ratios in Neural Network Robustness

SNPF: Sensitiveness Based Network Pruning Framework for Efficient Edge Computing

Multiple Sparse Spaces Network Pruning Via a Joint Similarity Criterion

Is Complexity Required for Neural Network Pruning? A Case Study on Global Magnitude Pruning

Pruning artificial neural networks using neural complexity measures

PSE-Net: Channel Pruning for Convolutional Neural Networks with Parallel-subnets Estimator

Multi-Class Classification of Medical Data Based on Neural Network Pruning and Information-Entropy Measures

Effective Subset Selection Through The Lens of Neural Network Pruning

What is the State of Neural Network Pruning?

Learning Sparse Structured Ensembles with Stochastic Gradient MCMC Sampling and Network Pruning.

Neural Network Pruning by Cooperative Coevolution

Multiobjective ResNet Pruning by Means of EMOAs for Remote Sensing Scene Classification

Personalized Classifier Ensemble Pruning Framework for Mobile Crowdsourcing.

SIECP: Neural Network Channel Pruning based on Sequential Interval Estimation

MEPSI: an MDL-Based Ensemble Pruning Approach with Structural Information