Abstract:This work presents a generic computer vision system designed for exploiting trained deep Convolutional Neural Networks (CNN) as a generic feature extractor and mixing these features with more traditional hand-crafted features. Such a system is a single structure that can be used for synthesizing a large number of different image classification tasks. Three substructures are proposed for creating the generic computer vision system starting from handcrafted and non-handcrafter features: i)one that remaps the output layer of a trained CNN to classify a different problem using an SVM; ii) a second for exploiting the output of the penultimate layer of a trained CNN as a feature vector to feed an SVM; and iii) a third for merging the output of some deep layers, applying a dimensionality reduction method, and using these features as the input to an SVM. The application of feature transform techniques to reduce the dimensionality of feature sets coming from the deep layers represents one of the main contributions of this paper. Three approaches are used for the non-handcrafted features: deep transfer learning features based on convolutional neural networks (CNN), principal component analysis network (PCAN), and the compact binary descriptor (CBD). For the handcrafted features, a wide variety of state-of-the-art algorithms are considered: Local Ternary Patterns, Local Phase Quantization, Rotation Invariant Co-occurrence Local Binary Patterns, Completed Local Binary Patterns, Rotated local binary pattern image, Globally Rotation Invariant Multi-scale Co-occurrence Local Binary Pattern, and several others. The computer vision system based on the proposed approach was tested on many different datasets, demonstrating the generalizability of the proposed approach thanks to the strong performance recorded. The Wilcoxon signed rank test is used to compare the different methods; moreover, the independence of the different methods is studied using the Q-statistic. To facilitate replication of our experiments, the MATLAB source code will be available at (https://www.dropbox.com/s/bguw035yrqz0pwp/ElencoCode.docx?dl=0).

Deep learning and hand-crafted features for virus image classification

Deep Learning Methods for Virus Identification from Digital Images

Deep Learning of Dual Plasma Fingerprints for High-Performance Infection Classification.

Heterogeneous virus classification using a functional deep learning model based on transmission electron microscopy images (Preprint)

VISN: virus instance segmentation network for TEM images using deep attention transformer

Pneumonia Diagnosis through pixels -- A Deep Learning Model for detection and classification

Handcrafted vs. non-handcrafted features for computer vision classification

Deep Learning for Imaging and Detection of Microorganisms

Multi-DeepNet: A Novel Weakly-Supervised Multi-Task and Multi-View-Oriented Convolution Neural Network for COVID-19 Diagnosis from CT Images

Transfer Learning Fusion and Stacked Auto-encoders for Viral Lung Disease Classification

COVID-19 Image Classification: A Comparative Performance Analysis of Hand-Crafted vs. Deep Features

A Deep Ensemble Dynamic Learning Network for Corona Virus Disease 2019 Diagnosis.

Deep Learning Models for Classification of COVID-19 Cases by Medical Images

Deep Ensemble Model for COVID-19 Diagnosis and Classification Using Chest CT Images

A Benchmark for Virus Infection Reporter Virtual Staining in Fluorescence and Brightfield Microscopy

Unlocking COVID-19 patterns: Exploring deep learning models for precise recognition and classification of CT images

Deep Learning Fusion For Effective Malware Detection: Leveraging Visual Features

Fighting Together against the Pandemic: Learning Multiple Models on Tomography Images for COVID-19 Diagnosis

Feature extraction and fusion using deep convolutional neural networks for Covid-19 detection using CT and X-RAY images

Synergistic use of handcrafted and deep learning features for tomato leaf disease classification

Fusion of Handcrafted and Deep Features for Medical Image Classification