Abstract:Abstract In the last few years, the deep learning (DL) computing paradigm has been deemed the Gold Standard in the machine learning (ML) community. Moreover, it has gradually become the most widely used computational approach in the field of ML, thus achieving outstanding results on several complex cognitive tasks, matching or even beating those provided by human performance. One of the benefits of DL is the ability to learn massive amounts of data. The DL field has grown fast in the last few years and it has been extensively used to successfully address a wide range of traditional applications. More importantly, DL has outperformed well-known ML techniques in many domains, e.g., cybersecurity, natural language processing, bioinformatics, robotics and control, and medical information processing, among many others. Despite it has been contributed several works reviewing the State-of-the-Art on DL, all of them only tackled one aspect of the DL, which leads to an overall lack of knowledge about it. Therefore, in this contribution, we propose using a more holistic approach in order to provide a more suitable starting point from which to develop a full understanding of DL. Specifically, this review attempts to provide a more comprehensive survey of the most important aspects of DL and including those enhancements recently added to the field. In particular, this paper outlines the importance of DL, presents the types of DL techniques and networks. It then presents convolutional neural networks (CNNs) which the most utilized DL network type and describes the development of CNNs architectures together with their main features, e.g., starting with the AlexNet network and closing with the High-Resolution network (HR.Net). Finally, we further present the challenges and suggested solutions to help researchers understand the existing research gaps. It is followed by a list of the major DL applications. Computational tools including FPGA, GPU, and CPU are summarized along with a description of their influence on DL. The paper ends with the evolution matrix, benchmark datasets, and summary and conclusion.

A Short Review on Supervised Machine Learning and Deep Learning Techniques in Computer Vision

Deep Learning for Computer Vision: A Brief Review

A Review on Machine Learning Styles in Computer Vision—Techniques and Future Directions

Deep learning in computer vision: A critical review of emerging techniques and application scenarios

Progress and Thinking on Self-Supervised Learning Methods in Computer Vision: A Review

Review of deep learning: concepts, CNN architectures, challenges, applications, future directions

Deep learning for visual understanding: A review

A Review of Machine Learning and Deep Learning for Object Detection, Semantic Segmentation, and Human Action Recognition in Machine and Robotic Vision

Computer Vision and Image Processing the Challenges and Opportunities for new technologies approach: A paper review

An abbreviated review of deep learning-based image classification models

A Comprehensive Review of the Application of Machine Learning in Medicine and Health Care

A Review on Machine Learning and Deep Learning Methods on Medical Image Classification

The Art of Seeing: A Computer Vision Journey into Object Detection

Deep Learning vs. Traditional Computer Vision

A review of convolutional neural networks in computer vision

A Survey on Deep Learning: Algorithms, Techniques, and Applications.

Review of deep learning: Convolutional Neural Network Algorithm

Review on self-supervised image recognition using deep neural networks

Self-supervised Learning: A Succinct Review

Review of Machine learning: Views, Architectures or Techniques, Challenges and Future guidance and Real-world applications