Abstract:In recent years, deep learning has garnered tremendous success in a variety of application domains. This new field of machine learning has been growing rapidly and has been applied to most traditional application domains, as well as some new areas that present more opportunities. Different methods have been proposed based on different categories of learning, including supervised, semi-supervised, and un-supervised learning. Experimental results show state-of-the-art performance using deep learning when compared to traditional machine learning approaches in the fields of image processing, computer vision, speech recognition, machine translation, art, medical imaging, medical information processing, robotics and control, bioinformatics, natural language processing, cybersecurity, and many others. This survey presents a brief survey on the advances that have occurred in the area of Deep Learning (DL), starting with the Deep Neural Network (DNN). The survey goes on to cover Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), including Long Short-Term Memory (LSTM) and Gated Recurrent Units (GRU), Auto-Encoder (AE), Deep Belief Network (DBN), Generative Adversarial Network (GAN), and Deep Reinforcement Learning (DRL). Additionally, we have discussed recent developments, such as advanced variant DL techniques based on these DL approaches. This work considers most of the papers published after 2012 from when the history of deep learning began. Furthermore, DL approaches that have been explored and evaluated in different application domains are also included in this survey. We also included recently developed frameworks, SDKs, and benchmark datasets that are used for implementing and evaluating deep learning approaches. There are some surveys that have been published on DL using neural networks and a survey on Reinforcement Learning (RL). However, those papers have not discussed individual advanced techniques for training large-scale deep learning models and the recently developed method of generative models.

Survey of Deep-Learning Techniques in Big-Data Analytics

A review on big data based on deep neural network approaches

A Review of Data Mining, Big Data Analytics and Machine Learning Approaches

An Assessment of Machine Learning and Deep Learning Techniques with Applications

Deep learning in business analytics and operations research: Models, applications and managerial implications

A Survey of Deep Learning and Its Applications: A New Paradigm to Machine Learning

Deep learning applications and challenges in big data analytics

DEEP LEARNING IN THE ERA OF BIG DATA: FOUNDATIONS, ADVANCES, APPLICATIONS, CHALLENGES, AND FUTURE DIRECTIONS

A Survey on Deep Learning: Algorithms, Techniques, and Applications.

Deep Learning, Machine Learning, Advancing Big Data Analytics and Management

Deep learning in business analytics: A clash of expectations and reality

Distributed Analytics For Big Data: A Survey

Predictive Analytics for Demand Forecasting: A deep Learning-based Decision Support System

Role of Big Data Analytics in supply chain management: current trends and future perspectives

A Structured Analysis to study the Role of Machine Learning and Deep Learning in The Healthcare Sector with Big Data Analytics

Challenges of Applying Deep Learning in Real-World Applications

Efficiently Processing Big Data in Real-Time Employing Deep Learning Algorithms

Deep Learning Model And Its Application In Big Data

A Survey of Machine Learning for Big Data Processing

Deep Learning-Based Intelligent Analysis of Medical Big Data

A State-of-the-Art Survey on Deep Learning Theory and Architectures