Abstract:In the modern-day era of technology, a paradigm shift has been witnessed in the areas involving applications of Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL). Specifically, Deep Neural Networks (DNNs) have emerged as a popular field of interest in most AI applications such as computer vision, image and video processing, robotics, etc. In the context of developed digital technologies and the availability of authentic data and data handling infrastructure, DNNs have been a credible choice for solving more complex real-life problems. The performance and accuracy of a DNN is a way better than human intelligence in certain situations. However, it is noteworthy that the DNN is computationally too cumbersome in terms of the resources and time to handle these computations. Furthermore, general-purpose architectures like CPUs have issues in handling such computationally intensive algorithms. Therefore, a lot of interest and efforts have been invested by the research fraternity in specialized hardware architectures such as Graphics Processing Unit (GPU), Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), and Coarse Grained Reconfigurable Array (CGRA) in the context of effective implementation of computationally intensive algorithms. This paper brings forward the various research works on the development and deployment of DNNs using the aforementioned specialized hardware architectures and embedded AI accelerators. The review discusses the detailed description of the specialized hardware-based accelerators used in the training and/or inference of DNN. A comparative study based on factors like power, area, and throughput, is also made on the various accelerators discussed. Finally, future research and development directions, such as future trends in DNN implementation on specialized hardware accelerators, are discussed. This review article is intended to guide hardware architects to accelerate and improve the eff- ctiveness of deep learning research.

Accelerating AI: the cutting-edge chips powering the computing revolution

Evaluating Emerging AI/ML Accelerators: IPU, RDU, and NVIDIA/AMD GPUs

Hardware Accelerators for Artificial Intelligence

From GPUs to AI and quantum: three waves of acceleration in bioinformatics

The Why, What and How of Artificial General Intelligence Chip Development

A Survey of Accelerator Architectures for Deep Neural Networks

A Review on General Purpose Computing on GPUs and Its Applications in Computational Intelligence

Analysis of the Principle and Configuration of AI Chip and the State-of-art Applications

Artificial intelligence accelerated by light

Convergence of Artificial Intelligence and High Performance Computing on NSF-supported Cyberinfrastructure

Advancing parallel programming integrating artificial intelligence for enhanced efficiency and automation

Analysis of the Designs and Applications of AI Chip

Hardware Accelerators in Autonomous Driving

Accelerating Video Decoding Using GPU

Power-aware Programming with GPU Accelerators

Benchmarking the Performance and Power of AI Accelerators for AI Training

Using the Abstract Computer Architecture Description Language to Model AI Hardware Accelerators

Hardware Accelerated Optimization of Deep Learning Model on Artificial Intelligence Chip

Analysis of the Principal, Fabrication and Application of AI Chips

Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

Efficient Hardware Architectures for Accelerating Deep Neural Networks: Survey