Abstract:Implementing deep learning models on edge devices presents significant challenges due to the limited computing power, memory limitations, and processing power of these devices As deep learning models become more complex, cf ensuring proper execution on an edge platform is critical for real-time implementation Hardware -Addresses these challenges by exploring ways to accelerate. The problem lies in the resource-hungry nature of today’s deep learning models, which are typically designed for cloud environments with high computing capacity, making them unsuitable for edge environments with restricted resources. The main objective of this review is to analyze and compare various hardware acceleration strategies, such as graphics processing units (GPUs), tensor processing units (TPUs), field programmable gate arrays (FPGAs), and application-specific integrated circuits (ASICs); . . . . (pruning, quantization, and knowledge storage), memory management, and data flow optimization to improve the performance and energy efficiency of deep learning models on edge devices The results of this comprehensive performance analysis suggests that hardware accelerators can significantly improve throughput and reduce latency while maintaining acceptable levels of power consumption and accuracy. In addition to techniques such as quantization and pruning that are seen to reduce computational load and memory footprint, enabling more efficient deep learning inference on edge platforms, the study highlights trade-offs between speed, consumption power efficiency and model accuracy between for each hardware accelerator are emphasized. The findings suggest that by choosing the right hardware and applying the right optimization techniques, edge devices may be able to optimize deep learning models, meeting the requirements of real-time AI applications in resource-constrained environments handle the role there.

AI Tax: The Hidden Cost of AI Data Center Applications

AI-oriented Workload Allocation for Cloud-Edge Computing.

AIBench: Towards Scalable and Comprehensive Datacenter AI Benchmarking

AI on the Edge: Rethinking AI-based IoT Applications Using Specialized Edge Architectures

Optimizing Cloud Infrastructure for Real-time AI Processing: Challenges and Solutions

Sustainable AI Processing at the Edge

Evaluating Emerging AI/ML Accelerators: IPU, RDU, and NVIDIA/AMD GPUs

A Survey of AI Accelerators for Edge Environment

Efficient Hardware Acceleration Techniques for Deep Learning on Edge Devices: A Comprehensive Performance Analysis

Reaching for the Sky: Maximizing Deep Learning Inference Throughput on Edge Devices with AI Multi-Tenancy

Accelerated Cloud for Artificial Intelligence (ACAI)

AI Multi-Tenancy on Edge: Concurrent Deep Learning Model Executions and Dynamic Model Placements on Edge Devices

Power Hungry Processing: Watts Driving the Cost of AI Deployment?

Towards Understanding the Adaptation Space of AI-Assisted Data Protection for Video Analytics at the Edge

Edge AI and On-Device Machine Learning For Real Time Processing

3U-EdgeAI: Ultra-Low Memory Training, Ultra-Low BitwidthQuantization, and Ultra-Low Latency Acceleration

Trends in Energy Estimates for Computing in AI/Machine Learning Accelerators, Supercomputers, and Compute-Intensive Applications

Analysing Edge Computing Devices for the Deployment of Embedded AI

The Unpaid Toll: Quantifying the Public Health Impact of AI

Empirical Measurements of AI Training Power Demand on a GPU-Accelerated Node

Hardware Accelerators for Artificial Intelligence