Abstract:Deep neural networks (DNNs) have recently achieved impressive success across a wide range of real-world vision and language processing tasks, spanning from image classification to many other downstream vision tasks, such as object detection, tracking, and segmentation. However, previous well-established DNNs, despite being able to maintain superior accuracy, have also been evolving to be deeper and wider and thus inevitably necessitate prohibitive computational resources for both training and inference. This trend further enlarges the computational gap between computation-intensive DNNs and resource-constrained embedded computing systems, making it challenging to deploy powerful DNNs upon real-world embedded computing systems towards ubiquitous embedded intelligence. To alleviate the above computational gap and enable ubiquitous embedded intelligence, we, in this survey, focus on discussing recent efficient deep learning infrastructures for embedded computing systems, spanning from training to inference, from manual to automated, from convolutional neural networks to transformers, from transformers to vision transformers, from vision models to large language models, from software to hardware, and from algorithms to applications. Specifically, we discuss recent efficient deep learning infrastructures for embedded computing systems from the lens of (1) efficient manual network design for embedded computing systems, (2) efficient automated network design for embedded computing systems, (3) efficient network compression for embedded computing systems, (4) efficient on-device learning for embedded computing systems, (5) efficient large language models for embedded computing systems, (6) efficient deep learning software and hardware for embedded computing systems, and (7) efficient intelligent applications for embedded computing systems.

Lossless Compression and Optimization Method of Data Flow Efficiency of Infrared Image Depth Learning Model of Substation Equipment

Improved Model Compression Method Based on Information Entropy

Research on Fault Detection Method of Infrared Thermal Imaging for Power Equipment based on Deep Learning

Intelligent Detection Technology of Infrared Image of Substation Equipment Based on Deep Learning Algorithm

A lighter weight substation infrared defect detection algorithm combining de‐weighted feature fusion and loss function fusion

To Compress, or Not to Compress: Characterizing Deep Learning Model Compression for Embedded Inference

Automatic Fault Diagnosis of Infrared Insulator Images Based on Image Instance Segmentation and Temperature Analysis

Lossy Intermediate Deep Learning Feature Compression and Evaluation

LMDFusion: A lightweight infrared and visible image fusion network for substation equipment based on mask and residual dense connection

Efficient real-time detection of electrical equipment images using a lightweight detector model

Substation Meter Detection and Recognition Method Based on Lightweight Deep Learning Model

Efficient Deep Learning Infrastructures for Embedded Computing Systems: A Comprehensive Survey and Future Envision

Enabling High Performance Deep Learning Networks on Embedded Systems

Intermediate Deep Feature Compression: the Next Battlefield of Intelligent Sensing

Deep Model Compression and Architecture Optimization for Embedded Systems: A Survey

Optimal deep learning based image compression technique for data transmission on industrial Internet of things applications

Probability Prediction Network With Checkerboard Prior for Lossless Remote Sensing Image Compression

Target Detection of Substation Electrical Equipment from Infrared Images Using an Improved Faster Regions with Convolutional Neural Network Features Algorithm

Design of a Novel Neural Network Compression Method for Tiny Machine Learning

Low-Rate Feature Compression for Collaborative Intelligence: Reducing Redundancy in Spatial and Statistical Levels