Abstract:In the field of edge computing, quantizing convolutional neural networks (CNNs) using extremely low bit widths can significantly alleviate the associated storage and computational burdens in embedded hardware, thereby improving computational efficiency. However, such quantization also presents a challenge related to substantial decreases in detection accuracy. This paper proposes an innovative method, called Adaptive Global Power-of-Two Ternary Quantization Based on Unfixed Boundary Thresholds (APTQ). APTQ achieves adaptive quantization by quantizing each filter into two binary subfilters represented as power-of-two values, thereby addressing the accuracy degradation caused by a lack of expression ability of low-bit-width weight values and the contradiction between fixed quantization boundaries and the uneven actual weight distribution. It effectively reduces the accuracy loss while at the same time presenting strong hardware-friendly characteristics because of the power-of-two quantization. This paper extends the APTQ algorithm to propose the APQ quantization algorithm, which can adapt to arbitrary quantization bit widths. Furthermore, this paper designs dedicated edge deployment convolutional computation modules for the obtained quantized models. Through quantization comparison experiments with multiple commonly used CNN models utilized on the CIFAR10, CIFAR100, and Mini-ImageNet data sets, it is verified that the APTQ and APQ algorithms possess better accuracy performance than most state-of-the-art quantization algorithms and can achieve results with very low accuracy loss in certain CNNs (e.g., the accuracy loss of the APTQ ternary ResNet-56 model on CIFAR10 is 0.13%). The dedicated convolutional computation modules enable the corresponding quantized models to occupy fewer on-chip hardware resources in edge chips, thereby effectively improving computational efficiency. This adaptive CNN quantization method, combined with the power-of-two quantization results, strikes a balance between the quantization accuracy performance and deployment efficiency in embedded hardware. As such, valuable insights for the industrial edge computing domain can be gained.

RobustEdge: Low Power Adversarial Detection for Cloud-Edge Systems

AyE-Edge: Automated Deployment Space Search Empowering Accuracy Yet Efficient Real-Time Object Detection on the Edge

Flexible high-resolution object detection on edge devices with tunable latency.

Guarding Against Universal Adversarial Perturbations in Data-driven Cloud/Edge Services

Edge-Cloud Collaborated Object Detection Via Bandwidth Adaptive Difficult-Case Discriminator

Noise Sensitivity-Based Energy Efficient and Robust Adversary Detection in Neural Networks

EdgeShield: A Universal and Efficient Edge Computing Framework for Robust AI

Edge Enhancement Improves Adversarial Robustness in Image Classification

AQD: Towards Accurate Quantized Object Detection

EdgeNet: Balancing Accuracy and Performance for Edge-based Convolutional Neural Network Object Detectors

Super-Efficient Super Resolution for Fast Adversarial Defense at the Edge

Cloud-Edge Inference under Communication Constraints: Data Quantization and Early Exit.

Edge-Cloud Collaborated Object Detection via Difficult-Case Discriminator

Defed: an Edge-Feature-Enhanced Image Denoised Network Against Adversarial Attacks for Secure Internet of Things

RCT: Resource Constrained Training for Edge AI

A Secure Data Interaction Method Based on Edge Computing

Robust Hazardous Driving Scenario Detection for Supporting Autonomous Vehicles in Edge-Cloud Collaborative Environments

Defending Edge Computing Based Metaverse AI Against Adversarial Attacks.

Adaptive Global Power-of-Two Ternary Quantization Algorithm Based on Unfixed Boundary Thresholds

Adversarially-Aware Robust Object Detector.

Underload: Defending against Latency Attacks for Object Detectors on Edge Devices