Abstract:In this paper, we propose a new on-device class-aware pruning method for edge systems, namely OCAP . The motivation behind is that Deep Neural Network (DNN) models are usually trained with a large dataset so that they can learn more diverse features and be generalized to accurately predict numerous classes. Some works reveal that some features (channels) are only related to some classes. And edge systems are usually implemented in a specific environment, where classes the system detects are limited. As a result, implementing a general-trained model for a specific edge environment leads to unnecessary redundancy. Meanwhile, transferring some data and models to the cloud for personalization will cause privacy issues. Thus, we may have an on-device class-aware pruning method to remove the channels which are irrelevant for the classes the edge system observes mostly, thereby reducing the model's Floating Point Operations (FLOPs), memory footprint, latency, improving energy efficiency and keeping a relatively high accuracy for the observed classes while protecting the in-situ data privacy. OCAP proposes a novel class-aware pruning method based on the intermediate activation of input images to identify the class-irrelevant channels. Moreover, we propose a method based on KL-divergence to select diverse and representative data for effectively fine-tuning the pruned model. The experimental results show the effectiveness and efficiency of OCAP . In comparison with state-of-the-art class-aware pruning methods, OCAP has better accuracy and higher compression ratio. Additionally, we evaluate OCAP on Nvidia Jetson Nano, Nvidia Jetson TX2 and Nvidia Jetson AGX Xavier in terms of efficiency, where the experimental results demonstrate the applicability of OCAP on edge systems. The code is available at https://github.com/mzd2222/OCAP .

Optimization of the Pedestrian and Vehicle Detection Model based on Cloud-Edge Collaboration

Pedestrian and Vehicle Detection Based on Pruning YOLOv4 with Cloud-Edge Collaboration

A Compression Pipeline for One-Stage Object Detection Model

All-in-One: A Highly Representative DNN Pruning Framework for Edge Devices with Dynamic Power Management

Compression of Vehicle and Pedestrian Detection Network Based on YOLOv3 Model.

Cloud–Edge Collaborative Inference with Network Pruning

Mixed Pruning Method for Vehicle Detection

Design of Lightweight Pedestrian Detection Network in Railway Scenes

Performance optimization of target detection based on edge-to-cloud deep learning

Vehicle and Pedestrian Detection Based on Improved YOLOv7-Tiny

Channel Pruning and Quantization-Based Learning for Object Detection with Computing Source Limited Application

Pruned-YOLO: Learning Efficient Object Detector Using Model Pruning

Accelerated Inference of Face Detection under Edge-Cloud Collaboration

OCAP: On-device Class-Aware Pruning for personalized edge DNN models

A Lightweight Model of Underwater Object Detection Based on YOLOv8n for an Edge Computing Platform

ABCP: Automatic Block-wise and Channel-wise Network Pruning via Joint Search

Compression of YOLOv3 Via Block-Wise and Channel-Wise Pruning for Real-Time and Complicated Autonomous Driving Environment Sensing Applications.

HRCP : High-ratio channel pruning for real-time object detection on resource-limited platform

Using Filter Pruning-Based Deep Learning Algorithm for the Real-Time Fruit Freshness Detection with Edge Processors

Three-Stage Global Channel Pruning for Resources-Limited Platform

Efficient Multi-Object Tracking on Edge Devices via Reconstruction-Based Channel Pruning