Abstract:Efficient model inference is an important and practical issue in the deployment of deep neural network on resource constraint platforms. Network quantization addresses this problem effectively by leveraging low-bit representation and arithmetic that could be conducted on dedicated embedded systems. In the previous works, the parameter bitwidth is set homogeneously and there is a trade-off between superior performance and aggressive compression. Actually the stacked network layers, which are generally regarded as hierarchical feature extractors, contribute diversely to the overall performance. For a well-trained neural network, the feature distributions of different categories differentiate gradually as the network propagates forward. Hence the capability requirement on the subsequent feature extractors is reduced. It indicates that the neurons in posterior layers could be assigned with lower bitwidth for quantized neural networks. Based on this observation, a simple but effective mixed-precision quantized neural network with progressively ecreasing bitwidth is proposed to improve the trade-off between accuracy and compression. Extensive experiments on typical network architectures and benchmark datasets demonstrate that the proposed method could achieve better or comparable results while reducing the memory space for quantized parameters by more than 30\% in comparison with the homogeneous counterparts. In addition, the results also demonstrate that the higher-precision bottom layers could boost the 1-bit network performance appreciably due to a better preservation of the original image information while the lower-precision posterior layers contribute to the regularization of $k-$bit networks.

Resource-efficient Face Detector Using 1.5-Bit Frame-to-frame Delta Quantization for Image Based Always-on Wake-up Application.

Fully Quantized Always-on Face Detector Considering Mobile Image Sensors

An Intelligent Surveillance System Base on Accelerated Human and Face Detection

An Efficient Face Detector on a CPU Using Dual-Camera Sensors for Intelligent Surveillance Systems

P-FAD: Real-time Face Detection Scheme on Embedded Smart Cameras

A low cost architecture for high performance face detection

Face acquiring optimization based on video sensor network

Efficient video face recognition based on frame selection and quality assessment

AQD: Towards Accurate Quantized Object Detection

CNN Inference acceleration using low-power devices for human monitoring and security scenarios

Simplification of Deep Neural Network-Based Object Detector for Real-Time Edge Computing

Revisiting a single-stage method for face detection

Real-time Face Tracking in Surveillance Videos on Chips for Valuable Face Capturing

SSRFD: single shot real-time face detector

A System-Level Solution for Low-Power Object Detection

Variable Resolution Pixel Quantization for Low Power Machine Vision Application on Edge

Ef-QuantFace: Streamlined Face Recognition with Small Data and Low-Bit Precision

A Lightweight Face Detector by Integrating the Convolutional Neural Network with the Image Pyramid

ACWFace: efficient and lightweight face detector based on RetinaFace

Energy-efficient and Privacy-aware Social Distance Monitoring with Low-resolution Infrared Sensors and Adaptive Inference

Mixed-Precision Quantized Neural Network with Progressively Decreasing Bitwidth For Image Classification and Object Detection.