Abstract:In the field of object detection, deep learning has greatly improved accuracy compared to previous algorithms and has been used widely in recent years. However, object detection using deep learning requires many hardware (HW) resources due to the huge computations for high performance, making it very difficult to run real-time on embedded platforms. Therefore, various compression methods have been studied to solve this problem. In particular, quantization methods greatly reduce the computational burden of deep learning by reducing the number of bits used for weights and activation functions in deep learning. However, most of these existing studies targeted only object classification and cannot be applied to object detection. Furthermore, most of the existing quantization studies are based on floating-point operations, which requires additional effort when implementing HW accelerators. This paper proposes an HW-friendly fixed-point-based quantization method that can also be applied to object detection. In the proposed method, the center of the weight distribution is adjusted to zero by subtracting the mean of weight parameters before quantization, and the retraining process is iteratively applied to minimize the accuracy drop caused by quantization. Furthermore, while applying the proposed method to object detection, performance degradation is minimized by considering the minimum and maximum values of weight parameters of deep learning networks. When applying the proposed quantization method to representative one-stage object detectors, You Only Look Once v3 and v4 (YOLOv3 and YOLOv4), detection accuracy similar to the original networks (i.e., YOLOv3 and YOLOv4) with a single-precision floating-point format (32-bit) is maintained despite expressing weights with only about 20% of the bits compared to a single-precision floating-point format in COCO dataset.

Fixed-point optimization of deep neural networks with adaptive step size retraining

Optimizing Quantized Neural Networks in a Weak Curvature Manifold

Fixed-point performance analysis of recurrent neural networks

Hessian-based Mixed-Precision Quantization with Transition Aware Training for Neural Networks

Fixed-Point Back-Propagation Training

Per-Tensor Fixed-Point Quantization of the Back-Propagation Algorithm

Resiliency of Deep Neural Networks under Quantization

Fixed Point Quantization of Deep Convolutional Networks

Toward INT4 Fixed-Point Training via Exploring Quantization Error for Gradients

Bit-shrinking: Limiting Instantaneous Sharpness for Improving Post-training Quantization

Unsupervised Network Quantization via Fixed-Point Factorization

Stochastic Quantization for Learning Accurate Low-Bit Deep Neural Networks

Trainable Fixed-Point Quantization for Deep Learning Acceleration on FPGAs

Optimization-based Post-training Quantization with Bit-split and Stitching

Fixed-point Quantization of Convolutional Neural Networks for Quantized Inference on Embedded Platforms

Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors

Bit Efficient Quantization for Deep Neural Networks

Training Deep Neural Networks with 8-bit Floating Point Numbers

Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networks

Learning to Warm-Start Fixed-Point Optimization Algorithms

Efficient Neural Image Decoding Via Fixed-Point Inference