Abstract:Deep learning-based image compression techniques can take advantage of the autoencoder's benefits to achieve greater compression quality at the same bit rate as traditional image compression, which is more in line with user desires. Designing a high-performance processor that can increase the inference speed and efficiency of the deep learning image compression (DIC) network is important to make this technology more extensively employed in mobile devices. To the best of our knowledge, there is no dedicated processor that can accelerate DIC with low power consumption, and general-purpose network accelerators based on field programmable gate arrays (FPGA) cannot directly process compressed networks, so we propose a processor suitable for DIC in this paper. First, we analyze the image compression algorithm and quantize the data of the network into 16-bit fixed points using a dynamic hierarchical quantization. Then, we design an operation module, which is the core computational part for processing. It is composed of convolution, sampling, and normalization units, which pipeline the inference calculation for each layer of the network. To achieve high-throughput inference computing, the processing elements group (PEG) array with local buffers is developed for convolutional computation. Based on the common components in encoding and decoding, the sampling and normalization units are compatible with codec computation and utilized for image compression with time-sharing multiplexing. According to the control signal, the operation module could change the order of data flow through the three units so that they perform encoding and decoding operations, respectively. Based on these design methods and schemes, DIC is deployed into the Xilinx Zynq ZCU104 development board to achieve high-throughput image compression at 6 different bit rates. The experimental results show that the processor can run at 200 MHz and achieve 283.4 GOPS for the 16 bits fixed-point DIC network.

A VLSI neural processor for image data compression using self-organization networks

Implementation of a novel adaptive coding using VLSI architecture for data compression in image processing

A 3.89-Gops/mw Scalable Recurrent Neural Network Processor with Improved Efficiency on Memory and Computation

A High-Throughput Processor for GDN-Based Deep Learning Image Compression

A Vlsi Architecture for the Hadamard Transform-Based Fast Vq Encoder

Image coding using Address-Dependent Vector Quantization based on Kohonen neural network

An Adaptive Vector Quantization Based on Neural Network

LVQAC: Lattice Vector Quantization Coupled with Spatially Adaptive Companding for Efficient Learned Image Compression

VLSI implementation of a neural network model

Low-complexity Near-Lossless Image Compression Method and Its Application-Specific Integrated Circuit Design for a Wireless Endoscopy Capsule System.

An Energy-efficient Time-domain Analog VLSI Neural Network Processor Based on a Pulse-width Modulation Approach

VLSI Design Based on Block Truncation Coding for Real-Time Color Image Compression for IoT

Efficient In Vivo Neural Signal Compression Using an Autoencoder-based Neural Network

Memristor-based storage system with convolutional autoencoder-based image compression network

Selectively Tree-Structured Vector Quantizer Using Kohonen Neural Network

Neural Image Compression with Quantization Rectifier

A Communication-Aware DNN Accelerator on ImageNet Using In-Memory Entry-Counting Based Algorithm-Circuit-Architecture Co-Design in 65-nm CMOS

Design and Implementation of a Low Complexity Near-lossless Image Compression Method for Wireless Endoscopy Capsule System

Downscaling and Overflow-aware Model Compression for Efficient Vision Processors

A Cost-Efficient High-Speed VLSI Architecture for Spiking Convolutional Neural Network Inference Using Time-Step Binary Spike Maps

Memory-Efficient Compression Based on Least-Squares Fitting in Convolutional Neural Network Accelerators.