Abstract:Quantization aims to form new vectors or matrices with shared values close to the original. In recent years, the popularity of scalar quantization has been soaring as it is found huge utilities in reducing the resource cost of neural networks. Popular clustering-based techniques suffers substantially from the problems of dependency on the seed, empty or out-of-the-range clusters, and high time complexity. To overcome the problems, in this paper, scalar quantization is examined from a new perspective, namely sparse least square optimization. Specifically, several quantization algorithms based on $l_1$<math>l1</math> least square are proposed and implemented. In addition, similar schemes with $l_1 + l_2$<math>l1+l2</math> and $l_0$<math>l0</math> regularization are proposed. Furthermore, to compute quantization results with given amount of values/clusters, this paper proposes an iterative method and a clustering-based method, and both of them are built on sparse least square optimization. The algorithms proposed are tested under three data scenarios and their computational performance, including information loss, time consumption, and distribution of values of sparse vectors are compared. The paper offers a new perspective to probe the area of qu-ntization, and the algorithms proposed are superior especially under bit-width reduction scenarios, where the required post-quantization resolution (the number of values) is not significantly lower than the original scalar.

Distributed Vector Quantization over Sensor Network

Distributed Vector Quantization Based On Kullback-Leibler Divergence

Distributed fault estimation of networked systems using quantized measurements

Distributed Jointly Sparse Bayesian Learning with Quantized Communication.

Non-Uniform Probabilistically Quantized Distributed Consensus Applied on Sensors Network

Distributed Quantization Networks

Partial Diffusion With Quantization Over Networks

An efficient encoding algorithm for vector quantization based on subvector technique.

Quantized Distributed Estimation with Adaptive Combiner

Scalar Quantization as Sparse Least Square Optimization

Distributed simultaneous state-input estimation over sensor networks under quantized communication

Distributed Wavelet Compression in Wireless Sensor Networks

Approximate Quantile Computation over Sensor Networks

VQ Image Coding Using Sub-Vector Techniques.

Distributed 3D wavelet image compression in wireless sensor networks

Averaging Based Distributed Estimation Algorithm for Rate-Constrained Sensor Networks with Additive Quantization Model.

Optimal Quantization In Energy-Constrained Sensor Networks Under Imperfect Transmission

Distributed Incremental Quantization and Estimation for Wireless Sensor Networks

Vector-based Signal Processing and Quantization for Image and Video Compression

On Distributed Vector Estimation for Power and Bandwidth Constrained Wireless Sensor Networks

Distributed Constrained Optimization With Delayed Subgradient Information Over Time-Varying Network Under Adaptive Quantization