Abstract:To distribute the storage and computation load caused by growing capacity of deep neural network (DNN), collaborative intelligence (CI) framework has been proposed, where a deep model is split and executed in two distributed devices respectively. Intermediate feature must be transferred from the front end to the back in order to perform distributed inference, thus transmission process is the bottleneck that influences the inference efficiency in terms of accuracy and delay. Specifically for a bandwidth-limited human-in-loop visual analysis task, feature compression approach needs exploration to reduce the data volume to be transmitted, in order to achieve low transmission delay as well as maintain analysis performance and human perception ability. In this paper, the redundancy of intermediate feature both in spatial and statistical levels are firstly analyzed. A mathematical expression for the goal of feature compression is formulated, based on which a two-level redundancy removal based low-rate feature compression approach is proposed. For the front-end device, an information squeezing (IS) module is developed to squeeze the key information of input image and inject them into a low-resolution image. Then a backbone network is split into two parts with respects to the application demands of CI, and can be deployed at the front and back ends correspondingly. With a specifically designed objective function, IS module and the partitioned backbone network are optimized collaboratively to reduce the two-level redundancy, thus compressing the intermediate feature. A generative adversarial network (GAN)-based restoration module is proposed to recover an image with original resolution from the compressed feature, for satisfying human perception. Comprehensive experiments are conduct to validate the efficiency of the proposed method.

Hybrid Approaches for Data Reduction of Spatiotemporal Scientific Applications

Neural Network Emulation of Spatio-temporal Data Using Linear and Nonlinear Dimensionality Reduction

Machine Learning Techniques for Data Reduction of Climate Applications

Attention Based Machine Learning Methods for Data Reduction with Guaranteed Error Bounds

Scalable Hybrid Learning Techniques for Scientific Data Compression

Spatiotemporally adaptive compression for scientific dataset with feature preservation -- a case study on simulation data with extreme climate events analysis

Low-Rate Feature Compression for Collaborative Intelligence: Reducing Redundancy in Spatial and Statistical Levels

Neural Compression of Atmospheric States

Machine Learning Techniques for Data Reduction of CFD Applications

A High-Quality Workflow for Multi-Resolution Scientific Data Reduction and Visualization

Enhancing Lossy Compression Through Cross-Field Information for Scientific Applications

Efficient Compression of Sparse Accelerator Data Using Implicit Neural Representations and Importance Sampling

HiHa: Introducing Hierarchical Harmonic Decomposition to Implicit Neural Compression for Atmospheric Data

Compression Supports Spatial Deep Learning

SCI: A Spectrum Concentrated Implicit Neural Compression for Biomedical Data

DynSNN: A Dynamic Approach to Reduce Redundancy in Spiking Neural Networks

Semantic-Oriented Feature Compression for Resource-Constrained Distributed Sensor Networks

A Scalable Partitioned Approach to Model Massive Nonstationary Non-Gaussian Spatial Datasets

Semantic redundancy-aware implicit neural compression for multidimensional biomedical image data

A Hierarchical Adaptive Spatio-Temporal Data Compression Scheme for Wireless Sensor Networks

A Survey on Error-Bounded Lossy Compression for Scientific Datasets