Abstract:Widespread deployment of the Internet of Things (IoT) has changed the way that network services are developed, deployed, and operated. Most onboard advanced IoT devices are equipped with visual sensors that form the so-called visual IoT. Typically, the sender would compress images, and then through the communication network, the receiver would decode images, and then analyze the images for applications. However, image compression and semantic inference are generally conducted separately, and thus, current compression algorithms cannot be transplanted for the use of semantic inference directly. A collaborative image compression and classification framework for visual IoT applications is proposed, which combines image compression with semantic inference by using multi-task learning. In particular, the multi-task Generative Adversarial Networks (GANs) are described, which include encoder, quantizer, generator, discriminator, and classifier to conduct simultaneously image compression and classification. The key to the proposed framework is the quantized latent representation used for compression and classification. GANs with perceptual quality can achieve low bitrate compression and reduce the amount of data transmitted. In addition, the design in which two tasks share the same feature can greatly reduce computing resources, which is especially applicable for environments with extremely limited resources. Using extensive experiments, the collaborative compression and classification framework is effective and useful for visual IoT applications.

Compacted Probabilistic Visual Target Classification with Committee Decision in Wireless Multimedia Sensor Networks

Hybrid Gaussian process visual target classification in wireless multimedia sensor networks

Collaborative Statistical Learning with Rough Feature Reduction for Visual Target Classification

Collaborative Target Classification with Multiagent System in Wireless Multimedia Sensor Networks

RVM-based classification of the network video surveillance system

Collaborative Target Classification for Image Recognition in Wireless Sensor Networks

Multi-agent Negotiation Mechanisms for Statistical Target Classification in Wireless Multimedia Sensor Networks.

Collaborative Probability Based Multimodel Target Identification in Wireless Sensor Networks

Dynamic Collaborative Support Vector Machine For Target Classification In Wireless Sensor Networks

Distributed visual-target-surveillance system in wireless sensor networks

Hierarchical Wireless Multimedia Sensor Networks for Collaborative Hybrid Semi-Supervised Classifier Learning

Collaborative hybrid classifier learning with ant colony optimization in wireless multimedia sensor networks

Leveraging Prediction to Improve the Coverage of Wireless Sensor Networks

Agent Collaborative Target Localization And Classification In Wireless Sensor Networks

A multi-class classification approach for target localization in wireless sensor networks

Particle Swarm Optimization Clustering for Target Classification in Wireless Sensor Networks

Perturbation Defense Ultra High-Speed Weak Target Recognition

Context-based Global Multi-Class Semantic Image Segmentation by Wireless Multimedia Sensor Networks.

Robust Visual Cooperative Tracking Using Constrained Adaptive Sparse Representations and Sparse Classifier Grids

Compressed sensing based object detection and tracking system using measurement selection process for wireless visual sensor networks

Collaborative image compression and classification with multi-task learning for visual Internet of Things