Abstract:Motivated by the recent advances in Internet and communication techniques and the proliferation of online social media, social sensing has emerged as a new sensing paradigm to obtain timely observations of the physical world from “human sensors”. In this study, we focus on an emerging application in social sensing – streaming disaster damage assessment (DDA), which aims to automatically assess the damage severity of affected areas in a disaster event on the fly by leveraging the streaming imagery data about the disaster on social media. In particular, we study a dynamic optimal neural architecture searching (NAS) problem in streaming DDA applications. Our goal is to dynamically determine the optimal neural network architecture that accurately estimates the damage severity for each newly arrived image in the stream by leveraging human intelligence from the crowdsourcing systems. The present study is motivated by the observation that the neural network architectures in current DDA solutions are mainly designed by artificial intelligence (AI) experts, which often leads to non-negligible costs and errors given the dynamic nature of the streaming DDA applications and the lack of real-time annotations of the massive social media data inputs. Two critical technical challenges exist in solving our problem: (i) it is non-trivial to dynamically identify the optimal neural network architecture for each image on the fly without knowing its ground-truth label a priori; (ii) it is challenging to effectively leverage the imperfect crowd intelligence to correctly identify the optimal neural network architecture for each image. To address the above challenges, we developed CD-NAS, a dynamic crowd-AI collaborative NAS framework that carefully explores the human intelligence from crowdsourcing systems to solve the dynamic optimal NAS problem and optimize the performance of streaming DDA applications. The evaluation results from a real-world streaming DDA application show that CD-NAS consistently outperforms the state-of-the-art AI and NAS baselines by achieving the highest disaster damage assessment accuracy while maintaining the lowest computational cost.

AdaStreamer: Machine-Centric High-Accuracy Multi-Video Analytics with Adaptive Neural Codecs

Accelerated Neural Enhancement for Video Analytics with Video Quality Adaptation

AccDecoder: Accelerated Decoding for Neural-enhanced Video Analytics

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Quality-Driven Adaptive Video Streaming for Cognitive VANETs

Deep Learning-Based Real-Time Quality Control of Standard Video Compression for Live Streaming

Enhancement or Super-Resolution: Learning-based Adaptive Video Streaming with Client-Side Video Processing

DeepStream: Bandwidth Efficient Multi-Camera Video Streaming for Deep Learning Analytics

Towards Drone-Sourced Live Video Analytics via Adaptive-yet-Compatible Compression

Edge-Cloud Collaborative Streaming Video Analytics with Multi-agent Deep Reinforcement Learning

Towards Live Video Analytics with On-Drone Deeper-yet-Compatible Compression

A 3D-DCT and Convolutional FEC Approach to Agile Video Streaming

Adaptive Streaming Continuous Learning System for Video Analytics

A Joint Online Transcoding and Delivery Approach for Dynamic Adaptive Streaming

DeepCoder: A Deep Neural Network Based Video Compression

DeepRS: Deep-learning Based Network-Adaptive FEC for Real-Time Video Communications

Batch Adaptative Streaming for Video Analytics

On streaming disaster damage assessment in social sensing: A crowd-driven dynamic neural architecture searching approach

Multi-channel Precision-Sparsity-adapted Inter-Frame Differential Data Codec for Video Neural Network Processor.

GRACE: Loss-Resilient Real-Time Video through Neural Codecs