Abstract:Motivated by the recent advances in Internet and communication techniques and the proliferation of online social media, social sensing has emerged as a new sensing paradigm to obtain timely observations of the physical world from “human sensors”. In this study, we focus on an emerging application in social sensing – streaming disaster damage assessment (DDA), which aims to automatically assess the damage severity of affected areas in a disaster event on the fly by leveraging the streaming imagery data about the disaster on social media. In particular, we study a dynamic optimal neural architecture searching (NAS) problem in streaming DDA applications. Our goal is to dynamically determine the optimal neural network architecture that accurately estimates the damage severity for each newly arrived image in the stream by leveraging human intelligence from the crowdsourcing systems. The present study is motivated by the observation that the neural network architectures in current DDA solutions are mainly designed by artificial intelligence (AI) experts, which often leads to non-negligible costs and errors given the dynamic nature of the streaming DDA applications and the lack of real-time annotations of the massive social media data inputs. Two critical technical challenges exist in solving our problem: (i) it is non-trivial to dynamically identify the optimal neural network architecture for each image on the fly without knowing its ground-truth label a priori; (ii) it is challenging to effectively leverage the imperfect crowd intelligence to correctly identify the optimal neural network architecture for each image. To address the above challenges, we developed CD-NAS, a dynamic crowd-AI collaborative NAS framework that carefully explores the human intelligence from crowdsourcing systems to solve the dynamic optimal NAS problem and optimize the performance of streaming DDA applications. The evaluation results from a real-world streaming DDA application show that CD-NAS consistently outperforms the state-of-the-art AI and NAS baselines by achieving the highest disaster damage assessment accuracy while maintaining the lowest computational cost.

Automatic Construction of Multi-layer Perceptron Network from Streaming Examples

Adaptive tree-like neural network: Overcoming catastrophic forgetting to classify streaming data with concept drifts

Weakly Supervised Deep Learning Approach in Streaming Environments

DeepStreamCE: A Streaming Approach to Concept Evolution Detection in Deep Neural Networks

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Dual Memory Architectures for Fast Deep Learning of Stream Data via an Online-Incremental-Transfer Strategy

On streaming disaster damage assessment in social sensing: A crowd-driven dynamic neural architecture searching approach

Autonomous Deep Quality Monitoring in Streaming Environments

Online Deep Learning: Learning Deep Neural Networks on the Fly

NNStreamer: Stream Processing Paradigm for Neural Networks, Toward Efficient Development and Execution of On-Device AI Applications

Lifelong Machine Learning with Deep Streaming Linear Discriminant Analysis

An Adaptive and Stability-Promoting Layerwise Training Approach for Sparse Deep Neural Network Architecture

Elephant Flows Detection Using Deep Neural Network, Convolutional Neural Network, Long Short Term Memory and Autoencoder

Streaming Graph Neural Networks Via Continual Learning

Self-organization of multi-layer spiking neural networks

Drift to Remember

Streaming Active Deep Forest for Evolving Data Stream Classification

Parallel Long Short-Term Memory for Multi-stream Classification

NNStreamer: Efficient and Agile Development of On-Device AI Systems

Adaptive Deep Models for Incremental Learning

STREAMLINE: Streaming Active Learning for Realistic Multi-Distributional Settings