Abstract:In order to assess damage and properly allocate relief efforts, mapping the extent of flood events is a necessary and important aspect of disaster management. In recent years, deep learning methods have evolved as an effective tool to quickly label high-resolution imagery and provide necessary flood extent mappings. These methods, though, require large amounts of annotated training data to create models that are accurate and robust to new flooded imagery. In this work, we provide FloodTrace, an application that enables effective crowdsourcing for flooded region annotation for machine learning training data, removing the requirement for annotation to be done solely by researchers. We accomplish this through two orthogonal methods within our application, informed by requirements from domain experts. First, we utilize elevation-guided annotation tools and 3D rendering to inform user annotation decisions with digital elevation model data, improving annotation accuracy. For this purpose, we provide a unique annotation method that uses topological data analysis to outperform the state-of-the-art elevation-guided annotation tool in efficiency. Second, we provide a framework for researchers to review aggregated crowdsourced annotations and correct inaccuracies using methods inspired by uncertainty visualization. We conducted a user study to confirm the application effectiveness in which 266 graduate students annotated high-resolution aerial imagery from Hurricane Matthew in North Carolina. Experimental results show the accuracy and efficiency benefits of our application apply even for untrained users. In addition, using our aggregation and correction framework, flood detection models trained on crowdsourced annotations were able to achieve performance equal to models trained on expert-labeled annotations, while requiring a fraction of the time on the part of the researcher.

Active learning for event detection in support of disaster analysis applications

Natural Disasters Detection in Social Media and Satellite imagery: a survey

Deep-Disaster: Unsupervised Disaster Detection and Localization Using Visual Data

Visual Sentiment Analysis from Disaster Images in Social Media

Deep Learning Benchmarks and Datasets for Social Media Image Classification for Disaster Response

Robust Training of Social Media Image Classification Models for Rapid Disaster Response

Sentiment Analysis from Images of Natural Disasters

Disaster assessment from social media using multimodal deep learning

“Generalization of convolutional network to domain adaptation network for classification of disaster images on twitter”

A Machine learning approach for Post-Disaster data curation

Enabling Quick, Accurate Crowdsourced Annotation for Elevation-Aware Flood Extent Mapping

Active Learning for Identifying Disaster-Related Tweets: A Comparison with Keyword Filtering and Generic Fine-Tuning

Natural Disaster Analysis using Satellite Imagery and Social-Media Data for Emergency Response Situations

Landslide Detection in Real-Time Social Media Image Streams

Multi-task Multimodal Learning for Disaster Situation Assessment.

A Social Context-aware Graph-based Multimodal Attentive Learning Framework for Disaster Content Classification during Emergencies

A Named Entity Recognition and Topic Modeling-based Solution for Locating and Better Assessment of Natural Disasters in Social Media

Multimodal Deep Learning Based on Multiple Correspondence Analysis for Disaster Management

A Multimodal Data Analysis Approach to Social Media during Natural Disasters

Social Media Data Analysis and Feedback for Advanced Disaster Risk Management

Weakly-supervised Fine-grained Event Recognition on Social Media Texts for Disaster Management