Abstract:This paper proposed and tested an integrated textual–visual–geo framework to enhance social sensing techniques in smart city digital twins in the context of disasters. Effective and efficient disaster response and recovery require reliable situational awareness regarding infrastructure disruptions and their societal impacts. Due to the rapid unfolding and evolution of events in disasters and emergencies, typical data sensing techniques (such as remote sensing and satellite images) are not sufficient to gain reliable situational awareness about disruptions that affect communities at a local scale. Social sensing enables gathering and analyzing massive user-generated data from various sources (social media, in particular) to monitor unfolding of localized events such as infrastructure disruptions and community needs. To advance social sensing methods and their integration into digital twins of cities, this study proposes an integrated framework for detecting infrastructure disruptions based on three information elements embedded in social media content: images, texts, and geo-maps. The framework consists of three main methods: a graph-based approach for detecting critical tweets, an image-ranking algorithm for selecting important images, and a kernel density estimate for estimating the geographical scales of the disruptions. The application of the proposed framework was demonstrated in a case study of water release from flood control reservoirs in Houston during Hurricane Harvey in 2017. The findings illustrate the capabilities of the proposed framework for capturing the critical situational information and interpreting the results for situational awareness and disruption response. The proposed framework can enhance integration of social sensing elements into smart city digital twins in the context of disasters. Accordingly, the proposed framework can improve the ability of community members, volunteer responders, residents, and other stakeholders in coping with built environment disruptions in disasters.

A general framework for assessing the value of social data for disaster response logistics planning

Enhancing Trustworthiness and Minimising Bias Issues in Leveraging Social Media Data for Disaster Management Response

Social Media Data Analysis and Feedback for Advanced Disaster Risk Management

Social Media Analytics in Disaster Response: A Comprehensive Review

Intelligent Disaster Response via Social Media Analysis - A Survey

Intelligent Disaster Response via Social Media Analysis A Survey

Social Media Use in Emergency Response to Natural Disasters: A Systematic Review With a Public Health Perspective

Social media information sharing for natural disaster response

A Topic Model Based Framework for Identifying the Distribution of Demand for Relief Supplies Using Social Media Data.

Rapid Multi-Dimensional Impact Assessment of Floods

Social network analysis: Characteristics of online social networks after a disaster

Using AI and Social Media Multimodal Content for Disaster Response and Management: Opportunities, Challenges, and Future Directions

A conceptual framework for developing solutions that organise social media information for emergency response teams

A Hierarchical Decision-Making Framework in Social Networks for Efficient Disaster Management

Social Sensing in Disaster City Digital Twin: Integrated Textual–Visual–Geo Framework for Situational Awareness during Built Environment Disruptions

Disaster damage assessment based on fine-grained topics in social media

Relief Supply-Demand Estimation Based on Social Media in Typhoon Disasters Using Deep Learning and a Spatial Information Diffusion Model

Situational awareness extraction: a comprehensive review of social media data classification during natural hazards

A multi-dimensional model of anticipating intention to use social media for disaster risk reduction

Emergent Use of Artificial Intelligence and Social Media for Disaster Management

A New Crowdsourcing Model to Assess Disaster Using Microblog Data in Typhoon Haiyan