Open-source data pipeline for street-view images: a case study on community mobility during COVID-19 pandemic

Matthew Martell,Nick Terry,Ribhu Sengupta,Chris Salazar,Nicole A. Errett,Scott B. Miles,Joseph Wartman,Youngjun Choe
2024-01-24
Abstract:Street View Images (SVI) are a common source of valuable data for researchers. Researchers have used SVI data for estimating pedestrian volumes, demographic surveillance, and to better understand built and natural environments in cityscapes. However, the most common source of publicly available SVI data is Google Street View. Google Street View images are collected infrequently, making temporal analysis challenging, especially in low population density areas. Our main contribution is the development of an open-source data pipeline for processing 360-degree video recorded from a car-mounted camera. The video data is used to generate SVIs, which then can be used as an input for temporal analysis. We demonstrate the use of the pipeline by collecting a SVI dataset over a 38-month longitudinal survey of Seattle, WA, USA during the COVID-19 pandemic. The output of our pipeline is validated through statistical analyses of pedestrian traffic in the images. We confirm known results in the literature and provide new insights into outdoor pedestrian traffic patterns. This study demonstrates the feasibility and value of collecting and using SVI for research purposes beyond what is possible with currently available SVI data. Limitations and future improvements on the data pipeline and case study are also discussed.
Computer Vision and Pattern Recognition,Applications
What problem does this paper attempt to address?
The paper attempts to address the following major issues: 1. **Temporal instability of existing Street View Image (SVI) data**: Existing SVI data (such as Google Street View) have low update frequencies, especially in areas with lower population density, making time series analysis difficult. 2. **Limitations of data collected by enterprises**: Data collected by enterprises like Google Street View have certain limitations in terms of coverage, time, and season, making them unreliable for time series research. 3. **Development of an open-source data processing pipeline**: To overcome the above issues, the authors propose an open-source data processing pipeline for generating street view images from videos recorded by vehicle-mounted 360-degree cameras, and further conducting pedestrian detection and analysis. By creating this data processing pipeline, the authors aim to demonstrate the feasibility of collecting longitudinal street view image data and prove the value of this approach in studying community mobility. Specifically, they validated the effectiveness and reliability of the pipeline through a 38-month longitudinal survey in the city of Seattle, providing new insights into outdoor pedestrian traffic patterns. Additionally, the study explores the impact of vaccine availability and local population characteristics on pedestrian detection, considering weekly and annual seasonal variations.