Abstract:We propose to use ambient sound as a privacy-aware source of information for COVID-19-related social distance monitoring and contact tracing. The aim is to complement currently dominant Bluetooth Low Energy Received Signal Strength Indicator (BLE RSSI) approaches. These often struggle with the complexity of Radio Frequency (RF) signal attenuation, which is strongly influenced by specific surrounding characteristics. This in turn renders the relationship between signal strength and the distance between transmitter and receiver highly non-deterministic. We analyze spatio-temporal variations in what we call “ambient sound fingerprints”. We leverage the fact that ambient sound received by a mobile device is a superposition of sounds from sources at many different locations in the environment. Such a superposition is determined by the relative position of those sources with respect to the receiver. We present a method for using the above general idea to classify proximity between pairs of users based on Kullback–Leibler distance between sound intensity histograms. The method is based on intensity analysis only, and does not require the collection of any privacy sensitive signals. Further, we show how this information can be fused with BLE RSSI features using adaptive weighted voting. We also take into account that sound is not available in all windows. Our approach is evaluated in elaborate experiments in real-world settings. The results show that both Bluetooth and sound can be used to differentiate users within and out of critical distance (1.5 m) with high accuracies of 77% and 80% respectively. Their fusion, however, improves this to 86%, making evident the merit of augmenting BLE RSSI with sound. We conclude by discussing strengths and limitations of our approach and highlighting directions for future work.

Mind The Gap: Real-time Decentralized Distance Estimation using Ultrasound and Bluetooth across Multiple Smartphones

Smartphone-Based Social Distance Detection Technology with Near-Ultrasonic Signal.

DISTERNING: Distance Estimation Using Machine Learning Approach for COVID-19 Contact Tracing and Beyond.

Distance Estimation for BLE-based Contact Tracing -- A Measurement Study

COVID-19 and Your Smartphone: BLE-Based Smart Contact Tracing

Towards Preventing Gaps in Health Care Systems through Smartphone Use: Analysis of ARKit for Accurate Measurement of Facial Distances in Different Angles

Using Privacy Respecting Sound Analysis to Improve Bluetooth Based Proximity Detection for COVID-19 Exposure Tracing and Social Distancing

Passive and Privacy-preserving Human Localization via mmWave Access Points for Social Distancing

Monitoring Social Distancing With Single Image Depth Estimation

A Social Distance Estimation and Crowd Monitoring System for Surveillance Cameras

Social Distance Monitor with a Wearable Magnetic Field Proximity Sensor

Interpersonal Distance Tracking with mmWave Radar and IMUs

DeepBLE: Generalizing RSSI-based Localization Across Different Devices

SonicPACT: An Ultrasonic Ranging Method for the Private Automated Contact Tracing (PACT) Protocol

CamDist: Camera Based Distance Estimation with a Smartphone

Fighting Pandemics With Augmented Reality and Smart Sensing-Based Social Distancing

Continuous social distance monitoring in indoor space

Underwater Acoustic Ranging Between Smartphones

A Low-Cost Centimeter-Level Acoustic Localization System Without Time Synchronization

Large-scale Indoor Localization Solution for Pervasive Smartphones Using Corrected Acoustic Signals and Data-driven PDR

BeSound: Bluetooth-Based Position Estimation Enhancing with Cross-Modality Distillation