From Lab to Field: Real-World Evaluation of an AI-Driven Smart Video Solution to Enhance Community Safety

Shanle Yao,Babak Rahimi Ardabili,Armin Danesh Pazho,Ghazal Alinezhad Noghre,Christopher Neff,Lauren Bourque,Hamed Tabkhi
2024-09-04
Abstract:This article adopts and evaluates an AI-enabled Smart Video Solution (SVS) designed to enhance safety in the real world. The system integrates with existing infrastructure camera networks, leveraging recent advancements in AI for easy adoption. Prioritizing privacy and ethical standards, pose based data is used for downstream AI tasks such as anomaly detection. Cloud-based infrastructure and mobile app are deployed, enabling real-time alerts within communities. The SVS employs innovative data representation and visualization techniques, such as the Occupancy Indicator, Statistical Anomaly Detection, Bird's Eye View, and Heatmaps, to understand pedestrian behaviors and enhance public safety. Evaluation of the SVS demonstrates its capacity to convert complex computer vision outputs into actionable insights for stakeholders, community partners, law enforcement, urban planners, and social scientists. This article presents a comprehensive real-world deployment and evaluation of the SVS, implemented in a community college environment across 16 cameras. The system integrates AI-driven visual processing, supported by statistical analysis, database management, cloud communication, and user notifications. Additionally, the article evaluates the end-to-end latency from the moment an AI algorithm detects anomalous behavior in real-time at the camera level to the time stakeholders receive a notification. The results demonstrate the system's robustness, effectively managing 16 CCTV cameras with a consistent throughput of 16.5 frames per second (FPS) over a 21-hour period and an average end-to-end latency of 26.76 seconds between anomaly detection and alert issuance.
Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to enhance community safety and functionality by deploying and evaluating an AI - based Smart Video Solution (SVS) in the real world. Specifically, the paper focuses on the following aspects: 1. **Enhancing community safety**: By integrating the existing surveillance camera network and using AI technology to analyze video data in real - time, it provides actionable insights to improve public safety. 2. **Privacy and ethical standards**: Ensure that the system can protect personal privacy and meet ethical standards when processing and analyzing video data. To this end, the system uses pose - based data for downstream AI tasks, such as anomaly detection. 3. **Real - time response**: Through cloud infrastructure and mobile applications, real - time alerts within the community are achieved, enabling stakeholders, community partners, law enforcement agencies, urban planners, and social scientists to take timely action. 4. **Innovative data representation and visualization techniques**: A variety of innovative data representation and visualization tools are introduced, such as Occupancy Indicator, Statistical Anomaly Detection, Bird’s Eye View, and Heatmaps, to better understand pedestrian behavior and resource allocation, thereby supporting urban planning and public safety. 5. **System performance evaluation**: Evaluate the performance of the system in a real - environment, especially the latency and throughput when dealing with multiple camera inputs and high - density crowds. The paper describes in detail the performance of the system under different configurations, including settings with 8, 12, and 16 camera nodes. 6. **Community participation and public perception**: Through survey research, understand the public's attitude and perception towards this AI - driven video solution, especially regarding safety and privacy issues. In summary, this paper aims to demonstrate the potential and practical effects of an AI - driven smart video solution in enhancing community safety and functionality through actual deployment and evaluation.