Video Analytics for Business Intelligence

Caifeng Shan,Fatih Porikli,Tao Xiang,Shaogang Gong

DOI: https://doi.org/10.1007/978-3-642-28598-1

2012-01-01

Abstract:Closed Circuit TeleVision (CCTV) cameras have been increasingly deployed pervasively in public spaces including retail centres and shopping malls. Intelligent video analytics aims to automatically ana

What problem does this paper attempt to address?

Video Analytics - Killer App for Edge Computing

Ganesh Ananthanarayanan,Victor Bahl,Landon Cox,Alex Crown,Shadi Nogbahi,Yuanchao Shu

DOI: https://doi.org/10.1145/3307334.3328589

2019-01-01

Abstract:The world is witnessing an unprecedented increase in camera deployment. The USA and UK, for instance, have one camera for every 8 people. Video analytics from these cameras are becoming more and more pervasive, exerting important functions on a wide range of verticals including manufacturing, transportation, and retails. While vision techniques have seen considerable advancement, they have come at the expense of compute and network cost.
Scaling Video Analytics Systems to Large Camera Deployments

Samvit Jain,Ganesh Ananthanarayanan,Junchen Jiang,Yuanchao Shu,Joseph Gonzalez

DOI: https://doi.org/10.1145/3301293.3302366

2019-01-01

Abstract:Driven by advances in computer vision and the falling costs of camera hardware, organizations are deploying video cameras en masse for the spatial monitoring of their physical premises. Scaling video analytics to massive camera deployments, however, presents a new and mounting challenge, as compute cost grows proportionally to the number of camera feeds. This paper is driven by a simple question: can we scale video analytics in such a way that cost grows sublinearly, or even remains constant, as we deploy more cameras, while inference accuracy remains stable, or even improves. We believe the answer is yes. Our key observation is that video feeds from wide-area camera deployments demonstrate significant content correlations (e.g. to other geographically proximate feeds), both in space and over time. These spatio-temporal correlations can be harnessed to dramatically reduce the size of the inference search space, decreasing both workload and false positive rates in multi-camera video analytics. By discussing use-cases and technical challenges, we propose a roadmap for scaling video analytics to large camera networks, and outline a plan for its realization.
Edge Video Analytics for Public Safety: A Review

Qingyang Zhang,Hui Sun,Xiaopei Wu,Hong Zhong

DOI: https://doi.org/10.1109/JPROC.2019.2925910

IF: 20.6

2019-01-01

Proceedings of the IEEE

Abstract:With the installation of enormous public safety and transportation infrastructure cameras, video analytics has come to play an essential part in public safety. Typically, video analytics is to collectively leverage the advanced computer vision (CV) and artificial intelligence (AI) to solve the four-W problem. That is to identify Who has done something (What) at a specific place (Where) at some time (When). According to the difference of latency requirements, video analytics can be applied to postevent retrospective analysis, such as archive management, search, forensic investigation and real-time live video stream analysis, such as situation awareness, alerting, and interested object (criminal suspect/missing vehicle) detection. The latter is characterized as having higher requirements on hardware resources as the sophisticated image processing algorithms under the hood. However, analyzing large-scale live video streams on the Cloud is impractical as the edge solution that conducts the video analytics on (or close to) the camera provides a silvering light. Analyzing live video streams on the edge is not trivial due to the constrained hardware resources on edge. The AI-dominated video analytics requires higher bandwidth, consumes considerable CPU/GPU resources for processing, and demands larger memory for caching. In this paper, we review the applications, algorithms, and solutions that have been proposed recently to facilitate edge video analytics for public safety.
The Big Data Analytics and Applications of the Surveillance System Using Video Structured Description Technology.

Zheng Xu,Lin Mei,Chuanping Hu,Yunhuai Liu

DOI: https://doi.org/10.1007/s10586-016-0581-x

2016-01-01

Cluster Computing

Abstract:Recently, the video data has very huge volume, taking one city for example, thousands of cameras are built of which each collects high-definition video over 24---48 GB every day with the rapidly growth; secondly, data collected includes variety of formats involving multimedia, images and other unstructured data; furthermore the valuable information contains in only a few frames called key frames of massive video data; and the last problem caused is how to improve the processing velocity of a large amount of original video with computers, so as to enhance the crime prediction and detection effectiveness of police and users. In this paper, we conclude a novel architecture for next generation public security system, and the "front + back" pattern is adopted to address the problems brought by the redundant construction of current public security information systems which realizes the resource consolidation of multiple IT resources, and provides unified computing and storage environment for more complex data analysis and applications such as data mining and semantic reasoning. Under the architecture, we introduce cloud computing technologies such as distributed storage and computing, data retrieval of huge and heterogeneous data, provide multiple optimized strategies to enhance the utilization of resources and efficiency of tasks. This paper also presents a novel strategy to generate a super-resolution image via multi-stage dictionaries which are trained by a cascade training process. Extensive experiments on image super-resolution validate that the proposed solution can get much better results than some state-of-the-arts ones.
Intelligent Video Surveillance Systems

Aswini Reddithala,Jnaneswar Bammidi,Abhijith Pegallapati,Suresh Kumar Moru,Yogesh Parnandi,V. Chundi

DOI: https://doi.org/10.1109/ICCST49569.2021.9717400

2021-10-11

Abstract:In the past decades, there has been tremendous growth in security-related issues throughout the world. With such a multifold increase in demand for security, video surveillance has become a critical research area. In the most recent studies, there were many attempts to integrate image processing algorithms. It was also possible to achieve artificial intelligence capabilities using computer vision. Intelligent video surveillance systems can be described as a technique to assist security personnel by providing reliable real-time alerts, thus supporting the investigations with efficient video analysis. This paper discusses a comprehensive and systematic overview of the existing video surveillance techniques and possible enhancements.

Computer Science,Engineering
Enhancing Situational Awareness in Surveillance: Leveraging Data Visualization Techniques for Machine Learning-based Video Analytics Outcomes

Babak Rahimi Ardabili,Shanle Yao,Armin Danesh Pazho,Lauren Bourque,Hamed Tabkhi

DOI: https://doi.org/10.48550/arXiv.2312.05629

2023-12-09

Computers and Society

Abstract:The pervasive deployment of surveillance cameras produces a massive volume of data, requiring nuanced interpretation. This study thoroughly examines data representation and visualization techniques tailored for AI surveillance data within current infrastructures. It delves into essential data metrics, methods for situational awareness, and various visualization techniques, highlighting their potential to enhance safety and guide urban development. This study is built upon real-world research conducted in a community college environment, utilizing eight cameras over eight days. This study presents tools like the Occupancy Indicator, Statistical Anomaly Detection, Bird's Eye View, and Heatmaps to elucidate pedestrian behaviors, surveillance, and public safety. Given the intricate data from smart video surveillance, such as bounding boxes and segmented images, we aim to convert these computer vision results into intuitive visualizations and actionable insights for stakeholders, including law enforcement, urban planners, and social scientists. The results emphasize the crucial impact of visualizing AI surveillance data on emergency handling, public health protocols, crowd control, resource distribution, predictive modeling, city planning, and informed decision-making.
Video analytics for multi-camera traffic surveillance.

Dongyu Ang,Yao Shen,Prakash Duraisamy

DOI: https://doi.org/10.1145/1645373.1645378

2009-01-01

Abstract:ABSTRACTA low-cost Video Image Detection Systems (VIDS) is introduced. Using video analytics, the system can count the number of vehicles making a left (or right) turn at an unseen intersection plus collect statistics on other traffic conditions. Other functionality can be added. Two cameras with non-overlapping views were used as the information source. Between them was situated a "T" intersection. Comparing the automated data collected from the two cameras' video with manually generated truth data, no errors were found over five minutes of video.
Machine Learning Software for the Detection of Violence from CCTV Live Footage

Adupa Nithin Sai,Kowdodi Siva Prasad

DOI: https://doi.org/10.46610/joipai.2023.v09i03.002

2023-09-30

Journal of Image Processing and Artificial Intelligence

Abstract:Automated CCTV analytics have become a potent resource for boosting public safety. The software program, which has sophisticated video analytics capabilities, isintroduced in this paper. The software program can instantly identify situations and notify concerned agencies such as the police and medical staff. Software processes video in three different ways: live streaming from external links, video uploaded from a computer, and real-time video from security cameras. Using past data for analysis, it scans CCTV feeds from public spaces for instances of violent crime, theft, burglary, and other crimes. The software’s key features are real-time CCTV stream analysis, alarm and report generatingand database updatingfor prompt response by the nearest police station.This software has the potential to significantly improve public safety measures by enabling proactive incident detection and real-time response, which will improve law enforcement operations.The software Program boasts key features such as real-time CCTV stream analysis, the instantaneous generation of alarms and reports, and seamless database updates accessible to the nearest police station for immediate response. This software's potential to significantly enhance public safety measures lies in its capacity to enable proactive incident detection and real-time responses, promising to optimize law enforcement operations and overall security.
Edge-Assisted Real-Time Video Analytics with Spatial–Temporal Redundancy Suppression

Ziyi Wang,Xiaoyu He,Zhizhen Zhang,Yishuo Zhang,Zhen Cao,Wei Cheng,Wendong Wang,Yong Cui

DOI: https://doi.org/10.1109/jiot.2022.3224750

IF: 10.6

2022-01-01

IEEE Internet of Things Journal

Abstract:Driven by plummeting camera prices and advances of video inference algorithms, video cameras are deployed ubiquitously and organizations usually rely on live video analytics to retrieve key information, such as the locations and identities of target objects. However, analyzing real-time video poses severe challenges to today’s network and computation systems. To balance accuracy, bandwidth usage, and latency, we present EVA, an edge-assisted real-time video analytics framework, which coordinates computationally weak cameras with more powerful edge servers to enable video analytics under the accuracy and latency requirements of applications. EVA treats the region where a target object is located as a fine-grained transmission unit and exploits the redundancies in both spatial and temporal domains to reduce the bandwidth usage. Based on the framework, we design an adaptive offloading algorithm, which coordinates the recognition process between the camera and the server. To adapt to complex environments, we then design a threshold adjustment algorithm to tune the confidence threshold dynamically. Experiments on real-world video feeds show that compared to several recent baselines on multiple video genres, EVA maintains high accuracy while reducing bandwidth usage by up to 90%.
Spatial-Based Intelligent System for CATV Network Analysis

Zhenhong Du,Renyi Liu,Nan Liu,Yuanzheng Shao

DOI: https://doi.org/10.1109/ICINIS.2008.179

2008-01-01

Abstract:The design and application of intelligent system has become a hotspot in todaypsilas intelligent study. With the expansive application of intelligent system, the study on spatial-based CATV intelligent analysis receives a growing concern. Based on the analysis of the status quo and development of intelligent technologies, aiming at the characteristics of CATV network management, a three-tier distributed spatial information system with superior and subordinate (SAS) intelligent analyzer and statistic container is proposed in this paper. The system provided a good solution to realize spatial visualization management of CATV network analysis. The spatial-based system designed by this paper also has certain significance of reference to the design of other intelligent applications.
Intelligent approach for analyzing surveillance videos in urban emergency management

Xinyu LI,Zuhua JIANG,Chunyan SHAN,Chao LIU,Chuchu HE

DOI: https://doi.org/10.3778/j.issn.1002-8331.1606-0382

2017-01-01

Abstract:With the acceleration of urban modernization process, it's urgent to construct an efficient and comprehensive system for managing the urban emergency. Surveillance videos obtained by monitors in multiple locations in cities are the indispensable input data of management system. However, these videos are processed by human with high costs and poor results. This paper proposes an intelligent approach for analyzing surveillance videos of urban emergency. Based on open source computer vision libraries, this approach extracts the quantities and locations of objects. Generating tracks of objects and matching pre-set abnormal templates, normalized context model of emergencies is constructed, and subsequently used for analyzing and warning. This paper also operates the proposed approach on videos acquired in districts of a university cam-pus and high-tech park, in order to evaluate the feasibility and reasonability of the proposed approach.
Video Big Data in Smart City: Background Construction and Optimization for Surveillance Video Processing

Ling Tian,Hongyu Wang,Yimin Zhou,Chengzong Peng

DOI: https://doi.org/10.1016/j.future.2017.12.065

2018-01-01

Abstract:Transforming infrastructures, buildings and services with the sensed data from the Internet of Things (IoT) technique has drawn wide attention. Enormous video data from city surveillance cameras poses huge challenges of transmission, storage and analysis, which necessitates new video compression technologies. The fusion of video data generated from smart city could be used to support city management and urban policy. Based on the specific characteristics of surveillance video, which are successive pictures have very strong correlations and each picture can be divided into background and foreground, this work proposes a block-level background modeling (BBM) algorithm to support long-term reference structure for efficient surveillance video coding. A rate–distortion optimization for surveillance source (SRDO) algorithm is also developed to improve the coding performance. Experimental results show that the proposed BBM and SRDO can significantly improve the compression performance, which can effectively support diverse video applications in smart city.
Video Intelligence as a component of a Global Security system

Dominique Verdejo,Eunika Mercier-Laurent

DOI: https://doi.org/10.48550/arXiv.2201.04349

IF: 14.4

2022-01-12

Artificial Intelligence

Abstract:This paper describes the evolution of our research from video analytics to a global security system with focus on the video surveillance component. Indeed video surveillance has evolved from a commodity security tool up to the most efficient way of tracking perpetrators when terrorism hits our modern urban centers. As number of cameras soars, one could expect the system to leverage the huge amount of data carried through the video streams to provide fast access to video evidences, actionable intelligence for monitoring real-time events and enabling predictive capacities to assist operators in their surveillance tasks. This research explores a hybrid platform for video intelligence capture, automated data extraction, supervised Machine Learning for intelligently assisted urban video surveillance; Extension to other components of a global security system are discussed. Applying Knowledge Management principles in this research helps with deep problem understanding and facilitates the implementation of efficient information and experience sharing decision support systems providing assistance to people on the field as well as in operations centers. The originality of this work is also the creation of "common" human-machine and machine to machine language and a security ontology.
Efficient Task-driven Video Data Privacy Protection for Smart Camera Surveillance System

Zhiqiang Wang,Jiahui Hou,Guangyu Wu,Suyuan Liu,Puhan Luo,Xiangyang Li

DOI: https://doi.org/10.1145/3625825

2024-01-01

ACM Transactions on Sensor Networks

Abstract:As one of the most commonly used AIoT sensors, smart cameras and their supporting services, namely cloud video surveillance (CVS) systems have brought great convenience to people’s lives. Recent CVS providers use different machine learning (ML) techniques to improve their services (regarded as tasks) based on the uploaded video. However, uploading data to the CVS providers may cause severe privacy issues. Existing works that remove privacy information could not achieve a high trade-off between data usability and privacy because the importance of information varies with the task. In addition, it is challenging to design a real-time privacy protection mechanism, especially in resource-constraint smart cameras. In this work, we design a task-driven and efficient video privacy protection mechanism for a better trade-off between privacy and data usability. We use Class Activation Mapping to protect privacy while preserving data usability. To improve the efficiency, we utilize the motion vector and residual matrix produced during video codec. Our work outperforms the ROI-based methods in data protection while preserving data usability. The attack accuracy drops 70%, while the task accuracy is comparable to those without protection (within ± 4%). The average protection frame rate of the High Definition video can exceed 16 fps+ even on a CPU.
Intelligent Video Analysis Technology of Public Security Standard Sets of Data and Measurements

Huan Du,Zheng Xu,Zhiguo Yan,Shuhong Gao

DOI: https://doi.org/10.1007/978-981-10-7398-4_47

2018-01-01

Abstract:AbstractVideo surveillance technology has become an indispensable method of public security work. As the number of monitored devices is increasing, resulting in a large amount of video data, resulting in great strength brought by police officers. From the early days of license plate recognition to the nearest human face than, vehicles feature recognition technology, are typical applications of intelligent video analysis, has produced positive results in public security work. With the progress of artificial intelligence techniques, especially the depth of learning in the field of video analysis to continuously refresh the recognition task, can see into the future will have more intelligent video analysis technology penetration into the field of public safety. However, intelligent analysis techniques in the field of public security still faces great challenges and bottlenecks.
Crowd management, crime detection, work monitoring using aiml

P.R.Adithya,Dheepak.S,B.Akash,Harshini.V,Sai Lakshana

2023-11-21

Abstract:This research endeavors to harness the potential of existing Closed-Circuit Television (CCTV) networks for a comprehensive approach to crowd management, crime prevention, and workplace monitoring through the integration of Artificial Intelligence (AI) and Machine Learning (ML) technologies. The primary objective is to develop and implement advanced algorithms capable of real-time analysis of video feeds, enabling the identification and assessment of crowd dynamics, early detection of potential criminal activities, and continuous monitoring of workplace environments. By leveraging AI/ML, the project aims to optimize surveillance capabilities, thereby enhancing public safety measures and improving organizational productivity. This initiative underscores the transformative impact that intelligent video analytics can have on existing infrastructure, mitigating the need for extensive system overhauls while significantly advancing security and operational efficiency.

Computer Vision and Pattern Recognition
Research on Intelligent Visual Surveillance for Public Security

Wenxiong Kang,Feiqi Deng

DOI: https://doi.org/10.1109/icis.2007.157

2007-01-01

Abstract:Intelligent visual surveillance plays an important role in the assurance of the public security, it is different from traditional passive video surveillance, it transforms the computer role from "Looking at People" to "Understanding People". In the paper, we review advances in intelligent visual surveillance, and present some future research directions.
From Lab to Field: Real-World Evaluation of an AI-Driven Smart Video Solution to Enhance Community Safety

Shanle Yao,Babak Rahimi Ardabili,Armin Danesh Pazho,Ghazal Alinezhad Noghre,Christopher Neff,Lauren Bourque,Hamed Tabkhi

2024-09-04

Abstract:This article adopts and evaluates an AI-enabled Smart Video Solution (SVS) designed to enhance safety in the real world. The system integrates with existing infrastructure camera networks, leveraging recent advancements in AI for easy adoption. Prioritizing privacy and ethical standards, pose based data is used for downstream AI tasks such as anomaly detection. Cloud-based infrastructure and mobile app are deployed, enabling real-time alerts within communities. The SVS employs innovative data representation and visualization techniques, such as the Occupancy Indicator, Statistical Anomaly Detection, Bird's Eye View, and Heatmaps, to understand pedestrian behaviors and enhance public safety. Evaluation of the SVS demonstrates its capacity to convert complex computer vision outputs into actionable insights for stakeholders, community partners, law enforcement, urban planners, and social scientists. This article presents a comprehensive real-world deployment and evaluation of the SVS, implemented in a community college environment across 16 cameras. The system integrates AI-driven visual processing, supported by statistical analysis, database management, cloud communication, and user notifications. Additionally, the article evaluates the end-to-end latency from the moment an AI algorithm detects anomalous behavior in real-time at the camera level to the time stakeholders receive a notification. The results demonstrate the system's robustness, effectively managing 16 CCTV cameras with a consistent throughput of 16.5 frames per second (FPS) over a 21-hour period and an average end-to-end latency of 26.76 seconds between anomaly detection and alert issuance.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
Best: Benchmark And Evaluation Of Surveillance Task

Chongyang Zhang,Bingbing Ni,Li Song,Guangtao Zhai,Xiaokang Yang,Wenjun Zhang

DOI: https://doi.org/10.1007/978-3-319-54526-4_29

2016-01-01

Abstract:Smart/Intelligent video surveillance technology plays the central role in the emerging smart city systems. Most intelligent visual algorithms require large-scale image/video datasets to train classifiers or acquire discriminative features using machine learning. However, most existing datasets are collected from non-surveillance conditions, which have significant differences as compared to the practical surveillance data. As a consequence, many existing intelligent visual algorithms trained on traditional datasets perform not so well in the real world surveillance applications. We believe the lack of high quality surveillance datasets has greatly limited the application of the computer vision algorithms in practical surveillance scenarios. To solve this problem, one large-scale and comprehensive surveillance image and video database and test platform, called Benchmark and Evaluation of Surveillance Task (abbreviated as BEST), is developed in this work. The original images and videos in BEST were all collected from on-using surveillance cameras, and have been carefully selected to cover a wide and balanced range of outdoor surveillance scenarios. Compared with the existing surveillance/non-surveillance datasets, the proposed BEST dataset provides a realistic, extensive and diversified testbed for a more comprehensive performance evaluation. Our experimental results show that, performance of seven pedestrian detection algorithms on BEST is worse than that on the existing datasets. This highlights the difference between non-surveillance data and real surveillance data, which is the major cause of the performance decreases. The dataset is open to the public and can be downloaded at: http://ivlab.sjtu.edu.cn/best/Data/List/Datasets.
Predicting Consumer In-Store Purchase Using Real-Time Retail Video Analytics

Rubing Li,Anindya Ghose,Kaiquan Xu,Beibei Li

DOI: https://doi.org/10.2139/ssrn.4513385

2023-01-01

SSRN Electronic Journal

Abstract:The proliferation of cameras and their video data in retail marketing presents new opportunities for academics to study customer behavior with the newer video analytics tools. In collaboration with a large retail chain store in Asia, we obtained a unique video dataset collected from in-store cameras and combined it with customer-transaction data. By leveraging state-of-the-art computer vision techniques, we extracted features of customer demographics, physiological appearance, emotional expression, and contextual dimensions from the videos. We implemented facial-recognition and face-tracking algorithms to extract consumer behavior with a limited amount of human aid and obtained consumer facial features on a scalable basis. We propose herein a novel framework that can use machine learning and deep learning models to analyze combined video and customer-transaction data in any commercial context to predict customer purchase decisions. The results show that our framework could in fact be effectively used to make predictions of consumer offline purchase decisions, which successful outcome reveals the importance of incorporating emotional response into prediction. Overall, our study demonstrates how video-based content can be used to understand customer behavior along multiple dimensions on a scalable basis. Our findings 1) complement the literature that examined customer behavior by incorporating video data into analysis, 2) reveal the multi-dimensional drivers of purchase decisions in a retail setting, and 3) provide for an implementable video analytics tool that can be usefully employed by marketers and practitioners. An important managerial implication, furthermore, is that our framework can be incorporated into the omni-channel retailing context to provide a win-win for both firms and customers and generate possibilities for offline recommendations.

Video Analytics for Business Intelligence

Video Analytics - Killer App for Edge Computing

Scaling Video Analytics Systems to Large Camera Deployments

Edge Video Analytics for Public Safety: A Review

The Big Data Analytics and Applications of the Surveillance System Using Video Structured Description Technology.

Intelligent Video Surveillance Systems

Enhancing Situational Awareness in Surveillance: Leveraging Data Visualization Techniques for Machine Learning-based Video Analytics Outcomes

Video analytics for multi-camera traffic surveillance.

Machine Learning Software for the Detection of Violence from CCTV Live Footage

Edge-Assisted Real-Time Video Analytics with Spatial–Temporal Redundancy Suppression

Spatial-Based Intelligent System for CATV Network Analysis

Intelligent approach for analyzing surveillance videos in urban emergency management

Video Big Data in Smart City: Background Construction and Optimization for Surveillance Video Processing

Video Intelligence as a component of a Global Security system

Efficient Task-driven Video Data Privacy Protection for Smart Camera Surveillance System

Intelligent Video Analysis Technology of Public Security Standard Sets of Data and Measurements

Crowd management, crime detection, work monitoring using aiml

Research on Intelligent Visual Surveillance for Public Security

From Lab to Field: Real-World Evaluation of an AI-Driven Smart Video Solution to Enhance Community Safety

Best: Benchmark And Evaluation Of Surveillance Task

Predicting Consumer In-Store Purchase Using Real-Time Retail Video Analytics