Abstract:In this study, we present a novel approach leveraging the segment anything model (SAM) for the efficient detection and tracking of vehicles in urban traffic surveillance systems by utilizing uncalibrated low-resolution highway cameras. This research addresses the critical need for accurate vehicle monitoring in intelligent transportation systems (ITS) and smart city infrastructure. Traditional methods often struggle with the variability and complexity of urban environments, leading to suboptimal performance. Our approach harnesses the power of SAM, an advanced deep learning-based image segmentation algorithm, to significantly enhance the detection accuracy and tracking robustness. Through extensive testing and evaluation on two datasets of 511 highway cameras from Quebec, Canada and NVIDIA AI City Challenge Track 1, our algorithm achieved exceptional performance metrics including a precision of 89.68%, a recall of 97.87%, and an F1-score of 93.60%. These results represent a substantial improvement over existing state-of-the-art methods such as the YOLO version 8 algorithm, single shot detector (SSD), region-based convolutional neural network (RCNN). This advancement not only highlights the potential of SAM in real-time vehicle detection and tracking applications, but also underscores its capability to handle the diverse and dynamic conditions of urban traffic scenes. The implementation of this technology can lead to improved traffic management, reduced congestion, and enhanced urban mobility, making it a valuable tool for modern smart cities. The outcomes of this research pave the way for future advancements in remote sensing and photogrammetry, particularly in the realm of urban traffic surveillance and management.

The Fast Detection Method for Abnormally Vehicle Behavior Based on Bhattacharyya Distance Measure

Vehicles Detection and Tracking Based on the Sub-Feature

Vision‐based Inter‐vehicle Distance Estimation for Driver Alarm System

A Method for Vehicle Detection Based on Local Gradients Vector

Self-Adaptive Road Detection Method Based on Vision and Cluster Analysis

Real-time Vehicle Detection and Distance Measurement in Multi-Environment

Vehicle Feature Point Trajectory Clustering and Vehicle Behavior Analysis in Complex Traffic Scenes.

A moving vehicle segmentation method based on clustering of feature points for tracking at urban intersection

Vehicle Speed Detection Method Based on Video Corner Feature Matching

Abnormal behavior detection for highway vehicle based on lane model

Research on Recognition and Classification of Moving Objects in Mixed Traffic Based on Video Detection

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

A fast detection algorithm for moving vehicle in traffic scenes

Anomaly Detection in Traffic Scenes via Spatial-aware Motion Reconstruction

Detection and Classification of Moving Vehicle from Video Using Multiple Spatio-Temporal Features

An Optimized Algorithm for Dangerous Driving Behavior Identification Based on Unbalanced Data

Vehicle behavior analysis using reconstructed 3D parameters for road safety

The study of the detection of pedestrian and bicycle using image processing

A Framework of Abnormal Behavior Detection and Classification Based on Big Trajectory Data for Mobile Networks

Proposing an Efficient Deep Learning Algorithm Based on Segment Anything Model for Detection and Tracking of Vehicles through Uncalibrated Urban Traffic Surveillance Cameras

Dual-Modality Vehicle Anomaly Detection via Bilateral Trajectory Tracing