Abstract:This chapter presents an approach to detect and track multiple people robustly in real time using laser scan frames. The detection and tracking of people in real time is a problem that arises in a variety of different contexts. Examples include intelligent Surveillance for security purposes, scene analysis for service robot, and crowd behavior analysis for human behavior study. Over the last several years, an increasing number of laser-based people-tracking systems have been developed in both mobile robotics platforms and fixed platforms using one or Multiple laser scanners. It has been proved that processing on laser scanner data makes the tracker much faster and more robust than a vision-only based one in complex situations. In this chapter, we present a novel robust tracker to detect and track multiple people in a crowded and open area in real time. First, raw data are obtained that measures two legs for each people at a height of 16 cm from horizontal ground with multiple registered laser scanners. A stable feature is extracted using accumulated distribution of successive laser frames. In this way, the noise that generates split and merged measurements is smoothed well, and the pattern of rhythmic swinging legs is utilized to extract each leg. Second, a probabilistic tracking model is presented, and then a sequential inference process using a Bayesian rule is described. A sequential inference process is difficult to compute analytically, so two strategies are presented to simplify the computation. In the case of independent tracking, the Kalman filter is used with a more efficient measurement likelihood model based on a region coherency property. Finally, to deal with trajectory fragments we present a concise approach to fuse just a little visual information from synchronized video camera to laser data. Evaluation with real data shows that the proposed method is robust and effective. It achieves a significant improvement compared with existing laser-based trackers.

Evaluation of a Laser-based Multi-people Detection and Tracking System

Laser-based Interacting People Tracking Using Multi-level Observations

Multi-modal Tracking of People Using Laser Scanners and Video Camera

Fusion of Detection and Matching Based Approaches for Laser Based Multiple People Tracking

Tracking multiple people using laser and vision

Real-Time Detection And Tracking Of Multiple People In Laser Scan Frames

Robust Tracking of Multiple People in Crowds Using Laser Range Scanners

Laser-based detection and tracking of multiple people in crowds

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Laser-based Tracking of Multiple Interacting Pedestrians Via On-Line Learning.

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

Bayesian Fusion of Laser and Vision for Multiple People Detection and Tracking

Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics

An online system for multiple interacting targets tracking

Multiple People Continuous Tracking and Identification Using Millimeter-Wave Radar

An Online System For Multiple Interacting Targets Tracking: Fusion Of Laser And Vision, Tracking And Learning

Mmtai: Biometrics-assisted Multi-person Tracking with Mmwave Radar

Tracking Multiple-person using Sparse Stereo Information

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar