Abstract:Most existing perception systems rely on sensory data acquired from cameras, which perform poorly in low light and adverse weather conditions. To resolve this limitation, we have witnessed advanced LiDAR sensors become popular in perception tasks in autonomous driving applications. Nevertheless, their usage in traffic monitoring systems is less ubiquitous. We identify two significant obstacles in cost-effectively and efficiently developing such a LiDAR-based traffic monitoring system: (i) public LiDAR datasets are insufficient for supporting perception tasks in infrastructure systems, and (ii) 3D annotations on LiDAR point clouds are time-consuming and expensive. To fill this gap, we present an efficient semi-automated annotation tool that automatically annotates LiDAR sequences with tracking algorithms while offering a fully annotated infrastructure LiDAR dataset -- FLORIDA (Florida LiDAR-based Object Recognition and Intelligent Data Annotation) -- which will be made publicly available. Our advanced annotation tool seamlessly integrates multi-object tracking (MOT), single-object tracking (SOT), and suitable trajectory post-processing techniques. Specifically, we introduce a human-in-the-loop schema in which annotators recursively fix and refine annotations imperfectly predicted by our tool and incrementally add them to the training dataset to obtain better SOT and MOT models. By repeating the process, we significantly increase the overall annotation speed by three to four times and obtain better qualitative annotations than a state-of-the-art annotation tool. The human annotation experiments verify the effectiveness of our annotation tool. In addition, we provide detailed statistics and object detection evaluation results for our dataset in serving as a benchmark for perception tasks at traffic intersections.

DeepScanner: a Robotic System for Automated 2D Object Dataset Collection with Annotations

GenScan: A Generative Method for Populating Parametric 3D Scan Datasets

An Analysis of Deep Object Detectors For Diver Detection

Automated Multimodal Data Annotation via Calibration With Indoor Positioning System

Semi-Automatic Labeling for Deep Learning in Robotics

ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes

Semi-Automatic Annotation of 3D Radar and Camera for Smart Infrastructure-Based Perception

ALET (Automated Labeling of Equipment and Tools): A Dataset, a Baseline and a Usecase for Tool Detection in the Wild

DART: An Automated End-to-End Object Detection Pipeline with Data Diversification, Open-Vocabulary Bounding Box Annotation, Pseudo-Label Review, and Model Training

CAD-Estate: Large-scale CAD Model Annotation in RGB Videos

COVERED, CollabOratiVE Robot Environment Dataset for 3D Semantic segmentation

Multi-Modal Dataset Acquisition for Photometrically Challenging Object

When the pen is mightier than the sword: semi-automatic 2 and 3D image labelling

A Dataset for Detection and Segmentation of Underwater Marine Debris in Shallow Waters

A New Urban Objects Detection Framework Using Weakly Annotated Sets

'CADSketchNet' -- An Annotated Sketch dataset for 3D CAD Model Retrieval with Deep Neural Networks

Fully automated landmarking and facial segmentation on 3D photographs

Smartannotator an Interactive Tool for Annotating Indoor Rgbd Images

An Efficient Semi-Automated Scheme for Infrastructure LiDAR Annotation

Efficiently Collecting Training Dataset for 2D Object Detection by Online Visual Feedback