Statistical methods for assessing agreement.

G. Fitzmaurice

DOI: https://doi.org/10.1016/S0899-9007(02)00802-X

2002-07-01

Abstract:

What problem does this paper attempt to address?

Radar2: Passive Spy Radar Detection and Localization Using COTS Mmwave Radar

Yanlong Qiu,Jiaxi Zhang,Yanjiao Chen,Jin Zhang,Bo Ji

DOI: https://doi.org/10.1109/tifs.2023.3268880

IF: 7.231

2023-01-01

IEEE Transactions on Information Forensics and Security

Abstract:Millimeter-wave (mmWave) radars have found applications in a wide range of domains, including human tracking, health monitoring, and autonomous driving, for their unobtrusive nature and high range accuracy. These capabilities, however, if used for malicious purposes, could also result in serious security and privacy issues. For example, a user’s daily life could be secretly monitored by a spy radar. Hence, there is a strong urge to develop systems that can detect and locate such spy radars. In this paper, we propose Radar2, a practical system for passive spy radar detection and localization using a single commercial off-the-shelf (COTS) mmWave radar. Specifically, we propose a novel Frequency Component Detection method to detect the existence of mmWave signals, distinguish between mmWave radar and WiGig signals using a waveform classifier based on a convolutional neural network (CNN), and localize spy radars using triangulation based on the detector’s observations at multiple anchor points. Not only does Radar2 work for different types of mmWave radar, but it can also detect and localize multiple radars simultaneously. Finally, we performed extensive experiments to evaluate the effectiveness and robustness of Radar2 in various settings. Our evaluation results show that the radar detection rate is above 96% and the localization error is within 0.3m. The results also reveal that Radar2 is robust against various environmental factors (e.g., room layout and human activities).
Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Fucheng Cui,Qiang Zhang,Jingxuan Wu,Yuying Song,Zhouzhen Xie,Chunyi Song,Zhiwei Xu

DOI: https://doi.org/10.1109/jsen.2023.3255924

IF: 4.3

2023-01-01

IEEE Sensors Journal

Abstract:This article focuses on the challenge of pedestrian tracking using camera and millimeter wave (MMW) radar in autonomous driving. Pedestrian tracking using a single sensor has inherent limitations due to the lack of comprehensive dimensionality of tracking information. Meanwhile, the existing multisensor-based tracking algorithms suffer from limited tracking accuracy by applying the fusion of projected positions. To enhance the tracking accuracy and robustness, a multisensor-based tracking algorithm based on fused detection of MMW radar and vision is proposed, which improves the association of detection results from multiple heterogeneous sensors by utilizing newly designed back-projection and undirected graph, and finally improves the fusion detection by simultaneously utilizing a pedestrian’s appearance, and local and global location information. Field tests are conducted to produce dataset, and the performance evaluation results based on the self-produced dataset have verified the superiority of the proposed algorithm over the conventional single-sensor-based tracking algorithm and multisensor-based tracking algorithms.
Radar Style Transfer for Metric Robot Localisation on Lidar Maps

Huan Yin,Yue Wang,Jun Wu,Rong Xiong

DOI: https://doi.org/10.1049/cit2.12112

IF: 7.985

2023-01-01

CAAI Transactions on Intelligence Technology

Abstract:Lidar and visual data are affected heavily in adverse weather conditions due to sensing mechanisms, which bring potential safety hazards for vehicle navigation. Radar sensing is desirable to build a more robust navigation system. In this paper, a cross‐modality radar localisation on prior lidar maps is presented. Specifically, the proposed workflow consists of two parts: first, bird's‐eye‐view radar images are transferred to fake lidar images by training a generative adversarial network offline. Then with online radar scans, a Monte Carlo localisation framework is built to track the robot pose on lidar maps. The whole online localisation system only needs a rotating radar sensor and a pre‐built global lidar map. In the experimental section, the authors conduct an ablation study on image settings and test the proposed system on Oxford Radar Robot Car Dataset. The promising results show that the proposed localisation system could track the robot pose successfully, thus demonstrating the feasibility of radar style transfer for metric robot localisation on lidar maps.
Multi-Object Tracking with mmWave Radar: A Review

Andre Pearce,J. Andrew Zhang,Richard Xu,Kai Wu

DOI: https://doi.org/10.3390/electronics12020308

IF: 2.9

2023-01-07

Electronics

Abstract:The boundaries of tracking and sensing solutions are continuously being pushed. A stimulation in this field over recent years is exploiting the properties of millimeter wave (mmWave) radar to achieve simultaneous tracking and sensing of multiple objects. This paper aims to provide a critical analysis of the current literature surrounding multi-object tracking and sensing with short-range mmWave radar. There is significant literature available regarding single-object tracking using mmWave radar, demonstrating the maturity of single-object tracking systems. However, innovative research and advancements are also needed in the field of mmWave radar multi-object tracking, specifically with respect to uniquely identifying multiple target tracks across an interrupted field of view. In this article, we aim to provide an overview of the latest progress in multi-target tracking. In particular, an attempt to phrase the problem space is made by firstly defining a typical multi-object tracking architecture. We then highlight the areas for potential advancements. These areas include sensor fusion, micro-Doppler feature analysis, specialized and generalized activity recognition, gait, tagging and shape profile. Potential multi-object tracking advancements are reviewed and compared with respect to adaptability, performance, accuracy and specificity. Although the majority of the literature reviewed has a focus on human targets, most of the methodologies can be applied to targets consisting of different profiles and characteristics to that of humans. Lastly, future research directions are also discussed to shed light on research opportunities and potential approaches in the open research areas.

engineering, electrical & electronic,computer science, information systems,physics, applied
Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Yipeng Zhu,Tao Wang,Shiqiang Zhu

DOI: https://doi.org/10.3390/rs14081837

IF: 5

2022-01-01

Remote Sensing

Abstract:Accurate and reliable tracking of multi-pedestrian is of great importance for autonomous driving, human-robot interaction and video surveillance. Since different scenarios have different best-performing sensors, sensor fusion perception plans are believed to have complementary modalities and be capable of handling situations which are challenging for single sensor. In this paper, we propose a novel track-to-track fusion strategy for multi-pedestrian tracking by using a millimeter-wave (MMW) radar and a monocular camera. Pedestrians are firstly tracked by each sensor according to the sensor characteristic. Specifically, the 3D monocular pedestrian detections are obtained by a convolutional neural network (CNN). The trajectory is formed by the tracking-by-detection approach, combined with Bayesian estimation. The measurement noise of the 3D monocular detection is modeled by a detection uncertainty value obtained from the same CNN, as an approach to estimate the pedestrian state more accurately. The MMW radar utilizes the track-before-detection method due to the sparseness of the radar features. Afterwards, the pedestrian trajectories are obtained by the proposed track-to-track fusion strategy, which can work adaptively under challenging weather conditions, low-illumination conditions and clutter scenarios. A group of tests are carried out to validate our pedestrian tracking strategy. Tracking trajectories and optimal sub-pattern assignment (OSPA) metric demonstrate the accuracy and robustness of the proposed multi-sensor multi-pedestrian tracking system.
Multi-target tracking and activity classification with millimeter-wave radar

Khalid Z. Rajab,Bang Wu,Peter Alizadeh,Akram Alomainy

DOI: https://doi.org/10.1063/5.0055641

IF: 4

2021-07-19

Applied Physics Letters

Abstract:The millimeterwave radar has made possible high resolution tracking, activity classification, and vital signs detection, at higher precisions than is possible with most other wireless approaches. However, detecting multiple moving targets is a challenge, as dynamic scene with a lot of motion leads to clutter and noise, which interfere with the responses of targets of interest. We present a digital beamforming approach using the MIMO radar, with a range resolution of 6.4 cm and a Doppler resolution of 0.18 m/s, which reduces interference between closely neighboring targets. Thus, measurements of individual target micro-Doppler signatures are possible, even in the presence of multiple other moving targets, and the signatures are, thereby, used to train a Deep Neural Network (DNN) for activity classification. The DNN has been applied to recognize six exercise-based classes, correctly predicting with over 95% classification accuracy for all classes, but that is extendable to fall detection and other activities.

physics, applied
Multi-Radar Inertial Odometry for 3D State Estimation using mmWave Imaging Radar

Jui-Te Huang,Ruoyang Xu,Akshay Hinduja,Michael Kaess

DOI: https://doi.org/10.48550/arXiv.2311.08608

2024-03-15

Abstract:State estimation is a crucial component for the successful implementation of robotic systems, relying on sensors such as cameras, LiDAR, and IMUs. However, in real-world scenarios, the performance of these sensors is degraded by challenging environments, e.g. adverse weather conditions and low-light scenarios. The emerging 4D imaging radar technology is capable of providing robust perception in adverse conditions. Despite its potential, challenges remain for indoor settings where noisy radar data does not present clear geometric features. Moreover, disparities in radar data resolution and field of view (FOV) can lead to inaccurate measurements. While prior research has explored radar-inertial odometry based on Doppler velocity information, challenges remain for the estimation of 3D motion because of the discrepancy in the FOV and resolution of the radar sensor. In this paper, we address Doppler velocity measurement uncertainties. We present a method to optimize body frame velocity while managing Doppler velocity uncertainty. Based on our observations, we propose a dual imaging radar configuration to mitigate the challenge of discrepancy in radar data. To attain high-precision 3D state estimation, we introduce a strategy that seamlessly integrates radar data with a consumer-grade IMU sensor using fixed-lag smoothing optimization. Finally, we evaluate our approach using real-world 3D motion data.

Robotics
Multiple People Continuous Tracking and Identification Using Millimeter-Wave Radar

Chunyu Wang,Jun Zhang,Yang Liu,Lihua Zhang

DOI: https://doi.org/10.1117/12.2680565

2023-01-01

Abstract:Automatic people tracking and identification have a lot of application prospects in access control, intelligent monitoring, personalized service, etc. Although the primary sensors used now are cameras, they are challenging to cope with low light conditions, adverse weather conditions, and clothing changes. The privacy risks brought by cameras cannot be ignored with people's increasing awareness of privacy. In this paper, we use a commercial millimeter-wave radar to track and identify multiple people indoors. The mmWave radar can "see" objects even in the dark and protects people's private information. We propose PPMM mechanism to solve the problem of tracking multiple people walking at close distances. What's more, we design transformer for mmWave radar pointclouds (TMP) based on transformer architecture. Finally, we evaluate our model and demonstrate the results on our dataset, which involved 6 people. Our method can track up to 3 people simultaneously. We achieve the best identification accuracy of 86.34% overall different numbers of people scenarios, and the accuracy of single, two, and three people scenarios are 87.93%, 87.00%, and 64.98%.
Mmtai: Biometrics-assisted Multi-person Tracking with Mmwave Radar

Yande Chen,Yuan He,Yimiao Sun,Awais Ahmad Siddiqi,Jia Zhang,Xiuzhen Guo

DOI: https://doi.org/10.1109/icpads63350.2024.00014

2024-01-01

Abstract:Wave-based human tracking is a key enabling technology for smart applications. Most of the existing works on this topic employ the conventional approach of device-free object localization, which treat any person as a general moving target rather than distinguish different persons. As a result, the existing approaches have poor performance in the scenarios of multi-person tracking, especially when there are crossovers among different persons’ trajectories. This paper presents mMTAI, a novel approach for multi-person tracking with a mmWave radar. By exploiting mmWave sensing to capture a human’s biometric features, MMTAI augments mmWave radar based human tracking with the ability of identifying different persons. Specifically, MMTAI is able to sense persons’ scalp responses to the signals and their head-shoulder distances, which are then continuously mapped to their trajectories using a bipartite matching algorithm. We implement MMTAI with a commercial mmWave radar and evaluate its performance under various settings. The results show that in the multi-person tracking scenarios, mmTAI has a median tracking error of 12.33 cm, which is $35.88 \%$ lower than that of the state-of-the-art approach.
A Survey of Mmwave Radar-Based Sensing in Autonomous Vehicles, Smart Homes and Industry

Hao Kong,Cheng Huang,Jiadi Yu,Xuemin Shen

DOI: https://doi.org/10.1109/comst.2024.3409556

IF: 35.6

2024-01-01

IEEE Communications Surveys & Tutorials

Abstract:Sensing technology plays a crucial role in bridging the physical and digital worlds. By transforming a multitude of physical phenomena into digital data, it significantly enhances our understanding of the environment and is instrumental in a wide range of applications. Given the wide bandwidth and short wavelength characteristics, millimeter wave (mmWave) radar sensing is considered one of the most promising sensing techniques beyond mmWave communication. In this paper, we provide a comprehensive survey of mmWave radar-based sensing techniques and applications in autonomous vehicles, smart homes, and industry. Specifically, we first review widely exploited mmWave radar techniques and signal processing techniques from the perspective of dedicated radars and communication integration, which are the basis of mmWave radar sensing. Then, we introduce mainstream machine learning techniques, especially the latest deep learning techniques for designing applications with mmWave signals. Related hardware devices, available public datasets, and evaluation metrics are also presented. Afterward, we provide a taxonomy of emerging mmWave radar sensing applications, and review the developments in object detection, ego-motion estimation, simultaneous localization and mapping, activity recognition, pose estimation, gesture recognition, speech recognition, vital sign monitoring, user authentication, indoor positioning, industrial imaging, industrial measurement, environmental monitoring, etc. We conclude the paper by discussing challenges and potential future research directions.
Research of Target Detection and Classification Techniques Using Millimeter-Wave Radar and Vision Sensors

Zhangjing Wang,Xianhan Miao,Zhen Huang,Haoran Luo

DOI: https://doi.org/10.3390/rs13061064

IF: 5

2021-03-11

Remote Sensing

Abstract:The development of autonomous vehicles and unmanned aerial vehicles has led to a current research focus on improving the environmental perception of automation equipment. The unmanned platform detects its surroundings and then makes a decision based on environmental information. The major challenge of environmental perception is to detect and classify objects precisely; thus, it is necessary to perform fusion of different heterogeneous data to achieve complementary advantages. In this paper, a robust object detection and classification algorithm based on millimeter-wave (MMW) radar and camera fusion is proposed. The corresponding regions of interest (ROIs) are accurately calculated from the approximate position of the target detected by radar and cameras. A joint classification network is used to extract micro-Doppler features from the time-frequency spectrum and texture features from images in the ROIs. A fusion dataset between radar and camera is established using a fusion data acquisition platform and includes intersections, highways, roads, and playgrounds in schools during the day and at night. The traditional radar signal algorithm, the Faster R-CNN model and our proposed fusion network model, called RCF-Faster R-CNN, are evaluated in this dataset. The experimental results indicate that the mAP(mean Average Precision) of our network is up to 89.42% more accurate than the traditional radar signal algorithm and up to 32.76% higher than Faster R-CNN, especially in the environment of low light and strong electromagnetic clutter.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Continuous Tracking of Indoor Human Targets Based on Millimeter Wave Radar

Haolan Luo,Shisheng Guo,G. Cui,Meiqiu Jiang

DOI: https://doi.org/10.23919/APSIPAASC55919.2022.9979904

2022-11-07

Abstract:The effect of target tracking based on millime-ter wave radar is susceptible to multi path effect and target crossover. Most existing methods are unsatisfactory in high-noise, complex environments. In contrast, we propose a method covering target positioning, tracking, and track re-association by using top-mounted millimeter-wave radar, achieving stable and accurate counting and tracking of multiple targets. First, a polar-coordinate- based tracking is performed using an extended Kalman filter with linear regression correction. Then, a density-based classification algorithm with group signal-to-noise ratio analysis is performed to remove ghost targets. In terms of the track fracture problem caused by the target intersection, we propose to use the Hankel matrix to solve this situation. Our experiments prove the robustness of the proposed method, which not only has a high tracking precision within O.lm but also successfully handles most target crossover situations considered. At the same time, in the cases within six people, the ratio between the number of frames in which personnel counting error is less than or equal to 1 and the total number of frames is more than 95%.

Physics,Engineering
Noninvasive Human Activity Recognition Using Millimeter-Wave Radar

Chengxi Yu,Zhezhuang Xu,Kun Yan,Ying-Ren Chien,Shih-Hau Fang,Hsiao-Chun Wu

DOI: https://doi.org/10.1109/jsyst.2022.3140546

IF: 4.802

2022-01-01

IEEE Systems Journal

Abstract:The millimeter-wave (mmWave) radar technology has attracted significant attention because it is susceptible to environmental lighting, wall shielding, and privacy concern. This article proposes a novel noninvasive human activity recognition system using a mmWave radar. The proposed framework first transforms mmWave signals into point clouds. Generally speaking, it consists of four major components: denosing, enhanced voxelization, data augmentation, and dual-view machine learning to lead to accurate and efficient human activity recognition. The proposed new methodology considers the spatialtemporal point clouds in physical environments through a modified voxelization approach, enriches the sparse data based on the symmetry property of radar rotations, and learns the activity using a dual-view convolutional neural network. To evaluate the performance of the proposed learning models, a dataset involving seven different activities has been established using a mmWave radar platform. The experimental results have demonstrated that the proposed system can achieve 97.61 and 98 accuracies during the tests of fall detection and activity classification, respectively. In comparison, the proposed scheme greatly outperforms four other conventional machine learning schemes in terms of the overall accuracy.

computer science, information systems,telecommunications,engineering, electrical & electronic,operations research & management science
Environment-aware Multi-person Tracking in Indoor Environments with MmWave Radars

Weiyan Chen,Hongliu Yang,Xiaoyang Bi,Rong Zheng,Fusang Zhang,Peng Bao,Zhaoxin Chang,Xujun Ma,Daqing Zhang

DOI: https://doi.org/10.1145/3610902

2023-09-28

Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies

Abstract:Device-free indoor localization and tracking using commercial millimeter wave radars have attracted much interest lately due to their non-intrusive nature and high spatial resolution. However, it is challenging to achieve high tracking accuracy due to rich multipath reflection and occlusion in indoor environments. Static objects with non-negligible reflectance of mmWave signals interact with moving human subjects and generate time-varying multipath ghosts and shadow ghosts, which can be easily confused as real subjects. To characterize the complex interactions, we first develop a geometric model that estimates the location of multipath ghosts given the locations of humans and static reflectors. Based on this model, the locations of static reflectors that form a reflection map are automatically estimated from received radar signals as a single person traverses the environment along arbitrary trajectories. The reflection map allows for the elimination of multipath and shadow ghost interference as well as the augmentation of weakly reflected human subjects in occluded areas. The proposed environment-aware multi-person tracking system can generate reflection maps with a mean error of 15.5cm and a 90-percentile error of 30.3cm, and achieve multi-person tracking accuracy with a mean error of 8.6cm and a 90-percentile error of 17.5cm, in four representative indoor spaces with diverse subjects using a single mmWave radar.
Real-time People Tracking and Identification from Sparse mm-Wave Radar Point-clouds

Jacopo Pegoraro,Michele Rossi

DOI: https://doi.org/10.48550/arXiv.2105.11368

IF: 4.729

2021-05-24

Signal Processing

Abstract:Mm-wave radars have recently gathered significant attention as a means to track human movement and identify subjects from their gait characteristics. A widely adopted method to perform the identification is the extraction of the micro-Doppler signature of the targets, which is computationally demanding in case of co-existing multiple targets within the monitored physical space. Such computational complexity is the main problem of state-of-the-art approaches, and makes them inapt for real-time use. In this work, we present an end-to-end, low-complexity but highly accurate method to track and identify multiple subjects in real-time using the sparse point-cloud sequences obtained from a low-cost mm-wave radar. Our proposed system features an extended object tracking Kalman filter, used to estimate the position, shape and extension of the subjects, which is integrated with a novel deep learning classifier, specifically tailored for effective feature extraction and fast inference on radar point-clouds. The proposed method is thoroughly evaluated on an edge-computing platform from NVIDIA (Jetson series), obtaining greatly reduced execution times (reduced complexity) against the best approaches from the literature. Specifically, it achieves accuracies as high as 91.62%, operating at 15 frames per seconds, in identifying three subjects that concurrently and freely move in an unseen indoor environment, among a group of eight.
mmSignature: Semi-supervised human identification system based on millimeter wave radar

Yicheng Yao,Hao Zhang,Pan Xia,Changyu Liu,Fanglin Geng,Zhongrui Bai,Lidong Du,Xianxiang Chen,Peng Wang,Baoshi Han,Ting Yang,Zhen Fang

DOI: https://doi.org/10.1016/j.engappai.2023.106939

IF: 8

2023-08-15

Engineering Applications of Artificial Intelligence

Abstract:Human identification is vital in health monitoring, human-computer interaction, safety detection, and other fields. Compared with traditional vision-based methods, millimeter wave radar sensors can protect users' privacy and work in dark environments, which has a wide range of application prospects in iot fields such as smart homes and smart medical care. Previous studies need to manually collect labeled data, which makes the data collection work need substantial human resources and is unsuitable for popularization and application. We automatically collect multi-modal radar signals in users ' daily lives without requiring researchers to label data manually. Based on the proposed data collection method, we established the first semi-supervised data set for human identification, which includes synchronous radar point cloud data and range-velocity map data. The dataset contains four experiments, including ten monitoring users and ten other users. We propose a semi-supervised co-training framework based on multi-modal data fusion for human identification. The framework guides the models to learn from unlabeled data using the complementary characteristics of point cloud data and range-velocity map data. In addition, we propose an information fusion method to fuse the radar data of two modes to further improve the model's performance. The experimental results show that the proposed method achieves 93.7% human identification accuracy, showing radar-based human identification technology's application and promotion potential.

automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
A millimeter wave radar target tracking method based on inter-frame fusion algorithm

Hang Lv,Yihui Li,Jinfeng Xiao,Zhicheng Bi

DOI: https://doi.org/10.1117/12.2660802

2023-02-02

Abstract:Millimeter-wave radar has become one of the mainstream sensors applied in the field of target tracking research because of its high accuracy, low cost, and non-intrusive nature. Millimeter-wave radar can solve the user's concern about privacy leakage. In this paper, a millimeter wave radar target tracking and recognition method based on an interframe fusion algorithm is proposed. The fusion algorithm is the combination of the DBSCAN algorithm and GMM algorithm. The method first combines multi-frame point cloud data and then compares the fusion algorithm with the DBSCAN algorithm. The multi-frame merging method with frame sequence features solves the problem of sparse radar point cloud data. The fusion algorithm not only solves the problem of noise and target recognition confusion but also solves the problem of DBSCAN identifying multiple clusters into one cluster in an indoor multi-target scene. The result shows that the fusion algorithm improves the recognition accuracy of target tracking compared with the original algorithm and can be applied to the indoor multi-target tracking and recognition scene.

Computer Science,Engineering
Machine Learning Based Object Classification and Identification Scheme Using an Embedded Millimeter-Wave Radar Sensor

Homa Arab,Iman Ghaffari,Lydia Chioukh,Serioja Tatu,Steven Dufour

DOI: https://doi.org/10.3390/s21134291

IF: 3.9

2021-06-23

Sensors

Abstract:A target’s movements and radar cross sections are the key parameters to consider when designing a radar sensor for a given application. This paper shows the feasibility and effectiveness of using 24 GHz radar built-in low-noise microwave amplifiers for detecting an object. For this purpose a supervised machine learning model (SVM) is trained using the recorded data to classify the targets based on their cross sections into four categories. The trained classifiers were used to classify the objects with varying distances from the receiver. The SVM classification is also compared with three methods based on binary classification: a one-against-all classification, a one-against-one classification, and a directed acyclic graph SVM. The level of accuracy is approximately 96.6%, and an F1-score of 96.5% is achieved using the one-against-one SVM method with an RFB kernel. The proposed contactless radar in combination with an SVM algorithm can be used to detect and categorize a target in real time without a signal processing toolbox.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
mmWave-YOLO: A mmWave Imaging Radar-Based Real-Time Multiclass Object Recognition System for ADAS Applications

Atsutake Kosuge,Satoshi Suehiro,Mototsugu Hamada,Tadahiro Kuroda

DOI: https://doi.org/10.1109/tim.2022.3176014

IF: 5.6

2022-05-27

IEEE Transactions on Instrumentation and Measurement

Abstract:This article presents a millimeter wave (mmWave) imaging radar-based real-time multiclass object recognition system for advanced driver-assistance system (ADAS) applications related to construction machinery. While mmWave radar has the advantage of being able to detect signals even in the optically harsh, dark, and dusty environments in which construction machinery is often used, the radar has two orders of magnitude lower resolution than cameras. Since the distance from the radar increases, object features vary, resulting in making it difficult to classify and detect the location of multiple objects. To address this issue, an mmWave-you only look once (YOLO) architecture is proposed that enables highly accurate object classification and location recognition by applying different detectors to each distance data. To provide precise labels for the radar data semiautomatically, a camera-radar cooperative data annotator is also developed. Using the radar only, a real-time (46.6 ms) object classification and location detection of six class objects is achieved. The accuracy of our system is 84% [mean average precision (mAP)], which is slightly higher than that of the red, blue, green (RGB)-camera-based system (78%). In addition, since the radar can acquire similar data of target objects against any background, mmWave-YOLO can detect objects in a variety of scenes with only a small variation of the training dataset, resulting in a lower training cost. Experiments confirmed that it can detect objects in outdoor scenes even when it is trained only with indoor scene data.

engineering, electrical & electronic,instruments & instrumentation

Statistical methods for assessing agreement.

Radar2: Passive Spy Radar Detection and Localization Using COTS Mmwave Radar

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Radar Style Transfer for Metric Robot Localisation on Lidar Maps

Multi-Object Tracking with mmWave Radar: A Review

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Multi-target tracking and activity classification with millimeter-wave radar

Multi-Radar Inertial Odometry for 3D State Estimation using mmWave Imaging Radar

Multiple People Continuous Tracking and Identification Using Millimeter-Wave Radar

Mmtai: Biometrics-assisted Multi-person Tracking with Mmwave Radar

A Survey of Mmwave Radar-Based Sensing in Autonomous Vehicles, Smart Homes and Industry

Research of Target Detection and Classification Techniques Using Millimeter-Wave Radar and Vision Sensors

Continuous Tracking of Indoor Human Targets Based on Millimeter Wave Radar

Noninvasive Human Activity Recognition Using Millimeter-Wave Radar

Environment-aware Multi-person Tracking in Indoor Environments with MmWave Radars

Real-time People Tracking and Identification from Sparse mm-Wave Radar Point-clouds

mmSignature: Semi-supervised human identification system based on millimeter wave radar

A millimeter wave radar target tracking method based on inter-frame fusion algorithm

Machine Learning Based Object Classification and Identification Scheme Using an Embedded Millimeter-Wave Radar Sensor

mmWave-YOLO: A mmWave Imaging Radar-Based Real-Time Multiclass Object Recognition System for ADAS Applications