Abstract:The commercial availability of low-cost millimeter-wave (mmWave) communication and radar devices is starting to improve the adoption of such technologies in consumer markets, paving the way for large-scale and dense deployments in fifth-generation (5G)-and-beyond as well as 6G networks. At the same time, pervasive mmWave access will enable device localization and device-free sensing with unprecedented accuracy, especially with respect to sub-6 GHz commercial-grade devices. This paper surveys the state of the art in device-based localization and device-free sensing using mmWave communication and radar devices, with a focus on indoor deployments. We overview key concepts about mmWave signal propagation and system design, detailing approaches, algorithms and applications for mmWave localization and sensing. Several dimensions are considered, including the main objectives, techniques, and performance of each work, whether they reached an implementation stage, and which hardware platforms or software tools were used. We analyze theoretical (including signal processing and machine learning), technological, and implementation (hardware and prototyping) aspects, exposing under-performing or missing techniques and items towards enabling a highly effective sensing of human parameters, such as position, movement, activity and vital signs. Among many interesting findings, we observe that device-based localization systems would greatly benefit from commercial-grade hardware that exposes channel state information, as well as from a better integration between standard-compliant mmWave initial access and localization algorithms, especially with multiple access points (APs). Moreover, more advanced algorithms requiring zero-initial knowledge of the environment would greatly help improve the adoption of mmWave simultaneous localization and mapping (SLAM). Machine learning (ML)-based algorithms are gaining momentum, but still require the collection of extensive train- ng datasets, and do not yet generalize to any indoor environment, limiting their applicability. Device-free (i.e., radar-based) sensing systems still have to be improved in terms of higher accuracy in the detection of vital signs (respiration and heart rate), and enhanced robustness/generalization capabilities across different environments. Moreover, improved support is needed for the tracking of multiple users, and for the automatic creation of radar networks to enable large-scale sensing applications. Finally, integrated systems performing joint communications and sensing are still in their infancy: theoretical and practical advancements are required to add sensing functionalities to mmWave-based channel access protocols based on orthogonal frequency-division multiplexing (OFDM) and multi-antenna technologies.

A Survey of mmWave-based Human Sensing: Technology, Platform and Applications

A Survey of Mmwave-Based Human Sensing: Technology, Platforms and Applications

A Survey of Mmwave Radar-Based Sensing in Autonomous Vehicles, Smart Homes and Industry

A Survey on Wireless Device-free Human Sensing: Application Scenarios, Current Solutions, and Open Issues

Human Activity Sensing with Wireless Signals: A Survey

Recent Progress in Sensing and Computing Techniques for Human Activity Recognition and Motion Analysis

A Review of Millimeter Wave Device-Based Localization and Device-Free Sensing Technologies and Applications

Sensing of Life Activities at the Human-Microwave Frontier

Acoustic-based sensing and applications: A survey

A Survey on Wi-Fi Based Contactless Activity Recognition

A Survey of Millimeter-Wave Communication: Physical-Layer Technology Specifications and Enabling Transmission Technologies

WISe: Wireless Intelligent Sensing for Human-Centric Applications

The State-of-the-Art Sensing Techniques in Human Activity Recognition: A Survey

Mobile Crowd Sensing of Human-Like Intelligence Using Social Sensors: A Survey.

A Review of Indoor Millimeter Wave Device-based Localization and Device-free Sensing Technologies and Applications

Recent Advances in mmWave-Radar-Based Sensing, Its Applications, and Machine Learning Techniques: A Review

Vital Sign and Sleep Monitoring Using Millimeter Wave

From Single-Point to Multi-Point Reflection Modeling: Robust Vital Signs Monitoring Via Mmwave Sensing

Mobility Support for Millimeter Wave Communications: Opportunities and Challenges

MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensing

Device-Free WiFi Human Sensing: from Pattern-Based to Model-Based Approaches