Footstep Localization By Acoustic Signals

B. Vanrumste,B. V. D. Broeck,P. Karsmakers,Gert Dekkers,L. Vuegen,H. V. hamme,M. Moonen

2013-12-06

Abstract:This contribution describes a system able to detect footstep locations. through acoustic information retrieved from a wireless sensor network with small and cheap microphone arrays. Results of this system show that a best median errors of 31cm is achievable.

Computer Science,Engineering

What problem does this paper attempt to address?

Acoustic Based Footstep Detection in Pervasive Healthcare

Summoogum K,Das D,Dasgupta S,McLoughlin I,Efstratiou C,Palaniappan R

DOI: https://doi.org/10.1109/EMBC46164.2021.9630125

Abstract:Passive detection of footsteps in domestic settings can allow the development of assistive technologies that can monitor mobility patterns of older adults in their home environment. Acoustic footstep detection is a promising approach for non-intrusive detection of footsteps. So far there has been limited work in developing robust acoustic footstep detection systems that can operate in noisy home environments. In this paper, we propose a novel application of the Attention based Recurrent Deep Neural Network to detect human footsteps in noisy overlapping audio streams. The model is trained on synthetic data which simulates the acoustic scene in a home environment. To evaluate performance, we reproduced two footstep detection models from literature and compared them using the newly developed Polyphonic Sound Detection Scores (PSDS). Our model achieved the highest PSDS and is close to the highest score achieved by generic indoor AED models in DCASE. The proposed system is designed to both detect and track footsteps within a home setting, and to enhance state-of-the-art digital health-care solutions for empowering older adults to live autonomously in their own homes.
Footstep Signal Extraction Algorithm Based on Wavelet Packet Decomposition and Local Discriminant Bases

Liu Haitao,L. Baoqing,Z. Xueyuan,Cao Hongbing

Abstract:This paper mainly focuses on how to extract out typical footstep signal in a noisy environment such like cities.After analyze the characters of frequency spectrum distribution of footstep and background noise,a novel footstep extraction algorithm based on seismic sensor arrays is proposed.In this algorithm,Wavelet Packet Decomposition(WPD) and Local Discriminant Bases(LDB) is utilized to acquire the best frequency band of the footstep signal,and extract it from background noise.The simulation results show that this algorithm has a distinct improvement in footstep detecting and classification.

Computer Science,Engineering,Environmental Science
FootStep-tracker

Chang Liu,Lei Xie,Chuyu Wang,Jie Wu,Sanglu Lu

DOI: https://doi.org/10.1145/2800835.2800844

2015-01-01

Abstract:Recently, indoor localization has been a key supporting technology for most ubiquitous applications. However, most localization schemes require the deployment of the anchor nodes in advance to assist indoor localization. In this demo, we develop FootStep-Tracker, an indoor localization system via sensing the user's footsteps, without any support infrastructures. By embedding tiny Sensor-Tag into the user's shoes, FootStep-Tracker is able to accurately perceive the user's moving trace, including the moving direction and distance. Moreover, by detecting the user's activities such as going upstairs/downstairs and taking an elevator, FootStep-Tracker can correlate with the specified positions such as stairs and elevators, and determine the exacted moving traces in the indoor map.
Rapid: A Multimodal and Device-free Approach Using Noise Estimation for Robust Person Identification

Yuanying Chen,Wei Dong,Yi Gao,Xue Liu,Tao Gu

DOI: https://doi.org/10.1145/3130906

2017-01-01

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Abstract:Device-free human sensing is a key technology to support many applications such as indoor navigation and activity recognition. By exploiting WiFi signals reflected by human body, there have been many WiFi-based device-free human sensing applications. Among these applications, person identification is a fundamental technology to enable user-specific services. In this paper, we present Rapid, a system that can perform robust person identification in a device-free and low-cost manner, using fine-grained channel information (i.e., CSI) of WiFi and acoustic information from footstep sound. In order to achieve high accuracy in real-life scenarios with both system and environment noise, we perform noise estimation and include two different confidence values to quantify the impact of noise to both CSI and acoustic measurements. Based on an accurate gait analysis, we then adaptively fuse CSI and acoustic measurements to achieve robust person identification. We implement low-cost Rapid nodes and evaluate our system using experiments at multiple locations with a total of 1800 gait instances from 20 volunteers, and the results show that Rapid identifies a subject with an average accuracy of 92% to 82% from a group of 2 to 6 subjects, respectively.
New algorithm for footstep localization using seismic sensors in an indoor environment

R. Bahroun,O. Michel,F. Frassati,M. Carmona,J. L. Lacoume

DOI: https://doi.org/10.48550/arXiv.1211.3233

2013-10-08

Abstract:In this study, we consider the use of seismic sensors for footstep localization in indoor environments. A popular strategy of localization is to use the measured differences in arrival times of source signals at multiple pairs of receivers. In the literature, most algorithms that are based on time differences of arrival (TDOA) assume that the propagation velocity is a constant as a function of the source position, which is valid for air propagation or even for narrow band signals. However a bounded medium such as a concrete slab (encountered in indoor environement) is usually dispersive and damped. In this study, we demonstrate that under such conditions, the concrete slab can be assimilated to a thin plate; considering a Kelvin-Voigt damping model, we introduce the notion of {\em perceived propagation velocity}, which decreases when the source-sensor distance increases. This peculiar behaviour precludes any possibility to rely on existing localization methods in indoor environment. Therefore, a new localization algorithm that is adapted to a damped and dispersive medium is proposed, using only on the sign of the measured TDOA (SO-TDOA). A simulation and some experimental results are included, to define the performance of this SO-TDOA algorithm.

Computational Engineering, Finance, and Science
FootStep-tracker: an anchor-free indoor localization system via sensing foot steps.

Chang Liu,Lei Xie,Chuyu Wang,Jie Wu,Sanglu Lu

DOI: https://doi.org/10.1145/2800835.2800844

2015-01-01

Abstract:Recently, indoor localization has been a key supporting technology for most ubiquitous applications. However, most localization schemes require the deployment of the anchor nodes in advance to assist indoor localization. In this demo, we develop FootStep-Tracker, an indoor localization system via sensing the user's footsteps, without any support infrastructures. By embedding tiny Sensor-Tag into the user's shoes, FootStep-Tracker is able to accurately perceive the user's moving trace, including the moving direction and distance. Moreover, by detecting the user's activities such as going upstairs/downstairs and taking an elevator, FootStep-Tracker can correlate with the specified positions such as stairs and elevators, and determine the exacted moving traces in the indoor map.
Footstep Detection using Dempster-Shafer Theory

Selestine Melchane,Achour Achroufene,Fahem Ameziane

DOI: https://doi.org/10.1109/ICEEAC61226.2024.10576585

2024-05-12

Abstract:Pedestrian localization remains a hot topic in confined environments, where satellite signals are often weakened by obstacles and radio frequency technologies are limited due to distance and coverage area constraints. An interesting alternative is to use a localization system based on inertial sensor technology, which can locate a pedestrian by detecting steps and estimating their length and walking angle. This paper proposes a new approach to step detection by combining inertial sensor data using the Dempster-Shafer theory. This approach makes it possible to represent and consider the imperfections in inertial data from accelerometers and gyroscopes and fuse them for decision-making on the validity of the detected step. The results obtained from the experimental evaluation show that the proposed approach performs well in terms of the number of detected steps and outperforms some methods proposed in the literature for step detection.

Engineering,Computer Science
A passive energy-based method for footstep impact localization, using an underfloor accelerometer sensor network with Kalman filtering

Sa’ed Alajlouni,Pablo Tarazaga

DOI: https://doi.org/10.1177/1077546319890520

IF: 2.633

2020-01-21

Journal of Vibration and Control

Abstract:An underfloor accelerometer sensor network can be used to track occupants in an indoor environment using measurements of floor vibration induced by occupant footsteps. To achieve occupant tracking, each footstep impact location must first be estimated. This paper proposes a new energy-based algorithm for footstep impact localization. Compared to existing energy-based algorithms, the new algorithm achieves higher localization accuracy and removes a previously required calibration step (removal of the need to estimate floor-dependent parameters). Furthermore, the algorithm uses a much smaller data sampling rate compared to time of flight/arrival localization methods, which greatly reduces data and data-processing time. The new algorithm is a two-step location estimator: the first step is a coarse location estimate, with the second step as a fine location search through a nonlinear minimization problem. The performance of the proposed algorithm is evaluated using a single occupant walking experiment on an instrumented floor inside an operational smart building. This paper also demonstrates that higher localization accuracy is obtained using an additional Kalman filtering scheme.

engineering, mechanical,mechanics,acoustics
Localisation de personnes dans les bâtiments par ondes sismiques. (Footstep localisation using seismic waves in an indoor environment.)

Rim Bahroun

Abstract:For many applications, it is important to obtain location information about a resident in an indoor environment. The vibration signature of the human footstep on a oor creates an elastic wave that is induced by the walking motions. Our goal in this study is to localize footsteps using seismic sensors that are xed on the oor in the indoor environment. Firstly, we studied the existing techniques of seismic source localization. The complexity of the elastic waves propagation in a building led to exclude these techniques. Then, we established a theoretical and experimental study of seismic wave propagation in a concrete slab. It appears that the only reliable information in such an environment is the conservation of the order of arrival of signals to the sensors. So, we deduced an algorithm of footstep localization based on the signs of time di erences of signals arrival. This approach has been the subject of many numerical and experimental validations. In the end, an extension of this approach was developed to allow dynamic localization of a person with an accuracy of the order of some tens of centimeters.

Computer Science,Engineering,Environmental Science
Footstep localization using seismic sensors in an indoor environment : SO-TDOA algorithm

J. Lacoume,O. Michel,R. Bahroun,F. Frassati,M. Carmona

2012-11-14

Abstract:In this study, we consider the use of seismic sensors for footstep localization in indoor environments. A popular strategy of localization is to use the measured differences in arrival times of source signals at multiple pairs of receivers. In the literature, most algorithms that are based on time differences of arrival (TDOA) assume that the propagation velocity is a constant as a function of the source position, which is valid for air propagation. However, a bounded medium, such as a concrete slab, is usually dispersive and damped. This study demonstrates that under such conditions, assimilating the concrete slab to a thin plate and considering a Kelvin-Voigt damping model, the perceived propagation velocity decreases when the source-sensor distance increases. Based on the sign of the measured TDOA (SO-TDOA), a new localization algorithm that is adapted to a damped and dispersive medium is proposed here. A simulation and some experimental results are included, to define the performance of this SO-TDOA algorithm.

Environmental Science,Engineering,Computer Science
Footstep recognition as people identification: A Systematic literature review

Arif Rachmat

2024-11-08

Abstract:Footstep recognition is a relatively new biometric which aims to discriminate people using walking characteristics. There are several feature and technology have been adopted in various research. This study will attempt to show a comparative technology and feature which is offered each previous related works. We performed a broad manually search to find SLRs published in the time period 1st January 2006 to 30th November 2018. Our broad search found 12 SLRs articles refer to 3 similar technology and 5 cluster feature. In over time, the number of published footstep recognition has increased, especially in conference publications. The differences in footsteps can be known from the power spectral density of sounds and vibrations generated by footsteps. Every footstep of the human has a certain density of frequency, either from density of sounds or vibrations generated. To improve accurately of the result, this paper suggests furthermore research to combining several measuring sensor and data processing method

Human-Computer Interaction
Track Your Foot Step: Anchor-Free Indoor Localization Based on Sensing Users' Foot Steps

Chang Liu,Lei Xie,Chuyu Wang,Jie Wu,Sanglu Lu

DOI: https://doi.org/10.1109/MASS.2016.034

2016-01-01

Abstract:Currently, conventional indoor localization schemes mainly leverage WiFi-based or Bluetooth-based schemes to locate the users in the indoor environment. These schemes require to deploy the infrastructures such as the WiFi APs and Bluetooth beacons in advance to assist indoor localization. This property hinders the indoor localization schemes in that they are not scalable to any other situations without these infrastructures. In this paper, we propose FootStep-Tracker, an anchor-free indoor localization scheme purely based on sensing the user's footsteps. By embedding the tiny SensorTag into the user's shoes, FootStep-Tracker is able to accurately perceive the user's moving trace, including the moving direction and distance, by leveraging the accelerometers and gyroscopes. Furthermore, by detecting the user's activities such as ascending/descending the stairs and taking an elevator, FootStep-Tracker can effectively correlate with the specified positions such as stairs and elevators, and further determine the exacted moving traces in the indoor map by leveraging the space constraints in the map. Realistic experiment results show that, FootStep-Tracker is able to achieve an average localization accuracy of 1m for indoor localization, without any infrastructures having been deployed in advance.
Indoor Multi-Person Detection and Recognition Through Footsteps: A Deep Learning Approach with Acoustic Signal Analysis

Yuanying Qu,Liming Shi,Xinheng Wang,Zhi Wang

DOI: https://doi.org/10.1109/jsen.2024.3394212

IF: 4.3

2024-01-01

IEEE Sensors Journal

Abstract:In the era of intelligent environments, detecting and recognising multi-person is crucial across various applications like smart homes, security surveillance, and human-computer interaction. This paper introduces a novel methodology integrating acoustic signal processing with deep learning to identify and detect multi-persons based on indoor footsteps. Anchored in a simulated family setting of three individuals, the research establishes a comprehensive audio repository, demonstrating the efficacy of the proposed approach. Presently, the study focuses on family recognition and activity detection, which can be applied to prevent unauthorised intrusions and facilitate the issuance of intelligent commands based on identified activities, thereby enhancing the convenience of daily life. Furthermore, the paper outlines prospective avenues for refining and expanding this pioneering methodology, opening new vistas for future research endeavours in this domain.
Wireless Sensor Network Acoustic Source Localization System Based on Telos B

Shu BAO,Xiang-yu LI,Jian-tao YANG

DOI: https://doi.org/10.19304/j.cnki.issn1000-7180.2015.08.019

2015-01-01

Abstract:A wireless sensor network acoustic source localization system based on TelosB is designed in this article . This system consists of a control node ,information collection nodes and a base station .Abnormal sampling lead by wake‐up delay of the information collection nodes was resolved as well as the data block of the serial port .In localization algorithm , the time delay estimation localization algorithm based on the classical generalized cross correlation function was adopted .At the same time ,in order to eliminate the effects brought by the non -ideal characteristics such as device mismatch and synchronization related noise among different nodes ,we pre-filtered the signal and the generalized cross correlation function .It is demonstrated in experiments that the sound localization can realize acoustic source localization in indoor environment .For a positioning area of 9 m2 ,absolute error of over 70% localization results are less than 30 cm .
Low-Cost Distributed Acoustic Sensor Network for Real-Time Urban Sound Monitoring

Ester Vidaña-Vila,Joan Navarro,Cristina Borda-Fortuny,Dan Stowell,Rosa Ma Alsina-Pagès

DOI: https://doi.org/10.3390/electronics9122119

IF: 2.9

2020-12-11

Electronics

Abstract:Continuous exposure to urban noise has been found to be one of the major threats to citizens’ health. In this regard, several organizations are devoting huge efforts to designing new in-field systems to identify the acoustic sources of these threats to protect those citizens at risk. Typically, these prototype systems are composed of expensive components that limit their large-scale deployment and thus reduce the scope of their measurements. This paper aims to present a highly scalable low-cost distributed infrastructure that features a ubiquitous acoustic sensor network to monitor urban sounds. It takes advantage of (1) low-cost microphones deployed in a redundant topology to improve their individual performance when identifying the sound source, (2) a deep-learning algorithm for sound recognition, (3) a distributed data-processing middleware to reach consensus on the sound identification, and (4) a custom planar antenna with an almost isotropic radiation pattern for the proper node communication. This enables practitioners to acoustically populate urban spaces and provide a reliable view of noises occurring in real time. The city of Barcelona (Spain) and the UrbanSound8K dataset have been selected to analytically validate the proposed approach. Results obtained in laboratory tests endorse the feasibility of this proposal.

engineering, electrical & electronic,computer science, information systems,physics, applied
Indoor Multiperson Detection and Recognition Through Footsteps: A Deep Learning Approach With Acoustic Signal Analysis

Yuanying Qu,Liming Shi,Xinheng Wang,Zhi Wang

DOI: https://doi.org/10.1109/jsen.2024.3394212

IF: 4.3

2024-06-19

IEEE Sensors Journal

Abstract:In the era of intelligent environments, detecting and recognizing multiperson is crucial across various applications such as smart homes, security surveillance, and human-computer interaction. This article introduces a novel methodology integrating acoustic signal processing with deep learning to identify and detect multipersons based on indoor footsteps. Anchored in a simulated family setting of three individuals, the research establishes a comprehensive audio repository, demonstrating the efficacy of the proposed approach. Presently, the study focuses on family recognition and activity detection, which can be applied to prevent unauthorized intrusions and facilitate the issuance of intelligent commands based on identified activities, thereby enhancing the convenience of daily life. Furthermore, this article outlines prospective avenues for refining and expanding this pioneering methodology, opening new vistas for future research endeavors in this domain.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Large scale indoor occupant tracking using distributed acoustic sensing and machine learning

Yuhan Zhou,Justin K.W. Yeoh,Yunyue Elita Li,Wawan Solihin

DOI: https://doi.org/10.1016/j.buildenv.2023.111005

IF: 7.093

2023-11-04

Building and Environment

Abstract:The recent COVID-19 pandemic has brought attention to the criticality of implementing measures to prevent viral transmission and reduce the risk of infection. It is necessary to identify crowd-gathering hazards and implement appropriate engineering control measures. Consequently, obtaining comprehensive footfall information at a large scale becomes significant. Vibration-based sensors are currently the preferred choice for footfall detection, with geophones being the commonly utilized sensors known for their effective performance. However, the deployment of geophones in large-scale scenarios presents challenges due to the substantial amount of manual labor involved. To address these limitations, the Distributed Acoustic Sensing (DAS) system, a non-intrusive sensor, is introduced as an alternative solution. While DAS has been successfully applied in various long-distance scenarios, such as pipeline surveillance and real-time train tracking, its effectiveness in footfall detection requires further evaluation. Therefore, this study proposes a machine learning method to achieve footstep recognition using DAS, considering the inherent time dependency and spatial continuity present in footfall trajectories. To further evaluate the effectiveness of DAS, geophones are selected as the benchmark sensors. The evaluation process encompasses footstep recognition and additional data implementation. The results demonstrate that the proposed recognition method achieves high accuracy for both sensors, thereby establishing DAS as a more applicable solution for footfall detection compared to geophones. In conclusion, DAS offers the advantage of flexible space resolution settings and adaptable deployment options, rendering it suitable for applications in diverse scenarios. Its capabilities make it suitable for large-scale occupancy monitoring scenarios.

engineering, environmental,construction & building technology, civil
Room-Scale Location Trace Tracking via Continuous Acoustic Waves

Jie Lian,Xu Yuan,Jiadong Lou,Li Chen,Hao Wang,Nianfeng Tzeng

DOI: https://doi.org/10.1145/3649136

2024-02-20

ACM Transactions on Sensor Networks

Abstract:The increasing prevalence of smart devices spurs the development of emerging indoor localization technologies for supporting diverse personalized applications at home. Given marked drawbacks of popular chirp signal-based approaches, we aim to develop a novel device-free localization system via the continuous wave of the inaudible frequency. To achieve this goal, solutions are developed for fine-grained analyses, able to precisely locate moving human traces in the room-scale environment. In particular, a smart speaker is controlled to emit continuous waves at inaudible 20 kHz , with a co-located microphone array to record their Doppler reflections for localization. We first develop solutions to remove potential noises and then propose a novel idea by slicing signals into a set of narrowband signals, each of which is likely to include at most one body segment’s reflection. Different from previous studies, which take original signals themselves as the baseband, our solutions employ the Doppler frequency of a narrowband signal to estimate the velocity first and apply it to get the accurate baseband frequency, which permits a precise phase measurement after I-Q (i.e., in-phase and quadrature) decomposition. A signal model is then developed, able to formulate the phase with body segment’s velocity, range, and angle. We next develop novel solutions to estimate the motion state in each narrowband signal, cluster the motion states for different body segments corresponding to the same person, and locate the moving traces while mitigating multi-path effects. Our system is implemented with commodity devices in room environments for performance evaluation. The experimental results exhibit that our system can conduct effective localization for up to three persons in a room, with the average errors of 7.49 cm for a single person, with 24.06 cm for two persons, with 51.15 cm for three persons.

computer science, information systems,telecommunications
AcouRadar: Towards Single Source Based Acoustic Localization

Linsong Cheng,Zhao Wang,Yunting Zhang,Weiyi Wang,Weimin Xu,Jiliang Wang

DOI: https://doi.org/10.1109/infocom41043.2020.9155430

2020-01-01

Abstract:Acoustic based tracking has been shown promising in many applications like Virtual Reality, smart home, video gaming, etc. Its real life deployments, however, face fundamental limitations. Existing approaches generally need three sound sources, while most COTS devices (e.g., TVs) and speakers have only two sound sources. We present AcouRadar, an acoustic-based localization system with single sound source. In the heart of AcouRadar we adopt a general new model which quantifies signal properties of different frequencies, distances and angles to the source. We verify the model and show that signal from a single source can provide features for localization. To address practical challenges, (1) we design an online model adaption method to address model deviation from real signal, (2) we design pulse modulated signals to alleviate the impact of environment such as multipath effect, and (3) to address signal dynamics over time, we derive relatively stable amplitude ratio between different frequencies, and thus provide a spectrum based localization method. We implement AcouRadar on Android and evaluate its performance for different COTS speakers in different environments. The results show that the model for localization can be generalized to different speakers. AcouRadar can achieve single source localization with average error less than 5 cm and average angle error of 1.76°.
Auditory System for a Mobile Robot

Jean-Marc Valin

DOI: https://doi.org/10.48550/arXiv.1602.06652

2016-02-22

Abstract:In this thesis, we propose an artificial auditory system that gives a robot the ability to locate and track sounds, as well as to separate simultaneous sound sources and recognising simultaneous speech. We demonstrate that it is possible to implement these capabilities using an array of microphones, without trying to imitate the human auditory system. The sound source localisation and tracking algorithm uses a steered beamformer to locate sources, which are then tracked using a multi-source particle filter. Separation of simultaneous sound sources is achieved using a variant of the Geometric Source Separation (GSS) algorithm, combined with a multi-source post-filter that further reduces noise, interference and reverberation. Speech recognition is performed on separated sources, either directly or by using Missing Feature Theory (MFT) to estimate the reliability of the speech features. The results obtained show that it is possible to track up to four simultaneous sound sources, even in noisy and reverberant environments. Real-time control of the robot following a sound source is also demonstrated. The sound source separation approach we propose is able to achieve a 13.7 dB improvement in signal-to-noise ratio compared to a single microphone when three speakers are present. In these conditions, the system demonstrates more than 80% accuracy on digit recognition, higher than most human listeners could obtain in our small case study when recognising only one of these sources. All these new capabilities will allow humans to interact more naturally with a mobile robot in real life settings.

Robotics,Sound

Footstep Localization By Acoustic Signals

Acoustic Based Footstep Detection in Pervasive Healthcare

Footstep Signal Extraction Algorithm Based on Wavelet Packet Decomposition and Local Discriminant Bases

FootStep-tracker

Rapid: A Multimodal and Device-free Approach Using Noise Estimation for Robust Person Identification

New algorithm for footstep localization using seismic sensors in an indoor environment

FootStep-tracker: an anchor-free indoor localization system via sensing foot steps.

Footstep Detection using Dempster-Shafer Theory

A passive energy-based method for footstep impact localization, using an underfloor accelerometer sensor network with Kalman filtering

Localisation de personnes dans les bâtiments par ondes sismiques. (Footstep localisation using seismic waves in an indoor environment.)

Footstep localization using seismic sensors in an indoor environment : SO-TDOA algorithm

Footstep recognition as people identification: A Systematic literature review

Track Your Foot Step: Anchor-Free Indoor Localization Based on Sensing Users' Foot Steps

Indoor Multi-Person Detection and Recognition Through Footsteps: A Deep Learning Approach with Acoustic Signal Analysis

Wireless Sensor Network Acoustic Source Localization System Based on Telos B

Low-Cost Distributed Acoustic Sensor Network for Real-Time Urban Sound Monitoring

Indoor Multiperson Detection and Recognition Through Footsteps: A Deep Learning Approach With Acoustic Signal Analysis

Large scale indoor occupant tracking using distributed acoustic sensing and machine learning

Room-Scale Location Trace Tracking via Continuous Acoustic Waves

AcouRadar: Towards Single Source Based Acoustic Localization

Auditory System for a Mobile Robot