Evaluating ML Robustness in GNSS Interference Classification, Characterization \& Localization

Lucas Heublein,Tobias Feigl,Thorsten Nowak,Alexander Rügamer,Christopher Mutschler,Felix Ott
2024-09-23
Abstract:Jamming devices present a significant threat by disrupting signals from the global navigation satellite system (GNSS), compromising the robustness of accurate positioning. The detection of anomalies within frequency snapshots is crucial to counteract these interferences effectively. A critical preliminary measure involves the reliable classification of interferences and characterization and localization of jamming devices. This paper introduces an extensive dataset compromising snapshots obtained from a low-frequency antenna, capturing diverse generated interferences within a large-scale environment including controlled multipath effects. Our objective is to assess the resilience of ML models against environmental changes, such as multipath effects, variations in interference attributes, such as the interference class, bandwidth, and signal-to-noise ratio, the accuracy jamming device localization, and the constraints imposed by snapshot input lengths. By analyzing the aleatoric and epistemic uncertainties, we demonstrate the adaptness of our model in generalizing across diverse facets, thus establishing its suitability for real-world applications. <a class="link-external link-https" href="https://gitlab.cc-asp.fraunhofer.de/darcy_gnss/controlled_low_frequency" rel="external noopener nofollow">this https URL</a>
Artificial Intelligence
What problem does this paper attempt to address?
### What problems does this paper attempt to solve? This paper aims to evaluate the robustness of machine learning (ML) models in handling global navigation satellite system (GNSS) interference classification, characterization, and location tasks. Specifically, the authors focus on the following key issues: 1. **Interference Detection and Classification**: - GNSS signals are vulnerable to threats from jamming devices, which can disrupt accurate positioning functions. Therefore, it is crucial to reliably detect and classify different types of interference (such as Chirp, FreqHopper, Modulated, etc.). - The paper introduces a large - scale dataset that contains multiple generated interference samples and was collected in a large - scale environment, including controlled multipath effects. 2. **Characterization and Location**: - The characterization of interference includes bandwidth (Bandwidth, BW) and signal - to - noise ratio (Signal - to - Noise Ratio, StN). To deal with different interference properties, the model needs to be able to accurately estimate these parameters. - In addition, it is necessary to accurately locate the interference source to help counter jamming devices. This involves predicting the angle or position of the interference signal. 3. **Robustness under Environmental Changes**: - The model needs to be able to maintain good performance under different environmental conditions, such as in the presence of multipath effects. Multipath effects refer to the complex propagation paths of signals during propagation due to reflection, refraction, etc. - Environmental changes also include different interference types, antenna changes, and differences in the location of receiving stations. Therefore, evaluating the robustness and generalization ability of the model under these changing conditions is one of the focuses of this paper. 4. **Analysis of Uncertainty**: - By analyzing the aleatoric uncertainty and epistemic uncertainty of the model, we can better understand the performance of the model when facing unknown data. - Aleatoric uncertainty reflects the inherent randomness of the data itself, while epistemic uncertainty can be reduced by increasing the observed data. 5. **Impact of Input Length**: - The study also explores the impact of different snapshot lengths on the performance of the model. This is of great significance for optimizing the data collection and processing flow in practical applications. In summary, the main goal of this paper is to develop a machine learning model that can perform well among various interference types, interference characteristics, antenna changes, environmental fluctuations, location changes, and different receiving stations, and ensure its reliability in real - world applications.