Abstract:In this paper, we present a comprehensive study on the application of YOLOv8, a state-of-the-art computer vision (CV) model, to the challenging problem of joint detection and classification of signals in a highly dynamic and congested RF environment. Using our synthetic RF datasets, we explored three different scenarios with congested communication and radar signals. In the first study, we applied YOLOv8 to detect and classify multiple digital modulation signals coexisting within a highly congested and dynamic spectral environment with significant overlap in both frequency and time domains. The trained model was able to achieve an impressive mean average precision (mAP) of 0.888 at an IoU threshold of 50%, signifying its robustness against spectral congestion. The second part of our research focuses on the detection and classification of multiple polyphase pulse radar signals, including Frank code and P1 through P4 codes. We were able to successfully train YOLOv8 to deliver a nearly perfect mAP50 score of 0.995 in a densely populated signal environment, further showcasing its capability in radar signal processing. In the last scenario, we demonstrated that the model can also be applied to the multi-target detection problem for continuous-wave radar. The synthetic datasets used in these experiments reflect a realistic mix of communication and radar signals with varying degrees of interference and congestion - a setup that has been overlooked by many past research efforts, which have primarily focused on ML-based classification of digital communication signal modulation schemes. Our study demonstrated the potential of advanced CV models in addressing spectrum sensing challenges in congested and dynamic RF environments involving both communication and radar signals. We hope our findings will spur further collaborative efforts to tackle the complexities of congested RF spectrum environments.

Unraveling Complexity: an Exploration into the Large-Scale Multi-Modal Signal Processing

On the Hidden Mystery of OCR in Large Multimodal Models

UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model

Challenges and Insights: Exploring 3D Spatial Features and Complex Networks on the MISP Dataset

MMS-EF: A Multi-Scale Modular Extraction Framework for Enhancing Deep Learning Models in Remote Sensing

SensorBench: Benchmarking LLMs in Coding-Based Sensor Processing

Multisensor Processing for Signal Extraction and Applications

Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Study

Wide-field Imaging and Recognition Through Cascaded Complex Scattering Media

Joint Detection and Classification of Communication and Radar Signals in Congested RF Environments Using YOLOv8

Contour Stella Image and Deep Learning for Signal Recognition in the Physical Layer

Poster: Cross Labelling and Learning Unknown Activities Among Multimodal Sensing Data

LaMoSC: Large Language Model-Driven Semantic Communication System for Visual Transmission

Towards an End-to-End Framework for Invasive Brain Signal Decoding with Large Language Models

Octavius: Mitigating Task Interference in MLLMs via LoRA-MoE

RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts

Sparks of Large Audio Models: A Survey and Outlook

Multimodal Large Language Models: A Survey

More Perspectives Mean Better: Underwater Target Recognition and Localization with Multimodal Data via Symbiotic Transformer and Multiview Regression

Multi-scale ensemble dispersion Lempel-Ziv complexity and its application on feature extraction for ship-radiated noise

Unraveling complex data diversity in underwater acoustic target recognition through convolution-based mixture of experts