Abstract:Modulation classification is a very challenging task since the signals intertwine with various ambient noises. Methods are required that can classify them without adding extra steps like denoising, which introduces computational complexity. In this study, we propose a vision transformer (ViT) based model named NMformer to predict the channel modulation images with different noise levels in wireless communication. Since ViTs are most effective for RGB images, we generated constellation diagrams from the modulated signals. The diagrams provide the information from the signals in a 2-D representation form. We trained NMformer on 106, 800 modulation images to build the base classifier and only used 3, 000 images to fine-tune for specific tasks. Our proposed model has two different kinds of prediction setups: in-distribution and out-of-distribution. Our model achieves 4.67% higher accuracy than the base classifier when finetuned and tested on high signal-to-noise ratios (SNRs) in-distribution classes. Moreover, the fine-tuned low SNR task achieves a higher accuracy than the base classifier. The fine-tuned classifier becomes much more effective than the base classifier by achieving higher accuracy when predicted, even on unseen data from out-of-distribution classes. Extensive experiments show the effectiveness of NMformer for a wide range of SNRs.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the automatic modulation classification (AMC) problem in wireless communication, especially how to accurately identify different modulation methods in the presence of noise. Specifically, traditional methods have poor performance when dealing with noisy signals and usually require additional denoising steps, which increases the computational complexity. Therefore, this paper proposes a new model based on Vision Transformer (ViT) - NMformer, which is used to directly classify noisy modulation signals under different signal - to - noise ratio (SNR) conditions without additional denoising treatment. ### Main problems: 1. **Influence of noise**: In practical applications, wireless communication signals are often interfered by environmental noise, making modulation classification very difficult. 2. **Performance at low SNR**: In the case of low signal - to - noise ratio (SNR), the classification accuracy of traditional methods decreases significantly. 3. **Generalization ability with limited data sets**: Existing methods perform poorly when facing limited labeled data, especially when dealing with unseen data distributions. ### Solutions: - **Generate constellation diagrams**: Convert the modulation signals into RGB constellation diagrams in order to utilize the powerful image - processing ability of ViT. - **NMformer model**: Use the Vision Transformer architecture to capture global image features through the self - attention mechanism instead of traditional local features. - **Fine - tuning strategy**: Fine - tune the basic classifier with a small number of samples to improve the performance of specific tasks, especially the classification accuracy at low SNR. ### Experimental results: - **At high SNR**: The fine - tuned model achieves a classification accuracy of 75.77% under high signal - to - noise ratio (such as 5.5 dB, 7.5 dB, 9.5 dB) conditions, which is significantly better than the basic classifier. - **At low SNR**: Even under low signal - to - noise ratio (such as 0.5 dB, 1.5 dB, 4.5 dB) conditions, the fine - tuned model also performs well, with an accuracy of 71.60%, which is 0.50% higher than that of the basic classifier. ### Conclusion: The NMformer model shows excellent classification performance under different SNR conditions, especially in the cases of low SNR and limited data sets, demonstrating strong generalization ability and higher accuracy. This achievement provides a new and effective solution for automatic modulation classification in wireless communication.

NMformer: A Transformer for Noisy Modulation Classification in Wireless Communication

FE-SKViT: A Feature-Enhanced ViT Model with Skip Attention for Automatic Modulation Recognition

Enhancing Automatic Modulation Recognition for IoT Applications Using Transformers

CTRNet: An Automatic Modulation Recognition Based on Transformer-CNN Neural Network

A real-time constellation image classification method of wireless communication signals based on the lightweight network MobileViT

HCTC: Hybrid Convolutional Transformer Classifier for Automatic Modulation Recognition

FMViT: A multiple-frequency mixing Vision Transformer

Radio–Image Transformer: Bridging Radio Modulation Classification and ImageNet Classification

Modulation Classification Through Deep Learning Using Resolution Transformed Spectrograms

An efficient automatic modulation recognition using time–frequency information based on hybrid deep learning and bagging approach

Automatic modulation classification with 2D transforms and convolutional neural network

MVL-Tra: Multi-view LFM signal source classification using Transformer

An Automatic Modulation Recognition Method with Low Parameter Estimation Dependence Based on Spatial Transformer Networks

Multimodal Transformers for Wireless Communications: A Case Study in Beam Prediction

On the Role of ViT and CNN in Semantic Communications: Analysis and Prototype Validation

Enhancing Automatic Modulation Recognition through Robust Global Feature Extraction

MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer

Modulation format recognition based on constellation diagrams and the Hough transform

Automatic Modulation Classification Based on CNN-Transformer Graph Neural Network

Identifying Physical-Layer Attacks for IoT Security: an Automatic Modulation Classification Approach Using Multi-Module Fusion Neural Network.

VLCMnet-Based Modulation Format Recognition for Indoor Visible Light Communication Systems