Abstract:End-to-end semantic communications (ESC) rely on deep neural networks (DNN) to boost communication efficiency by only transmitting the semantics of data, showing great potential for high-demand mobile applications. We argue that central to the success of ESC is the robust interpretation of conveyed semantics at the receiver side, especially for security-critical applications such as automatic driving and smart healthcare. However, robustifying semantic interpretation is challenging as ESC is extremely vulnerable to physical-layer adversarial attacks due to the openness of wireless channels and the fragileness of neural models. Toward ESC robustness in practice, we ask the following two questions: Q1: For attacks, is it possible to generate semantic-oriented physical-layer adversarial attacks that are imperceptible, input-agnostic and controllable? Q2: Can we develop a defense strategy against such semantic distortions and previously proposed adversaries? To this end, we first present MobileSC, a novel semantic communication framework that considers the computation and memory efficiency in wireless environments. Equipped with this framework, we propose SemAdv, a physical-layer adversarial perturbation generator that aims to craft semantic adversaries over the air with the abovementioned criteria, thus answering the Q1. To better characterize the realworld effects for robust training and evaluation, we further introduce a novel adversarial training method SemMixed to harden the ESC against SemAdv attacks and existing strong threats, thus answering the Q2. Extensive experiments on three public benchmarks verify the effectiveness of our proposed methods against various physical adversarial attacks. We also show some interesting findings, e.g., our MobileSC can even be more robust than classical block-wise communication systems in the low SNR regime.

Encrypted Semantic Communication Using Adversarial Training for Privacy Preserving

GELU-Net: A Globally Encrypted, Locally Unencrypted Deep Neural Network for Privacy-Preserved Learning.

Privacy-Preserving Collaborative Model Learning: the Case of Word Vector Training

Physical-layer Adversarial Robustness for Deep Learning-based Semantic Communications

Secure Semantic Communications: From Perspective of Physical Layer Security

Covert and Reliable Semantic Communication Against Cross-Layer Privacy Inference over Wireless Edge Networks

Diffusion Model Based Secure Semantic Communications with Adversarial Purification.

Secure Semantic Communication via Paired Adversarial Residual Networks

SemProtector: A Unified Framework for Semantic Protection in Deep Learning-based Semantic Communication Systems

Securing Semantic Communications with Physical-layer Semantic Encryption and Obfuscation

Secure Semantic Communications: Challenges, Approaches, and Opportunities

Contrastive Learning and Adversarial Disentanglement for Privacy-Preserving Task-Oriented Semantic Communications

Robust Semantic Communications Against Semantic Noise

Boosting Physical Layer Black-Box Attacks with Semantic Adversaries in Semantic Communications

Privacy-Preserving Task-Oriented Semantic Communications Against Model Inversion Attacks

Training Encrypted Models with Privacy-preserved Data on Blockchain

Knowledge-Assisted Privacy Preserving in Semantic Communication

Asymmetric Diffusion Based Channel-Adaptive Secure Wireless Semantic Communications

Backdoor Attacks and Defenses on Semantic-Symbol Reconstruction in Semantic Communications

Trustworthy Semantic-Enabled 6G Communication: A Task-oriented and Privacy-preserving Perspective

IRS-Enhanced Secure Semantic Communication Networks: Cross-Layer and Context-Awared Resource Allocation