Abstract:Semantic communications seeks to transfer information from a source while conveying a desired meaning to its destination. We model the transmitter-receiver functionalities as an autoencoder followed by a task classifier that evaluates the meaning of the information conveyed to the receiver. The autoencoder consists of an encoder at the transmitter to jointly model source coding, channel coding, and modulation, and a decoder at the receiver to jointly model demodulation, channel decoding and source decoding. By augmenting the reconstruction loss with a semantic loss, the two deep neural networks (DNNs) of this encoder-decoder pair are interactively trained with the DNN of the semantic task classifier. This approach effectively captures the latent feature space and reliably transfers compressed feature vectors with a small number of channel uses while keeping the semantic loss low. We identify the multi-domain security vulnerabilities of using the DNNs for semantic communications. Based on adversarial machine learning, we introduce test-time (targeted and non-targeted) adversarial attacks on the DNNs by manipulating their inputs at different stages of semantic communications. As a computer vision attack, small perturbations are injected to the images at the input of the transmitter's encoder. As a wireless attack, small perturbations signals are transmitted to interfere with the input of the receiver's decoder. By launching these stealth attacks individually or more effectively in a combined form as a multi-domain attack, we show that it is possible to change the semantics of the transferred information even when the reconstruction loss remains low. These multi-domain adversarial attacks pose as a serious threat to the semantics of information transfer (with larger impact than conventional jamming) and raise the need of defense methods for the safe adoption of semantic communications.

Diffusion Model Based Secure Semantic Communications with Adversarial Purification.

Asymmetric Diffusion Based Channel-Adaptive Secure Wireless Semantic Communications

Physical-layer Adversarial Robustness for Deep Learning-based Semantic Communications

Manipulating Semantic Communication by Adding Adversarial Perturbations to Wireless Channel

Secure Semantic Communications: From Perspective of Physical Layer Security

Secure Semantic Communications: Challenges, Approaches, and Opportunities

Asymmetric Semantic Communication System Based on Diffusion Model in IoT

Latent Diffusion Model-Enabled Low-Latency Semantic Communication in the Presence of Semantic Ambiguities and Wireless Channel Noises

Semantic Entropy Can Simultaneously Benefit Transmission Efficiency and Channel Security of Wireless Semantic Communications

SemProtector: A Unified Framework for Semantic Protection in Deep Learning-based Semantic Communication Systems

Robust Semantic Communications Against Semantic Noise

Is Semantic Communications Secure? A Tale of Multi-Domain Adversarial Attacks

Deep Learning-Based Image Semantic Communication System

Securing Semantic Communications with Physical-layer Semantic Encryption and Obfuscation

Lightweight and Robust Wireless Semantic Communications

SemBAT: Physical Layer Black-box Adversarial Attacks for Deep Learning-based Semantic Communication Systems

Exploring Adversarial Attacks in Semantic Communication Systems Across Diverse Channel Environments

Robust Semantic Communication Systems based on Image Transmission.

Secure Semantic Communications: Fundamentals and Challenges

Covert and Reliable Semantic Communication Against Cross-Layer Privacy Inference over Wireless Edge Networks

Toward Mixture-of-Experts Enabled Trustworthy Semantic Communication for 6G Networks