Abstract:Deep learning-based semantic communication is an emerging communication method that achieves cooperative transmission between source and channel. The primary objectives of semantic communication are to enhance the efficiency of information transmission and ensure the accurate restoration of semantic content. Recent studies have shown that semantic communication performs well in enhancing transmission rates, especially in low signal-to-noise ratio environments. However, existing speech semantic communication methods neglect to account for speech perception at the receiver and the complexity of the method, which limits the practical implementation of semantic communication methods. In this paper, we propose a perceptually-motivated, low-complexity speech semantic communication method. Specifically, we employ an end-to-end communication approach to transmit the source speech and obtain the reconstructed speech at the receiver. To ensure the accurate extraction of semantic information, we present a low-complexity fully convolutional semantic encoder, which increases the accuracy of semantic information extraction and improves transmission efficiency. Considering the sensitivity of human perception, a multi-resolution joint loss function has been implemented to enhance the model’s performance and guarantee that the reconstructed speech aligns with the human ear’s auditory perception. Experimental results show that the proposed method performs better on objective and subjective metrics than existing speech transmission methods. Compared with existing neural semantic transmission methods, we improve the transmission efficiency, and the number of symbols needed for transmission is decreased by 60% without compromising the quality of speech. Furthermore, the proposed semantic communication method has a lower complexity and consumes less time to transmit.

LaMoSC: Large Language Model-Driven Semantic Communication System for Visual Transmission

Large AI Model Empowered Multimodal Semantic Communications

Large Language Model Enabled Semantic Communication Systems

Visual Language Model based Cross-modal Semantic Communication Systems

Large AI Model-Based Semantic Communications

Semantic Importance-Aware Communications with Semantic Correction Using Large Language Models

Semantic Communication based on Large Language Model for Underwater Image Transmission

Deep Learning-Based Image Semantic Communication System

Semantic Communication for Multi-modal Data Transmission

A Robust Semantic Communication System for Image

Semantic Successive Refinement: A Generative AI-aided Semantic Communication Framework

SiSCo: Signal Synthesis for Effective Human-Robot Communication Via Large Language Models

On the Uses of Large Language Models to Design End-to-End Learning Semantic Communication

A Perceptually Motivated Approach for Low-Complexity Speech Semantic Communication

Multi-Modal Fusion-Based Multi-Task Semantic Communication System

Non-Orthogonal Multiple Access Enhanced Multi-User Semantic Communication

Multimodal Large Language Models Driven Privacy-Preserving Wireless Semantic Communication in 6G

Language-Oriented Communication with Semantic Coding and Knowledge Distillation for Text-to-Image Generation

CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding

Semantic Communication System Based on Semantic Slice Models Propagation

Text Semantic Communication Systems with Sentence-Level Semantic Fidelity