Abstract:This paper addresses the problem of end-to-end (E2E) design of learning and communication in a task-oriented semantic communication system. In particular, we consider a multi-device cooperative edge inference system over a wireless multiple-input multiple-output (MIMO) multiple access channel, where multiple devices transmit extracted features to a server to perform a classification task. We formulate the E2E design of feature encoding, MIMO precoding, and classification as a conditional mutual information maximization problem. However, it is notoriously difficult to design and train an E2E network that can be adaptive to both the task dataset and different channel realizations. Regarding network training, we propose a decoupled pretraining framework that separately trains the feature encoder and the MIMO precoder, with a maximum a posteriori (MAP) classifier employed at the server to generate the inference result. The feature encoder is pretrained exclusively using the task dataset, while the MIMO precoder is pretrained solely based on the channel and noise distributions. Nevertheless, we manage to align the pretraining objectives of each individual component with the E2E learning objective, so as to approach the performance bound of E2E learning. By leveraging the decoupled pretraining results for initialization, the E2E learning can be conducted with minimal training overhead. Regarding network architecture design, we develop two deep unfolded precoding networks that effectively incorporate the domain knowledge of the solution to the decoupled precoding problem. Simulation results on both the CIFAR-10 and ModelNet10 datasets verify that the proposed method achieves significantly higher classification accuracy compared to various baselines.

Learning to Modulate for Non-coherent MIMO

Distributed Mimo Network Optimization Based On Duality And Local Message Passing

Deep Stochastic Optimization for Algorithm-Specific Pilot Design in Massive MIMO.

Two-Timescale End-to-End Learning for Channel Acquisition and Hybrid Precoding

Deep Learning Based MIMO Communications

On Deep Learning Solutions for Joint Transmitter and Noncoherent Receiver Design in MU-MIMO Systems

Noncoherent Energy-Modulated Massive SIMO in Multipath Channels: A Machine Learning Approach

Modem Optimization of High-Mobility Scenarios: A Deep-Learning-Inspired Approach

Deep Learning Based Joint Beam Selection and Precoding Design for Mmwave Systems with Lens Arrays

Joint Deep Reinforcement Learning and Unfolding: Beam Selection and Precoding for Mmwave Multiuser MIMO with Lens Arrays

Modeling an Enhanced Modulation Classification Approach using Arithmetic Optimization with Deep Learning for MIMO-OFDM Systems

Deep Learning-Based Precoder Design in MIMO Systems With Finite-Alphabet Inputs

TC-MIMONet: A Learning-based Transceiver for MIMO Systems with Temporal Correlations.

Deep Learning for Joint MIMO Detection and Channel Decoding

Benchmarking End-to-end Learning of MIMO Physical-Layer Communication

Modular Hypernetworks for Scalable and Adaptive Deep MIMO Receivers

Exceeding the Nonlinear Shannon-Limit in Coherent Optical Communications by MIMO Machine Learning

Rapid and Power-Aware Learned Optimization for Modular Receive Beamforming

End-to-End Learning for Uplink MU-SIMO Joint Transmitter and Non-Coherent Receiver Design in Fading Channels.

End-to-End Learning for Task-Oriented Semantic Communications Over MIMO Channels: An Information-Theoretic Framework

Deep Modulation Embedding