Mixed Attention Transformer Enhanced Channel Estimation for Extremely Large-Scale MIMO Systems

Shuang shuang Li,Peihao Dong
2024-10-18
Abstract:Extremely large-scale massive multiple-input multiple-output (XL-MIMO) is one of the key technologies for next-generation wireless communication systems. However, acquiring the accurate high-dimensional channel matrix of XL-MIMO remains a pressing challenge due to the intractable channel property and the high complexity. In this paper, a Mixed Attention Transformer based Channel Estimation Neural Network (MAT-CENet) is developed, which is inspired by the Transformer encoder structure as well as organically integrates the feature map attention and spatial attention mechanisms to better grasp the unique characteristics of the XL-MIMO channel. By incorporating the multi-head attention layer as the core enabler, the insightful feature importance is captured and exploited effectively. A comprehensive complexity analysis for the proposed MAT-CENet is also provided. Simulation results show that MAT-CENet outperforms the state of the art in different propagation scenarios of near-, far- and hybrid-fields.
Signal Processing
What problem does this paper attempt to address?
### Problems Addressed by the Paper The paper aims to address the challenges of high-dimensional channel matrix estimation in extremely large-scale multiple-input multiple-output (XL-MIMO) systems. Specifically, due to the enormous antenna arrays in XL-MIMO systems, obtaining accurate high-dimensional channel state information (CSI) becomes very difficult. The main issues are as follows: 1. **Complexity of High-Dimensional Channel Matrix**: Compared to traditional MIMO systems, the channel matrix in XL-MIMO systems not only has higher dimensions but also more complex characteristics. 2. **Impact of Near-Field Effects**: In XL-MIMO systems, due to the large scale of the antenna arrays, near-field effects become more significant, affecting the accuracy of channel estimation. 3. **Increased Computational Load**: Handling such large-scale antenna systems dramatically increases the computational load, requiring efficient algorithms and powerful computational resources to perform channel estimation. To address these challenges, the paper proposes a Mixed Attention Transformer-enhanced Channel Estimation Neural Network (MAT-CENet), which combines Convolutional Neural Networks (CNN) and Transformer encoder structures. It organically integrates feature map attention and spatial attention mechanisms to better capture the unique characteristics of XL-MIMO channels. By introducing multi-head attention layers as core components, the model can effectively capture and utilize the importance of features. Simulation results show that MAT-CENet outperforms existing methods in different propagation scenarios (near-field, far-field, and mixed-field).