Abstract:In the future sixth-generation (6G) era, to support accurate localization sensing and efficient communication link establishment for intelligent agents, a comprehensive understanding of the surrounding environment and proper channel modeling are indispensable. The existing method, which solely exploits radio frequency (RF) communication information, is difficult to accomplish accurate channel modeling. Fortunately, multi-modal devices are deployed on intelligent agents to obtain environmental features, which could further assist in channel modeling. Currently, some research efforts have been devoted to utilizing multi-modal information to facilitate channel modeling, while still lack a comprehensive review. To fill this gap, we embark on an initial endeavor with the goal of reviewing multi-modal intelligent channel modeling (MMICM) via Synesthesia of Machines (SoM). Compared to channel modeling approaches that solely utilize RF communication information, the utilization of multi-modal information can provide a more in-depth understanding of the propagation environment around the transceiver, thus facilitating more accurate channel modeling. First, this paper introduces existing channel modeling approaches from the perspective of the channel modeling evolution. Then, we have elaborated and investigated recent advances in the topic of capturing typical channel characteristics and features, i.e., channel non-stationarity and consistency, by characterizing the mathematical, spatial, coupling, and mapping relationships. In addition, applications that can be supported by MMICM are summarized and analyzed. To corroborate the superiority of MMICM via SoM, we give the simulation result and analysis. Finally, some open issues and potential directions for the MMICM are outlined from the perspectives of measurements, modeling, and applications.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: in the future sixth - generation (6G) communication era, in order to support the precise positioning perception of agents and the establishment of efficient communication links, how to achieve more accurate channel modeling through multi - modal information.
### Problem Background
Existing channel modeling methods mainly rely on radio - frequency (RF) communication information, which makes it difficult to achieve accurate channel modeling in complex environments. Therefore, these methods cannot fully support agent - related applications, such as self - driving vehicles, unmanned aerial vehicles, and robots. However, with the development of technology, multiple sensors (such as LiDAR, RGB - D cameras, millimeter - wave radars, etc.) are deployed on agents, which can obtain environmental features and further assist channel modeling.
### Solution
To solve the above problems, the author proposes the concept of "Synesthesia of Machines (SoM)", which is an intelligent multi - modal perception - communication integration technology. SoM aims to achieve mutual benefit between communication and perception through machine - learning techniques, so as to obtain a deeper understanding of the propagation environment and then achieve higher - precision channel modeling.
### Specific Contents
1. **Multi - Modal Intelligent Channel Modeling (MMICM)**: Utilize multi - modal information from communication devices and various sensors, and intelligently process and explore the mapping relationship between communication and perception.
2. **Evolution of Channel Modeling**: Evolve gradually from traditional channel modeling to intelligent channel modeling relying only on RF, and then to MMICM.
3. **Channel Non - stationarity and Consistency**: Capture the channel characteristics in different channel modeling methods through mathematics, space, coupling, and mapping relationships.
4. **Application Analysis**: Summarize and analyze the applications that MMICM can support, such as communication system transceiver design, network optimization, positioning perception, and agent cognitive intelligence.
5. **Simulation Results and Analysis**: Verify the advantages of MMICM through simulation and demonstrate the necessity of using multi - modal information and exploring the mapping relationship between communication and perception.
6. **Future Research Directions**: Propose future research challenges and directions from the three perspectives of measurement, modeling, and application.
### Conclusion
By introducing the SoM concept, the paper proposes a brand - new multi - modal intelligent channel modeling method, which solves the problem that existing methods are difficult to achieve accurate channel modeling in complex environments, and provides theoretical and technical support for the future 6G communication system design.