Generative Network Layer for Communication Systems with Artificial Intelligence

Mathias Thorsager,Israel Leyva-Mayorga,Beatriz Soret,Petar Popovski
2024-01-26
Abstract:The traditional role of the network layer is the transfer of packet replicas from source to destination through intermediate network nodes. We present a generative network layer that uses Generative AI (GenAI) at intermediate or edge network nodes and analyze its impact on the required data rates in the network. We conduct a case study where the GenAI-aided nodes generate images from prompts that consist of substantially compressed latent representations. The results from network flow analyses under image quality constraints show that the generative network layer can achieve an improvement of more than 100% in terms of the required data rate.
Information Theory,Machine Learning
What problem does this paper attempt to address?
The paper discusses how generative artificial intelligence (GenAI) can be utilized in communication systems to improve the data transmission efficiency and resource utilization of the network layer. Traditionally, the role of the network layer is to copy data packets from the source to the destination through intermediate nodes, but this model assumes that the data generated by the source is unpredictable at the destination. The paper proposes the concept of a generative network layer, where intermediate or edge nodes equipped with GenAI can generate approximate replicas of data based on prompts, thereby reducing network load. Specifically, the paper demonstrates that when GenAI-assisted nodes are capable of generating images from compressed latent representations, it is possible to significantly improve the traffic efficiency required by the network while satisfying image quality constraints, even achieving an improvement of over 100%. This is thanks to GenAI models, such as Foundation Models (FM) based on deep neural networks (DNN), which can be trained through self-supervised learning without the need for labeled data, allowing them to be trained on large-scale datasets. The paper considers two types of prompting strategies: implicit prompting, where GenAI nodes generate approximate replicas based on previously received data when no specific data packet is received; and explicit prompting, where source nodes send prompts smaller than the actual data to GenAI nodes to generate data. Both strategies aim to control the quality of the generated content, and quality assessment relies not only on traditional communication system distortion metrics but also on perceptual quality indicators, such as Fréchet Inception Distance (FID), to measure the similarity between generated content and real content. Through a case study, the paper analyzes the performance of the generative network layer under image quality constraints in network flow analysis and proposes a mechanism that can gracefully increase or decrease the size of prompts used for image generation to maximize throughput while meeting specific distortion and FID constraints. In addition, the paper compares the performance of the GenAI-enhanced network layer with JPEG image compression schemes at different prompt sizes, showing that the GenAI approach provides higher perceptual quality at lower prompt sizes, thereby achieving higher effective data throughput, especially under given perceptual quality constraints.