Mathematical Theory of Communication Networks

Venkat Anantharam

DOI: https://doi.org/10.1007/978-1-4612-2450-1_1

1996-01-01

Abstract:We describe some recent advances in the mathematical theory of communication networks.

What problem does this paper attempt to address?

An Algebraic and Probabilistic Framework for Network Information Theory

S. Sandeep Pradhan,Arun Padakandla,Farhad Shirani

DOI: https://doi.org/10.1561/0100000083

2020-01-01

Foundations and Trends® in Communications and Information Theory

Abstract:In this monograph, we develop a mathematical framework based on asymptotically good random structured codes, i.e., codes possessing algebraic properties, for network information theory. We use these codes to propose new strategies for communication in multi-terminal settings. The proposed coding strategies are applicable to arbitrary instances of the multi-terminal communication problems under consideration. In particular, we consider four fundamental problems which can be considered as building blocks of networks: distributed source coding, interference channels, multiple-access channels with distributed states and multiple description source coding. We then develop a systematic framework for characterizing the performance limits of these strategies for these problems from an information-theoretic viewpoint. Lastly, we identify several examples of the multiterminal communication problems studied herein, for which structured codes attain optimality, and provide strictly better performance as compared to classical techniques based on unstructured codes. In summary, we develop an algebraic and probabilistic framework to demonstrate the fundamental role played by structured codes in multiterminal communication problems. This monograph deals exclusively with discrete source and channel coding problems.<h3>Suggested Citation</h3>S. Sandeep Pradhan, Arun Padakandla and Farhad Shirani (2020), "An Algebraic and Probabilistic Framework for Network Information Theory", Foundations and Trends® in Communications and Information Theory: Vol. 18: No. 2, pp 173-379. http://dx.doi.org/10.1561/0100000083
A Mathematical Theory of Communication

Jin Woo Shin,Sang Joon Kim

Abstract:This paper opened the new area the information theory. Before this paper, most people believed that the only way to make the error probability of transmission as small as desired is to reduce the data rate (such as a long repetition scheme). However, surprisingly this paper revealed that it does not need to reduce the data rate for achieving that much of small errors. It proved that we can get some positive data rate that has the same small error probability and also there is an upper bound of the data rate, which means we cannot achieve the data rate with any encoding scheme that has small enough error probability over the upper bound.

Mathematics
Brief Announcement: Data Dissemination in Unified Dynamic Wireless Networks

Magnus M. Halldorsson,Tigran Tonoyan,Yuexuan Wang,Dongxiao Yu

DOI: https://doi.org/10.1145/2933057.2933065

2016-01-01

Abstract:We give efficient algorithms for the fundamental problems of Broadcast and Local Broadcast in dynamic wireless networks. We propose a general model of communication which captures and includes both fading models (like SINR) and graph-based models (such as quasi unit disc graphs, bounded-independence graphs, and protocol model). The only requirement is that the nodes can be embedded in a bounded growth quasi-metric, which is the weakest condition known to ensure distributed operability. Both the nodes and the links of the network are dynamic: nodes can come and go, while the signal strength on links can go up or down. The results improve some of the known bounds even in the static setting, including an optimal algorithm for local broadcasting in the SINR model, which is additionally uniform (independent of network size). An essential component is a procedure for balancing contention, which has potentially wide applicability. The results illustrate the importance of carrier sensing, a stock feature of wireless nodes today, which we encapsulate in primitives to better explore its uses and usefulness.
Mathematical Foundations for Information Theory in Diffusion-Based Molecular Communications

Ya-Ping Hsieh,Ping-Cheng Yeh

DOI: https://doi.org/10.48550/arXiv.1311.4431

2013-11-19

Abstract:Molecular communication emerges as a promising communication paradigm for nanotechnology. However, solid mathematical foundations for information-theoretic analysis of molecular communication have not yet been built. In particular, no one has ever proven that the channel coding theorem applies for molecular communication, and no relationship between information rate capacity (maximum mutual information) and code rate capacity (supremum achievable code rate) has been established. In this paper, we focus on a major subclass of molecular communication - the diffusion-based molecular communication. We provide solid mathematical foundations for information theory in diffusion-based molecular communication by creating a general diffusion-based molecular channel model in measure-theoretic form and prove its channel coding theorems. Various equivalence relationships between statistical and operational definitions of channel capacity are also established, including the most classic information rate capacity and code rate capacity. As byproducts, we have shown that the diffusion-based molecular channel is with "asymptotically decreasing input memory and anticipation" and "d-continuous". Other properties of diffusion-based molecular channel such as stationarity or ergodicity are also proven.

Information Theory,Molecular Networks
Problems in the mathematical theory of quantum communication channels

A.S. Holevo

DOI: https://doi.org/10.1016/0034-4877(77)90010-6

IF: 0.808

1977-10-01

Reports on Mathematical Physics

Abstract:In this paper a survey of some basic concepts of the general communication theory including both classical and quantum case is given. Some open questions are formulated and discussed.

physics, mathematical
Max-Flow Min-Cut Theorems for Multi-User Communication Networks

Soren Riis,Maximilien Gadouleau

DOI: https://doi.org/10.48550/arXiv.1012.5224

2014-10-16

Abstract:The paper presents four distinct new ideas and results for communication networks: 1) We show that relay-networks (i.e. communication networks where different nodes use the same coding functions) can be used to model dynamic networks. 2) We introduce {\em the term model}, which is a simple, graph-free symbolic approach to communication networks. 3) We state and prove variants of a theorem concerning the dispersion of information in single-receiver communications. 4) We show that the solvability of an abstract multi-user communication problem is equivalent to the solvability of a single-target communication in a suitable relay network. In the paper, we develop a number of technical ramifications of these ideas and results. One technical result is a max-flow min-cut theorem for the Rényi entropy with order less than one, given that the sources are equiprobably distributed; conversely, we show that the max-flow min-cut theorem fails for the Rényi entropy with order greater than one. We leave the status of the theorem with regards to the ordinary Shannon Entropy measure (Rényi entropy of order one and the limit case between validity or failure of the theorem) as an open question. In non-dynamic static communication networks with a single receiver, a simple application of Menger's theorem shows that the optimal throughput can be achieved without proper use of network coding i.e. just by using ordinary packet-switching. This fails dramatically in relay networks with a single receiver. We show that even a powerful method like linear network coding fails miserably for relay networks. With that in mind, it is noticeable that our rather weak form of network coding (routing with dynamic headers) is asymptotically sufficient to reach capacity.

Information Theory,Logic in Computer Science,Combinatorics
Recent Advances in Complex Networks Theories with Applications

Hamid Reza Karimi,Wei Zhang,Xuebo Yang,Zhandong Yu

DOI: https://doi.org/10.1155/2014/504923

2014-01-01

Abstract:Since the 1980s, the rapid development of computer and information engineering technology represented by the Internet makes the human society stride into the “network era.” From the Internet to the World Wide Web, from the power grid to the transportation network, from the organism's brain neural networks to the metabolic network, and from research cooperation network to a variety of political, economic, and social networks, people have actually lived in a world filled with a wide variety of complex networks. Hence, in recent years, complex networks have become the research focus in different disciplines including mechanical, physics, biology, system control, communication technology, social, economic, and military disciplines. Previous studies have mainly focused on the following: (1) static statistical analysis of complex network topology, such as the matching pattern based on a given degree distribution, a variety of correlation, and the description of weighted networks; (2) the evolution and mechanisms model of complex networks, such as network evolution statistical regularity and geometric properties of network; (3) kinetics of complex networks, including network fault tolerance and attack robustness, and the dynamic processes of spread, synchronization, and resonance on the network.
Euclidean network information theory

Shao-Lun Huang

2013-01-01

Abstract:Many network information theory problems face the similar difficulty of single letterization. We argue that this is due to the lack of a geometric structure on the space of probability distributions. In this thesis, we develop such a structure by assuming that the distributions of interest are all close to each other. Under this assumption, the Kullback-Leibler (K-L) divergence is reduced to the squared Euclidean metric in an Euclidean space. In addition, we construct the notion of coordinate and inner product, which will facilitate solving communication problems. We will present the application of this approach to the point-to-point channels, general broadcast channels (BC), multiple access channels (MAC) with common sources, interference channels, and multi-hop layered communication networks without or with feedback. It can be shown that with this approach, information theory problems, such as the single-letterization, can be reduced to some linear algebra problems. Solving these linear algebra problems, we will show that for the general broadcast channels, transmitting the common message to receivers can be formulated as the trade-off between linear systems. We also provide an example to visualize this trade-off in a geometric way. For the MAC with common sources, we observe a coherent combining gain due to the cooperation between transmitters, and this gain can be obtained quantitively by applying our technique. In addition, the developments of the broadcast channels and multiple access channels suggest a trade-off relation between generating common messages for multiple users and transmitting them as the common sources to exploit the coherent combining gain, when optimizing the throughputs of communication networks. To study the structure of this trade-off and understand its role in optimizing the network throughput, we construct a deterministic model by our local approach that captures the critical channel parameters and well models the network. With this deterministic model, for multi-hop layered networks, we analyze the optimal network throughputs, and illustrate what kinds of common messages should be generated to achieve the optimal throughputs. Our results provide the insight of how users in a network should cooperate with each other to transmit information efficiently. Thesis Supervisor: Lizhong Zheng 3 Title: Professor of Electrical Engineering and Computer Science
Semantic Communications: Theories, Technologies and Applications

Ping Zhang,Guangming Shi,Shuguang Cui,Zhaoyang Zhang,Kai Niu,Yong Xiao,Zhijin Qin,Jincheng Dai,Shuo Shao,Deniz Gunduz,Eleonora Grassucci

DOI: https://doi.org/10.23919/jcc.2024.10606406

2024-01-01

China Communications

Abstract:The last seventy years have witnessed the transition of communication from Shannon's theoretical concept to current high-efficiency practical systems. With respect to Shannon information theory, to fulfill the high-bandwidth utilization, any further increase in the data rate requires a significant augmentation in the received signal power unless the bandwidth is extended in proportion to the incremental data rate. Although many such technologies have achieved tremendous success in today's communication systems, they also lead to severe high-frequency coverage costs, complicated signal processing, high energy consumption, etc. Together with extraordinary promises, naively increasing channel capacity cannot address all communication problems, especially in future intelligent eras. It is the very time for radical rethinking of classical communication mechanisms.
Towards Communication-Aware Robust Topologies

Chen Avin,Alexandr Hercules,Andreas Loukas,Stefan Schmid

DOI: https://doi.org/10.48550/arXiv.1705.07163

2017-05-20

Abstract:We currently witness the emergence of interesting new network topologies optimized towards the traffic matrices they serve, such as demand-aware datacenter interconnects (e.g., ProjecToR) and demand-aware overlay networks (e.g., SplayNets). This paper introduces a formal framework and approach to reason about and design such topologies. We leverage a connection between the communication frequency of two nodes and the path length between them in the network, which depends on the entropy of the communication matrix. Our main contribution is a novel robust, yet sparse, family of network topologies which guarantee an expected path length that is proportional to the entropy of the communication patterns.

Networking and Internet Architecture
Theories of Communication Networks

Peter R. Monge,Noshir Contractor

DOI: https://doi.org/10.1093/oso/9780195160369.001.0001

2003-03-27

Abstract:To date, most network research contains one or more of five major problems. First, it tends to be atheoretical, ignoring the various social theories that contain network implications. Second, it explores single levels of analysis rather than the multiple levels out of which most networks are comprised. Third, network analysis has employed very little the insights from contemporary complex systems analysis and computer simulations. Foruth, it typically uses descriptive rather than inferential statistics, thus robbing it of the ability to make claims about the larger universe of networks. Finally, almost all the research is static and cross-sectional rather than dynamic. Theories of Communication Networks presents solutions to all five problems. The authors develop a multitheoretical model that relates different social science theories with different network properties. This model is multilevel, providing a network decomposition that applies the various social theories to all network levels: individuals, dyads, triples, groups, and the entire network. The book then establishes a model from the perspective of complex adaptive systems and demonstrates how to use Blanche, an agent-based network computer simulation environment, to generate and test network theories and hypotheses. It presents recent developments in network statistical analysis, the p* family, which provides a basis for valid multilevel statistical inferences regarding networks. Finally, it shows how to relate communication networks to other networks, thus providing the basis in conjunction with computer simulations to study the emergence of dynamic organizational networks.
Survey on Application of Communication Network Topology Simulation Technology

Wei Zhu,Jinshu Zeng,Zhengwen Gong,Sheng Yu

DOI: https://doi.org/10.54097/hset.v56i.10710

2023-07-14

Abstract:As an important part of the study of communication networks, network topology clearly reflects many structural features of communication networks from the physical level and is a major research hotspot in this field. Simulation techniques are becoming more and more widely used in the study of communication networks as computer technology advances and becomes more convenient and intuitive. This paper collates the current research results on the topology of communication networks and the effectiveness of the applications of simulation technology, reviews the current status of research in related fields at home and abroad, and summarises the application of simulation technology in topology research to provide some reference for subsequent researchers in related fields.
Information Theory in Emerging Wireless Communication Systems and Networks

Erdem Koyuncu

DOI: https://doi.org/10.3390/e26070543

IF: 2.738

2024-06-26

Entropy

Abstract:Wireless communication systems and networks are rapidly evolving to meet the increasing demands for higher data rates, better reliability, and connectivity anywhere, anytime [...]

physics, multidisciplinary
Network information theory for classical-quantum channels

Ivan Savov

DOI: https://doi.org/10.48550/arXiv.1208.4188

2012-08-21

Abstract:Network information theory is the study of communication problems involving multiple senders, multiple receivers and intermediate relay stations. The purpose of this thesis is to extend the main ideas of classical network information theory to the study of classical-quantum channels. We prove coding theorems for quantum multiple access channels, quantum interference channels, quantum broadcast channels and quantum relay channels. A quantum model for a communication channel describes more accurately the channel's ability to transmit information. By using physically faithful models for the channel outputs and the detection procedure, we obtain better communication rates than would be possible using a classical strategy. In this thesis, we are interested in the transmission of classical information, so we restrict our attention to the study of classical-quantum channels. These are channels with classical inputs and quantum outputs, and so the coding theorems we present will use classical encoding and quantum decoding. We study the asymptotic regime where many copies of the channel are used in parallel, and the uses are assumed to be independent. In this context, we can exploit information-theoretic techniques to calculate the maximum rates for error-free communication for any channel, given the statistics of the noise on that channel. These theoretical bounds can be used as a benchmark to evaluate the rates achieved by practical communication protocols. Most of the results in this thesis consider classical-quantum channels with finite dimensional output systems, which are analogous to classical discrete memoryless channels. In the last chapter, we will show some applications of our results to a practical optical communication scenario, in which the information is encoded in continuous quantum degrees of freedom, which are analogous to classical channels with Gaussian noise.

Quantum Physics,Information Theory
Several Mathematical Problems in Quantum Information Theory

FENG KeQin,JIN LingFei

DOI: https://doi.org/10.1360/n012016-00159

2017-01-01

Abstract:The theory of quantum communication and technology have been one of hot research topics in information science and technology since 1980's.In this paper,we survey some research development of several mathematical problems in quantum information theory.Particularly,we focus on the important role of combinatorics (including graph theory),number theory,algebra and algebraic geometry (the arithmetic theory of algebraic curves over finite field) in investigating quantum measurement and quantum error-correction.
Random Network Coding and Its Applications in Wireless Networks

Mingwei Xu

2009-01-01

Abstract:Random network coding is a new fundamental network theory. It has many unique advantages by comparison with traditional routing based network theory. This will promote the birth of next-generation communication network. We present its definition,exclusive characteristics and preponderances,and analyze some open issues when it is applied to wireless networks. We also forecast its future development directions.
Topology design of communication networks: a game-theoretic perspective

Amir Nahir,Ariel Orda,Ari Freund

DOI: https://doi.org/10.1109/TNET.2013.2254125

2014-04-01

IEEE/ACM Transactions on Networking

Abstract:We study the performance of noncooperative networks in light of three major topology design considerations, namely the price of establishing a link, path delay, and path proneness to congestion, the latter being modeled through the "relaying extent" of the nodes. We analyze these considerations and the tradeoffs between them from a game-theoretic perspective, where each network element attempts to optimize its individual performance. We show that for all considered cases but one, the existence of a Nash equilibrium point is guaranteed. For the latter case, we indicate, by simulations, that practical scenarios tend to admit a Nash equilibrium. In addition, we demonstrate that the price of anarchy, i.e., the performance penalty incurred by noncooperative behavior, may be prohibitively large; yet, we also show that such games usually admit at least one Nash equilibrium that is system-wide optimal, i.e., their price of stability is 1. This finding suggests that a major improvement can be achieved by providing a central ("social") agent with the ability to impose the initial configuration on the system.
The Topology of Wireless Communication

Erez Kantor,Zvi Lotker,Merav Parter,David Peleg

DOI: https://doi.org/10.48550/arXiv.1103.4566

2011-03-24

Abstract:In this paper we study the topological properties of wireless communication maps and their usability in algorithmic design. We consider the SINR model, which compares the received power of a signal at a receiver against the sum of strengths of other interfering signals plus background noise. To describe the behavior of a multi-station network, we use the convenient representation of a \emph{reception map}. In the SINR model, the resulting \emph{SINR diagram} partitions the plane into reception zones, one per station, and the complementary region of the plane where no station can be heard. We consider the general case where transmission energies are arbitrary (or non-uniform). Under that setting, the reception zones are not necessarily convex or even connected. This poses the algorithmic challenge of designing efficient point location techniques as well as the theoretical challenge of understanding the geometry of SINR diagrams. We achieve several results in both directions. We establish a form of weaker convexity in the case where stations are aligned on a line. In addition, one of our key results concerns the behavior of a $(d+1)$-dimensional map. Specifically, although the $d$-dimensional map might be highly fractured, drawing the map in one dimension higher "heals" the zones, which become connected. In addition, as a step toward establishing a weaker form of convexity for the $d$-dimensional map, we study the interference function and show that it satisfies the maximum principle. Finally, we turn to consider algorithmic applications, and propose a new variant of approximate point location.

Data Structures and Algorithms
Random Matrix Theory and Wireless Communication

王磊,郑宝玉,崔景伍

DOI: https://doi.org/10.3969/j.issn.1673-5439.2010.03.017

2010-01-01

Abstract:First,mathematical background of random matrix theory related to wireless communications is introduced;then the relationship between random matrix theory and wireless communications is addressed,and the question why the random matrix theory is important to wireless communications is answered;Finally,we take the performance analysis of DEC receiver with large dimensional system as an example,showing the huge power of random matrix theory to deal with the issues in wireless communications.
Concentration of Measure Inequalities in Information Theory, Communications, and Coding

Maxim Raginsky,Igal Sason

DOI: https://doi.org/10.1561/0100000064

2013-01-01

Foundations and Trends® in Communications and Information Theory

Abstract:Concentration inequalities have been the subject of exciting developments during the last two decades, and have been intensively studied and used as a powerful tool in various areas. These include convex geometry, functional analysis, statistical physics, mathematical statistics, pure and applied probability theory (e.g., concentration of measure phenomena in random graphs, random matrices, and percolation), information theory, theoretical computer science, learning theory, and dynamical systems. This monograph focuses on some of the key modern mathematical tools that are used for the derivation of concentration inequalities, on their links to information theory, and on their various applications to communications and coding. In addition to being a survey, this monograph also includes various new recent results derived by the authors. The first part of the monograph introduces classical concentration inequalities for martingales, as well as some recent refinements and extensions. The power and versatility of the martingale approach is exemplified in the context of codes defined on graphs and iterative decoding algorithms, as well as codes for wireless communication. The second part of the monograph introduces the entropy method, an information-theoretic technique for deriving concentration inequalities for functions of many independent random variables. The basic ingredients of the entropy method are discussed first in conjunction with the closely related topic of logarithmic Sobolev inequalities, which are typical of the so-called functional approach to studying the concentration of measure phenomenon. The discussion on logarithmic Sobolev inequalities is complemented by a related viewpoint based on probability in metric spaces. This viewpoint centers around the so-called transportation-cost inequalities, whose roots are in information theory. Some representative results on concentration for dependent random variables are briefly summarized, with emphasis on their connections to the entropy method. Finally, we discuss several applications of the entropy method and related information-theoretic tools to problems in communications and coding. These include strong converses, empirical distributions of good channel codes with non-vanishing error probability, and an information-theoretic converse for concentration of measure.

Mathematical Theory of Communication Networks

An Algebraic and Probabilistic Framework for Network Information Theory

A Mathematical Theory of Communication

Brief Announcement: Data Dissemination in Unified Dynamic Wireless Networks

Mathematical Foundations for Information Theory in Diffusion-Based Molecular Communications

Problems in the mathematical theory of quantum communication channels

Max-Flow Min-Cut Theorems for Multi-User Communication Networks

Recent Advances in Complex Networks Theories with Applications

Euclidean network information theory

Semantic Communications: Theories, Technologies and Applications

Towards Communication-Aware Robust Topologies

Theories of Communication Networks

Survey on Application of Communication Network Topology Simulation Technology

Information Theory in Emerging Wireless Communication Systems and Networks

Network information theory for classical-quantum channels

Several Mathematical Problems in Quantum Information Theory

Random Network Coding and Its Applications in Wireless Networks

Topology design of communication networks: a game-theoretic perspective

The Topology of Wireless Communication

Random Matrix Theory and Wireless Communication

Concentration of Measure Inequalities in Information Theory, Communications, and Coding