Capacity of an infinite family of networks related to the diamond network for fixed alphabet sizes

Sascha Kurz

2024-09-13

Abstract:We consider the problem of error correction in a network where the errors can occur only on a proper subset of the network edges. For a generalization of the so-called Diamond Network we consider lower and upper bounds for the network's (1-shot) capacity for fixed alphabet sizes.

Information Theory

What problem does this paper attempt to address?

Capacity of an infinite family of networks related to the diamond network for fixed alphabet sizes

Sascha Kurz

DOI: https://doi.org/10.1007/s10623-024-01485-9

IF: 1.4

2024-09-19

Designs Codes and Cryptography

Abstract:We consider the problem of error correction in a network where the errors can occur only on a proper subset of the network edges. For a generalization of the so-called Diamond Network we consider lower and upper bounds for the network's (1-shot) capacity for fixed alphabet sizes.

mathematics, applied,computer science, theory & methods
Network error correction with limited feedback capacity

Yanbo Yang,Tracey Ho,Wentao Huang

DOI: https://doi.org/10.48550/arXiv.1312.3823

2013-12-13

Information Theory

Abstract:We consider the problem of characterizing network capacity in the presence of adversarial errors on network links,focusing in particular on the effect of low-capacity feedback links cross network cuts.
Capacity and Achievable Rate Regions for Linear Network Coding Over Ring Alphabets

Joseph Connelly,Kenneth Zeger

DOI: https://doi.org/10.1109/tit.2018.2866244

IF: 2.5

2019-01-01

IEEE Transactions on Information Theory

Abstract:The rate of a network code is the ratio of the block size of the network’s messages to that of its edge codewords. We compare the linear capacities and achievable rate regions of networks using finite field alphabets to the more general cases of arbitrary ring and module alphabets. For non-commutative rings, two-sided linearity is allowed. Specifically, we prove the following for directed acyclic networks. First, the linear rate region and the linear capacity of any network over a finite field depend only on the characteristic of the field. Furthermore, any two fields with different characteristics yield different linear capacities for at least one network. Second, whenever the characteristic of a given finite field divides the size of a given finite ring, each network’s linear rate region over the ring is contained in its linear rate region over the field. Thus, any network’s linear capacity over a field is at least its linear capacity over any other ring of the same size. An analogous result also holds for linear network codes over module alphabets. Third, whenever the characteristic of a given finite field does not divide the size of a given finite ring, there is some network whose linear capacity over the ring is strictly greater than its linear capacity over the field. Thus, for any finite field, there always exist rings over which some networks have higher linear capacities than over the field.

computer science, information systems,engineering, electrical & electronic
Single-Source/Sink Network Error Correction Is as Hard as Multiple-Unicast

Wentao Huang,Tracey Ho,Michael Langberg,Joerg Kliewer

DOI: https://doi.org/10.48550/arXiv.1410.1905

2014-10-08

Abstract:We study the problem of communicating over a single-source single-terminal network in the presence of an adversary that may jam a single link of the network. If any one of the edges can be jammed, the capacity of such networks is well understood and follows directly from the connection between the minimum cut and maximum flow in single-source single- terminal networks. In this work we consider networks in which some edges cannot be jammed, and show that determining the network communication capacity is at least as hard as solving the multiple-unicast network coding problem for the error-free case. The latter problem is a long standing open problem.

Information Theory
Minimizing the Alphabet Size in Codes with Restricted Error Sets

Mira Gonen,Ishay Haviv,Michael Langberg,Alex Sprintson

DOI: https://doi.org/10.1109/tit.2024.3352052

IF: 2.5

2024-01-01

IEEE Transactions on Information Theory

Abstract:This paper focuses on the study of the minimum possible alphabet size of codes in a generalized setting where the coding scheme is required to handle a pre-specified set of erasure or error patterns, naturally represented by a hypergraph. The need for such codes arises in many settings of practical interest, including wireless communication and flash memory systems. In many such settings, a smaller field size is achievable than that offered by MDS and other standard codes. We establish a connection between the minimum alphabet size of codes in this generalized setting and the combinatorial properties of the hypergraph that represents the pre-specified collection of erasure or error patterns. We also establish connections between error and erasure correcting codes in our generalized setting. Finally, we consider a variation of the problem that allows a small probability of decoding error and relate it to an approximate version of hypergraph coloring.

computer science, information systems,engineering, electrical & electronic
Computation of Binary Arithmetic Sum over an Asymmetric Diamond Network

Ruze Zhang,Xuan Guang,Shenghao Yang,Xueyan Niu,Bo Bai

DOI: https://doi.org/10.1109/jsait.2024.3453273

2024-01-01

IEEE Journal on Selected Areas in Information Theory

Abstract:In this paper, the problem of zero-error network function computation is considered, where in a directed acyclic network, a single sink node is required to compute with zero error a function of the source messages that are separately generated by multiple source nodes. From the information-theoretic point of view, we are interested in the fundamental computing capacity, which is defined as the average number of times that the function can be computed with zero error for one use of the network. The explicit characterization of the computing capacity in general is overwhelming difficult. The best known upper bound applicable to arbitrary network topologies and arbitrary target functions is the one proved by Guang et al. in using an approach of the cut-set strong partition. This bound is tight for all previously considered network function computation problems whose computing capacities are known. In this paper, we consider the model of computing the binary arithmetic sum over an asymmetric diamond network, which is of great importance to illustrate the combinatorial nature of network function computation problem. First, we prove a corrected upper bound 1 by using a linear programming approach, which corrects an invalid bound previously claimed in the literature. Nevertheless, this upper bound cannot bring any improvement over the best known upper bound for this model, which is also equal to 1. Further, by developing a different graph coloring approach, we obtain an improved upper bound 1/log32+log3-1 (≈0.822). We thus show that the best known upper bound proved by Guang et al. is not tight for this model which answers the open problem that whether this bound in general is tight. On the other hand, we present an explicit code construction, which implies a lower bound 1/2log36 (≈0.815) on the computing capacity. Comparing the improved upper and lower bounds thus obtained, there exists a rough 0.007 gap between them.
On Zero-Error Capacity of Graphs with One Edge

Qi Cao,Qi Chen,Baoming Bai

2024-06-25

Abstract:In this paper, we study the zero-error capacity of channels with memory, which are represented by graphs. We provide a method to construct code for any graph with one edge, thereby determining a lower bound on its zero-error capacity. Moreover, this code can achieve zero-error capacity when the symbols in a vertex with degree one are the same. We further apply our method to the one-edge graphs representing the binary channels with two memories. There are 28 possible graphs, which can be organized into 11 categories based on their symmetries. The code constructed by our method is proved to achieve the zero-error capacity for all these graphs except for the two graphs in Case 11.

Information Theory
An Algebraic Approach to Link Failures Based on Network Coding

Kai Cai,Pingyi Fan

DOI: https://doi.org/10.1109/tit.2006.889736

IF: 2.5

2007-01-01

IEEE Transactions on Information Theory

Abstract:In this correspondence, we investigate the link failure problem based on the recent results of network coding. We propose a concept, named capacity factor of a network, which is the minimum link set that can influence the network capacity, as our basic tool. We define the capacity rank to each link of the network to characterize its criticality and present the concept of the p-stable network. Based on these notions, an upper bound for the capacity factor size is derived and a family of p-stable networks is constructed
Capacity of a Class of Multicast Tree Networks

Si-Hyeon Lee,Sae-Young Chung

DOI: https://doi.org/10.1109/tit.2013.2253871

IF: 2.5

2013-06-01

IEEE Transactions on Information Theory

Abstract:In this paper, we characterize the capacity of a new class of discrete memoryless multicast networks having a tree topology. For achievability, a novel coding scheme is constructed where some relays employ a combination of decode-and-forward and compress-and-forward and the other relays perform a random binning such that codebook constructions and relay operations are independent for each node and do not depend on the network topology. For converse, a new technique of iteratively manipulating inequalities exploiting the tree topology is used. This class of multicast tree networks includes the class of diamond networks studied by Kang and Ulukus as a special case.

computer science, information systems,engineering, electrical & electronic
The Capacity Factors of a Network

Haibin Kan,Xin Wang

DOI: https://doi.org/10.1109/icppw.2007.79

2007-01-01

Abstract:In the paper, we first investigate some properties of capacity factors of a point-to-point network, then give a new upper bound for the maximal cardinality of capacity factors, which is better than the bound in [3]. Finally, we give two definitions of the vertex capacity factors, and present a close relation between the vertex capacity factors and the edge capacity factors.
Coding for Network Coding

Andrea Montanari,Ruediger Urbanke

DOI: https://doi.org/10.48550/arXiv.0711.3935

2007-11-26

Abstract:We consider communication over a noisy network under randomized linear network coding. Possible error mechanism include node- or link- failures, Byzantine behavior of nodes, or an over-estimate of the network min-cut. Building on the work of Koetter and Kschischang, we introduce a probabilistic model for errors. We compute the capacity of this channel and we define an error-correction scheme based on random sparse graphs and a low-complexity decoding algorithm. By optimizing over the code degree profile, we show that this construction achieves the channel capacity in complexity which is jointly quadratic in the number of coded information bits and sublogarithmic in the error probability.

Information Theory,Networking and Internet Architecture
Network Communication with operators in Dedekind Finite and Stably Finite Rings

Søren Riis

DOI: https://doi.org/10.48550/arXiv.1507.01249

2015-07-05

Rings and Algebras

Abstract:Messages in communication networks often are considered as "discrete" taking values in some finite alphabet (e.g. a finite field). However, if we want to consider for example communication based on analogue signals, we will have to consider messages that might be functions selected from an infinite function space. In this paper, we extend linear network coding over finite/discrete alphabets/message space to the infinite/continuous case. The key to our approach is to view the space of operators that acts linearly on a space of signals as a module over a ring. It turns out that modules over many rings $R$ leads to unrealistic network models where communication channels have unlimited capacity. We show that a natural condition to avoid this is equivalent to the ring $R$ being Dedekind finite (or Neumann finite) i.e. each element in $R$ has a left inverse if and only if it has a right inverse. We then consider a strengthened capacity condition and show that this requirement precisely corresponds to the class of (faithful) modules over stably finite rings (or weakly finite). The introduced framework makes it possible to compare the performance of digital and analogue techniques. It turns out that within our model, digital and analogue communication outperforms each other in different situations. More specifically we construct: 1) A communications network where digital communication outperforms analogue communication. 2) A communication network where analogue communication outperforms digital communication. The performance of a communication network is in the finite case usually measured in terms band width (or capacity). We show this notion also remains valid for finite dimensional matrix rings which make it possible (in principle) to establish gain of digital versus analogue (analogue versus digital) communications.
Network Coding Capacity of Random Wireless Networks under a Signal-to-Interference-and-Noise Model

Zhenning Kong,Salah A. Aly,Emina Soljanin,Edmund M. Yeh,Andreas Klappenecker

DOI: https://doi.org/10.48550/arXiv.0708.3070

2007-08-22

Information Theory

Abstract:In this paper, we study network coding capacity for random wireless networks. Previous work on network coding capacity for wired and wireless networks have focused on the case where the capacities of links in the network are independent. In this paper, we consider a more realistic model, where wireless networks are modeled by random geometric graphs with interference and noise. In this model, the capacities of links are not independent. We consider two scenarios, single source multiple destinations and multiple sources multiple destinations. In the first scenario, employing coupling and martingale methods, we show that the network coding capacity for random wireless networks still exhibits a concentration behavior around the mean value of the minimum cut under some mild conditions. Furthermore, we establish upper and lower bounds on the network coding capacity for dependent and independent nodes. In the second one, we also show that the network coding capacity still follows a concentration behavior. Our simulation results confirm our theoretical predictions.
Design of capacity-approaching irregular low-density parity-check codes

Thomas J. Richardson,M. Amin Shokrollahi,Rüdiger L. Urbanke,T.J. Richardson,M.A. Shokrollahi,R.L. Urbanke

DOI: https://doi.org/10.1109/18.910578

IF: 2.5

2001-01-01

IEEE Transactions on Information Theory

Abstract:We design low-density parity-check (LDPC) codes that perform at rates extremely close to the Shannon capacity. The codes are built from highly irregular bipartite graphs with carefully chosen degree patterns on both sides. Our theoretical analysis of the codes is based on [1]. Assuming that the underlying communication channel is symmetric, we prove that the probability densities at the message nodes of the graph possess a certain symmetry. Using this symmetry property we then show that, under the assumption of no cycles, the message densities always converge as the number of iterations tends to infinity. Furthermore, we prove a stability condition which implies an upper bound on the fraction of errors that a belief-propagation decoder can correct when applied to a code induced from a bipartite graph with a given degree distribution. Our codes are found by optimizing the degree structure of the underlying graphs. We develop several strategies to perform this optimization. We also present some simulation results for the codes found which show that the performance of the codes is very close to the asymptotic theoretical bounds.

computer science, information systems,engineering, electrical & electronic
Bounding the Graph Capacity with Quantum Mechanics and Finite Automata

Alexander Meiburg

2024-03-17

Abstract:The zero-error capacity of a channel (or Shannon capacity of a graph) quantifies how much information can be transmitted with no risk of error. In contrast to the Shannon capacity of a channel, the zero-error capacity has not even been shown to be computable: we have no convergent upper bounds. In this work, we present a new quantity, the zero-error {\em unitary} capacity, and show that it can be succinctly represented as the tensor product value of a quantum game. By studying the structure of finite automata, we show that the unitary capacity is within a controllable factor of the zero-error capacity. This allows new upper bounds through the sum-of-squares hierarchy, which converges to the commuting operator value of the game. Under the conjecture that the commuting operator and tensor product value of this game are equal, this would yield an algorithm for computing the zero-error capacity.

Information Theory,Quantum Physics
Implementing $\Diamond P$ with Bounded Messages on a Network of ADD Channels

Saptaparni Kumar,Jennifer Welch

DOI: https://doi.org/10.48550/arXiv.1708.02906

2017-08-10

Abstract:We present an implementation of the eventually perfect failure detector ($\Diamond P$) from the original hierarchy of the Chandra-Toueg oracles on an arbitrary partitionable network composed of unreliable channels that can lose and reorder messages. Prior implementations of $\Diamond P$ have assumed different partially synchronous models ranging from bounded point-to-point message delay and reliable communication to unbounded message size and known network topologies. We implement $\Diamond P$ under very weak assumptions on an arbitrary, partitionable network composed of Average Delayed/Dropped (ADD) channels to model unreliable communication. Unlike older implementations, our failure detection algorithm uses bounded-sized messages to eventually detect all nodes that are unreachable (crashed or disconnected) from it.

Distributed, Parallel, and Cluster Computing
Capacity Factors in A Point-To-Point Network

Haibin Kan,Yuan Li,Yue Zhao

DOI: https://doi.org/10.1016/j.ins.2014.06.048

IF: 8.1

2014-01-01

Information Sciences

Abstract:In this paper, we investigate some properties on capacity factors, which were proposed to investigate the link failure problem from network coding. A capacity factor (CF) of a network is an edge set, deleting which will cause the maximum flow to decrease while deleting any proper subset will not. Generally, a k-CF is a minimal (not minimum) edge set which will cause the network maximum flow decrease by k. Under point to point acyclic scenario, we characterize all the edges which are contained in some CF, and propose an efficient algorithm to classify. And we show that all edges on some s-t path in an acyclic point-to-point acyclic network are contained in some 2-CF. We also study some other properties of CF of point to point network, and a simple relationship with CF in multicast network. On the other hand, some computational hardness results relating to capacity factors are obtained. We prove that deciding whether there is a capacity factor of a cyclic network with size not less a given number is NP-complete, and the time complexity of calculating the capacity rank is lowered bounded by solving the maximal flow. Besides that, we propose the analogous definition of CF on vertices and show it captures edge capacity factors as a special case.
Cut-Set Bounds for Networks With Zero-Delay Nodes

Silas L. Fong,Raymond W. Yeung

DOI: https://doi.org/10.1109/tit.2015.2432760

IF: 2.5

2015-07-01

IEEE Transactions on Information Theory

Abstract:In a network, a node is said to incur a delay if its encoding of each transmitted symbol involves only its received symbols obtained before the time slot in which the transmitted symbol is sent (hence the transmitted symbol sent in a time slot cannot depend on the received symbol obtained in the same time slot). A node is said to incur no delay if its received symbol obtained in a time slot is available for encoding its transmitted symbol sent in the same time slot. Under the classical model, every node in a discrete memoryless network (DMN) incurs a unit delay, and the capacity region of the DMN satisfies the well-known cut-set outer bound. In this paper, we propose a generalized model for the DMN where some nodes may incur no delay. Under our generalized model, we obtain a new cut-set outer bound, which is proved to be tight for some two-node DMN and is shown to subsume an existing cut-set bound for the causal relay network. In addition, we establish under the generalized model another cut-set outer bound on the positive-delay region—the set of achievable rate tuples under the constraint that every node incurs a delay. We use the cut-set bound on the positive-delay region to show that for some two-node DMN under the generalized model, the positive-delay region is strictly smaller than the capacity region.

computer science, information systems,engineering, electrical & electronic
Encoding of Network Protection Codes Against Link and Node Failures Over Finite Fields

Salah A. Aly,Ahmed E. Kamal

DOI: https://doi.org/10.48550/arXiv.0905.1778

2009-05-12

Abstract:Link and node failures are common two fundamental problems that affect operational networks. Hence, protection of communication networks is essential to increase their reliability, performance, and operations. Much research work has been done to protect against link and node failures, and to provide reliable solutions based on pre-defined provision or dynamic restoration of the domain. In this paper we develop network protection strategies against multiple link failures using network coding and joint capacities. In these strategies, the source nodes apply network coding for their transmitted data to provide backup copies for recovery at the receivers' nodes. Such techniques can be applied to optical, IP, and mesh networks. The encoding operations of protection codes are defined over finite fields. Furthermore, the normalized capacity of the communication network is given by $(n-t)/n$ in case of $t$ link failures. In addition, a bound on the minimum required field size is derived.

Information Theory,Cryptography and Security,Networking and Internet Architecture
Shannon capacity, Chess, DNA and Umbrellas

Oliver Knill

DOI: https://doi.org/10.48550/arXiv.2108.04994

2021-08-11

Abstract:A vexing open problem in information theory is to find the Shannon capacity of odd cyclic graphs larger than the pentagon and especially for the heptagon. Lower bounds for the capacity are obtained by solving King chess puzzles. Upper bounds are obtained by solving entanglement problems, that is to find good Lovasz umbrellas, quantum state realizations of the graph. We observe that optimal states are always pure states. The rest is expository. One general interesting question is whether the Shannon capacity is always some n-th root of the independence number of the n'th power of the graph.

Information Theory

Capacity of an infinite family of networks related to the diamond network for fixed alphabet sizes

Capacity of an infinite family of networks related to the diamond network for fixed alphabet sizes

Network error correction with limited feedback capacity

Capacity and Achievable Rate Regions for Linear Network Coding Over Ring Alphabets

Single-Source/Sink Network Error Correction Is as Hard as Multiple-Unicast

Minimizing the Alphabet Size in Codes with Restricted Error Sets

Computation of Binary Arithmetic Sum over an Asymmetric Diamond Network

On Zero-Error Capacity of Graphs with One Edge

An Algebraic Approach to Link Failures Based on Network Coding

Capacity of a Class of Multicast Tree Networks

The Capacity Factors of a Network

Coding for Network Coding

Network Communication with operators in Dedekind Finite and Stably Finite Rings

Network Coding Capacity of Random Wireless Networks under a Signal-to-Interference-and-Noise Model

Design of capacity-approaching irregular low-density parity-check codes

Bounding the Graph Capacity with Quantum Mechanics and Finite Automata

Implementing $\Diamond P$ with Bounded Messages on a Network of ADD Channels

Capacity Factors in A Point-To-Point Network

Cut-Set Bounds for Networks With Zero-Delay Nodes

Encoding of Network Protection Codes Against Link and Node Failures Over Finite Fields

Shannon capacity, Chess, DNA and Umbrellas