Network error correction with limited feedback capacity

Yanbo Yang,Tracey Ho,Wentao Huang

DOI: https://doi.org/10.48550/arXiv.1312.3823

2013-12-13

Information Theory

Abstract:We consider the problem of characterizing network capacity in the presence of adversarial errors on network links,focusing in particular on the effect of low-capacity feedback links cross network cuts.

What problem does this paper attempt to address?

Feedback Capacity over Networks

Bo Li,Guodong Shi

DOI: https://doi.org/10.48550/arXiv.1701.03186

2017-01-11

Systems and Control

Abstract:In this paper, we investigate the fundamental limitations of feedback mechanism in dealing with uncertainties for network systems. The study of maximum capability of feedback control was pioneered in Xie and Guo (2000) for scalar systems with nonparametric nonlinear uncertainty. In a network setting, nodes with unknown and nonlinear dynamics are interconnected through a directed interaction graph. Nodes can design feedback controls based on all available information, where the objective is to stabilize the network state. Using information structure and decision pattern as criteria, we specify three categories of network feedback laws, namely the global-knowledge/global-decision, network-flow/local-decision, and local-flow/local-decision feedback. We establish a series of network capacity characterizations for these three fundamental types of network control laws. First of all, we prove that for global-knowledge/global-decision and network-flow/local-decision control where nodes know the information flow across the entire network, there exists a critical number $\big(3/2+\sqrt{2}\big)/\|A_{\mathrm{G}}\|_\infty$, where $3/2+\sqrt{2}$ is as known as the Xie-Guo constant and $A_{\mathrm{G}}$ is the network adjacency matrix, defining exactly how much uncertainty in the node dynamics can be overcome by feedback. Interestingly enough, the same feedback capacity can be achieved under max-consensus enhanced local flows where nodes only observe information flows from neighbors as well as extreme (max and min) states in the network. Next, for local-flow/local-decision control, we prove that there exists a structure-determined value being a lower bound of the network feedback capacity. These results reveal the important connection between network structure and fundamental capabilities of in-network feedback control.
Single-Source/Sink Network Error Correction Is as Hard as Multiple-Unicast

Wentao Huang,Tracey Ho,Michael Langberg,Joerg Kliewer

DOI: https://doi.org/10.48550/arXiv.1410.1905

2014-10-08

Abstract:We study the problem of communicating over a single-source single-terminal network in the presence of an adversary that may jam a single link of the network. If any one of the edges can be jammed, the capacity of such networks is well understood and follows directly from the connection between the minimum cut and maximum flow in single-source single- terminal networks. In this work we consider networks in which some edges cannot be jammed, and show that determining the network communication capacity is at least as hard as solving the multiple-unicast network coding problem for the error-free case. The latter problem is a long standing open problem.

Information Theory
Coding for Network Coding

Andrea Montanari,Ruediger Urbanke

DOI: https://doi.org/10.48550/arXiv.0711.3935

2007-11-26

Abstract:We consider communication over a noisy network under randomized linear network coding. Possible error mechanism include node- or link- failures, Byzantine behavior of nodes, or an over-estimate of the network min-cut. Building on the work of Koetter and Kschischang, we introduce a probabilistic model for errors. We compute the capacity of this channel and we define an error-correction scheme based on random sparse graphs and a low-complexity decoding algorithm. By optimizing over the code degree profile, we show that this construction achieves the channel capacity in complexity which is jointly quadratic in the number of coded information bits and sublogarithmic in the error probability.

Information Theory,Networking and Internet Architecture
Capacity of an infinite family of networks related to the diamond network for fixed alphabet sizes

Sascha Kurz

DOI: https://doi.org/10.1007/s10623-024-01485-9

IF: 1.4

2024-09-19

Designs Codes and Cryptography

Abstract:We consider the problem of error correction in a network where the errors can occur only on a proper subset of the network edges. For a generalization of the so-called Diamond Network we consider lower and upper bounds for the network's (1-shot) capacity for fixed alphabet sizes.

mathematics, applied,computer science, theory & methods
Allocation of Network Error Correction Flow to Combat Byzantine Attacks

Zhiqing Xiao,Yunzhou Li,Ming Zhao,Xibin Xu,Jing Wang

DOI: https://doi.org/10.1109/tcomm.2015.2438811

IF: 6.166

2015-01-01

IEEE Transactions on Communications

Abstract:This paper studies the allocation of information flows in noiseless, memoryless communication networks in the presence of omniscient Byzantine adversary. In such networks, adversary may maliciously modify some edge-flows, and legitimate users should resort to network error correction strategies to transmit data reliably. Unlike prior papers, which focused on the capacities of the networks, we consider the expense of resources used by the flow. Hereby, this paper uses an optimization problem to define the concept of minimum cost network error correction flows. We provide a necessary and sufficient condition of feasibility of the allocation problem, and derive a cut-set outer bound on the feasible region. Using this cut-set bound, we can find the minimum cost network error correction flow in some instances. Moreover, we also consider the relationship between incoming edge-flows and outgoing edge-flows of a vertex. As for the directed acyclic graphs, we propose an algorithm to allocate the network error correction flow. This algorithm is with polynomial time complexity, and proves to be optimal when recoding at intermediate nodes is forbidden. Additionally, in order to justify the necessity of recoding at intermediate nodes, we analyze the benefit of intermediate recoding. On the one hand, we construct a series of instances to prove that intermediate recoding can bring enormous benefits in some networks. On the other hand, numerical analysis shows that the benefit is modest in small random graphs.
Opportunistic capacity and error exponent regions for compound channel with feedback

Aditya Mahajan,Sekhar Tatikonda

DOI: https://doi.org/10.48550/arXiv.0911.2023

2011-06-30

Abstract:Variable length communication over a compound channel with feedback is considered. Traditionally, capacity of a compound channel without feedback is defined as the maximum rate that is determined before the start of communication such that communication is reliable. This traditional definition is pessimistic. In the presence of feedback, an opportunistic definition is given. Capacity is defined as the maximum rate that is determined at the end of communication such that communication is reliable. Thus, the transmission rate can adapt to the channel chosen by nature. Under this definition, feedback communication over a compound channel is conceptually similar to multi-terminal communication. Transmission rate is a vector rather than a scalar; channel capacity is a region rather than a scalar; error exponent is a region rather than a scalar. In this paper, variable length communication over a compound channel with feedback is formulated, its opportunistic capacity region is characterized, and lower bounds for its error exponent region are provided..

Information Theory
Bounds for the capacity error function for unidirectional channels with noiseless feedback

Christian Deppe,Vladimir Lebedev,Georg Maringer

DOI: https://doi.org/10.48550/arXiv.2001.09030

2020-04-28

Abstract:In digital systems such as fiber optical communications, the ratio between probability of errors of type $1\to 0$ and $0 \to 1$ can be large. Practically, one can assume that only one type of error can occur. These errors arecalled asymmetric. Unidirectional errors differ from asymmetric type of errors; here both $1 \to 0$ and $0 \to 1$ type of errors are possible, but in any submittedcodeword all the errors are of the same type. This can be generalized for the $q$-ary case. We consider $q$-ary unidirectional channels with feedback and give bounds for the capacity error function. It turns out that the bounds depend on the parity of the alphabet $q$. Furthermore, we show that for feedback, the capacity error function for the binary asymmetric channel is different from the symmetric channel. This is in contrast to the behavior of the function without feedback.

Information Theory
Refined Coding Bounds and Code Constructions for Coherent Network Error Correction

Shenghao Yang,Raymond W. Yeung,Chi Kin Ngai

DOI: https://doi.org/10.1109/tit.2011.2106930

IF: 2.5

2011-03-01

IEEE Transactions on Information Theory

Abstract:Coherent network error correction is the error-control problem in network coding with the knowledge of the network codes at the source and sink nodes. With respect to a given set of local encoding kernels defining a linear network code, we obtain refined versions of the Hamming bound, the Singleton bound, and the Gilbert–Varshamov bound for coherent network error correction. Similar to its classical counterpart, this refined Singleton bound is tight for linear network codes. The tightness of this refined bound is shown by two construction algorithms of linear network codes achieving this bound. These two algorithms illustrate different design methods: one makes use of existing network coding algorithms for error-free transmission and the other makes use of classical error-correcting codes. The implication of the tightness of the refined Singleton bound is that the sink nodes with higher maximum flow values can have higher error correction capabilities.

computer science, information systems,engineering, electrical & electronic
Balancing forward and feedback error correction for erasure channels with unreliable feedback

Anant Sahai

DOI: https://doi.org/10.48550/arXiv.0712.0871

2007-12-06

Information Theory

Abstract:The traditional information theoretic approach to studying feedback is to consider ideal instantaneous high-rate feedback of the channel outputs to the encoder. This was acceptable in classical work because the results were negative: Shannon pointed out that even perfect feedback often does not improve capacity and in the context of symmetric DMCs, Dobrushin showed that it does not improve the fixed block-coding error exponents in the interesting high rate regime. However, it has recently been shown that perfect feedback does allow great improvements in the asymptotic tradeoff between end-to-end delay and probability of error, even for symmetric channels at high rate. Since gains are claimed with ideal instantaneous feedback, it is natural to wonder whether these improvements remain if the feedback is unreliable or otherwise limited. Here, packet-erasure channels are considered on both the forward and feedback links. First, the feedback channel is considered as a given and a strategy is given to balance forward and feedback error correction in the suitable information-theoretic limit of long end-to-end delays. At high enough rates, perfect-feedback performance is asymptotically attainable despite having only unreliable feedback! Second, the results are interpreted in the zero- sum case of "half-duplex" nodes where the allocation of bandwidth or time to the feedback channel comes at the direct expense of the forward channel. It turns out that even here, feedback is worthwhile since dramatically lower asymptotic delays are possible by appropriately balancing forward and feedback error correction. The results easily generalize to channels with strictly positive zero-undeclared-error capacities.
The adaptive zero-error capacity for a class of channels with noisy feedback

Meysam Asadi,Natasha Devroye

DOI: https://doi.org/10.48550/arXiv.1704.01215

2017-04-04

Information Theory

Abstract:The adaptive zero-error capacity of discrete memoryless channels (DMC) with noiseless feedback has been shown to be positive whenever there exists at least one channel output "disprover", i.e. a channel output that cannot be reached from at least one of the inputs. Furthermore, whenever there exists a disprover, the adaptive zero-error capacity attains the Shannon (small-error) capacity. Here, we study the zero-error capacity of a DMC when the channel feedback is noisy rather than perfect. We show that the adaptive zero-error capacity with noisy feedback is lower bounded by the forward channel's zero-undetected error capacity, and show that under certain conditions this is tight.
An Algebraic Approach to Link Failures Based on Network Coding

Kai Cai,Pingyi Fan

DOI: https://doi.org/10.1109/tit.2006.889736

IF: 2.5

2007-01-01

IEEE Transactions on Information Theory

Abstract:In this correspondence, we investigate the link failure problem based on the recent results of network coding. We propose a concept, named capacity factor of a network, which is the minimum link set that can influence the network capacity, as our basic tool. We define the capacity rank to each link of the network to characterize its criticality and present the concept of the p-stable network. Based on these notions, an upper bound for the capacity factor size is derived and a family of p-stable networks is constructed
Network Coding Capacity of Random Wireless Networks under a Signal-to-Interference-and-Noise Model

Zhenning Kong,Salah A. Aly,Emina Soljanin,Edmund M. Yeh,Andreas Klappenecker

DOI: https://doi.org/10.48550/arXiv.0708.3070

2007-08-22

Information Theory

Abstract:In this paper, we study network coding capacity for random wireless networks. Previous work on network coding capacity for wired and wireless networks have focused on the case where the capacities of links in the network are independent. In this paper, we consider a more realistic model, where wireless networks are modeled by random geometric graphs with interference and noise. In this model, the capacities of links are not independent. We consider two scenarios, single source multiple destinations and multiple sources multiple destinations. In the first scenario, employing coupling and martingale methods, we show that the network coding capacity for random wireless networks still exhibits a concentration behavior around the mean value of the minimum cut under some mild conditions. Furthermore, we establish upper and lower bounds on the network coding capacity for dependent and independent nodes. In the second one, we also show that the network coding capacity still follows a concentration behavior. Our simulation results confirm our theoretical predictions.
Capacity Consideration under Cooperation and Relay in Mobile Ad Hoc Networks

Hong-Wa Yang,Gao-Feng Pan,Hui Li,Zhe-Ming Lu

DOI: https://doi.org/10.1109/imccc.2012.143

2012-01-01

Abstract:Non-ergodicity limits the utilization of Shannon capacity in mobile Ad hoc networks (MANET). Three definitions of function capacity, outage capacity and expected capacity in network information theory are narrated. Multiple-input and multiple-output, relay and conferencing are usually adopted for cooperation in MANET to tackle the problems of dynamic channel state information and non-equilibrium. The capacity, which is the fundamental performance upper bound, together with layerless dynamic network design and combined optimization are three key issues when considering usability and utility in MANET. These three research areas comprise an interdisciplinary approach beyond traditional Shannon theory that could hold much promise for breakthroughs in establishing the fundamental performance limits of wireless ad hoc networks and the applications that utilize them.
Capacity of Byzantine Consensus with Capacity-Limited Point-to-Point Links

Guanfeng Liang,Nitin Vaidya

DOI: https://doi.org/10.48550/arXiv.1104.0043

2011-03-31

Distributed, Parallel, and Cluster Computing

Abstract:We consider the problem of maximizing the throughput of Byzantine consensus, when communication links have finite capacity. Byzantine consensus is a classical problem in distributed computing. In existing literature, the communication links are implicitly assumed to have infinite capacity. The problem changes significantly when the capacity of links is finite. We define the throughput and capacity of consensus, and identify upper bound of achievable consensus throughput. We propose an algorithm that achieves consensus capacity in complete four-node networks with at most 1 failure with arbitrary distribution of link capacities.
Protection Against Link Errors and Failures Using Network Coding

Shizheng Li,A Ramamoorthy,Aditya Ramamoorthy

DOI: https://doi.org/10.1109/tcomm.2011.120710.090455

IF: 6.166

2011-02-01

IEEE Transactions on Communications

Abstract:We propose a network-coding based scheme to protect multiple bidirectional unicast connections against adversarial errors and failures in a network. The network consists of a set of bidirectional primary path connections that carry the uncoded traffic. The end nodes of the bidirectional connections are connected by a set of shared protection paths that provide the redundancy required for protection. Such protection strategies are employed in the domain of optical networks for recovery from failures. In this work we consider the problem of simultaneous protection against adversarial errors and failures. Suppose that ne paths are corrupted by the omniscient adversary. Under our proposed protocol, the errors can be corrected at all the end nodes with 4ne protection paths. More generally, if there are ne adversarial errors and nf failures, 4ne + 2nf protection paths are sufficient. The number of protection paths only depends on the number of errors and failures being protected against and is independent of the number of unicast connections.

telecommunications,engineering, electrical & electronic
A characterization of the capacity of online (causal) binary channels

Zitan Chen,Sidharth Jaggi,Michael Langberg

DOI: https://doi.org/10.48550/arXiv.1412.6376

2014-12-19

Abstract:In the binary online (or "causal") channel coding model, a sender wishes to communicate a message to a receiver by transmitting a codeword $\mathbf{x} =(x_1,\ldots,x_n) \in \{0,1\}^n$ bit by bit via a channel limited to at most $pn$ corruptions. The channel is "online" in the sense that at the $i$th step of communication the channel decides whether to corrupt the $i$th bit or not based on its view so far, i.e., its decision depends only on the transmitted bits $(x_1,\ldots,x_i)$. This is in contrast to the classical adversarial channel in which the error is chosen by a channel that has a full knowledge on the sent codeword $\mathbf{x}$. In this work we study the capacity of binary online channels for two corruption models: the {\em bit-flip} model in which the channel may flip at most $pn$ of the bits of the transmitted codeword, and the {\em erasure} model in which the channel may erase at most $pn$ bits of the transmitted codeword. Specifically, for both error models we give a full characterization of the capacity as a function of $p$. The online channel (in both the bit-flip and erasure case) has seen a number of recent studies which present both upper and lower bounds on its capacity. In this work, we present and analyze a coding scheme that improves on the previously suggested lower bounds and matches the previously suggested upper bounds thus implying a tight characterization.

Information Theory
On the Capacity Region of Broadcast Packet Erasure Relay Networks With Feedback

Quan Geng,Hieu T. Do,Rui Wu,Mindi Yuan,Yun Li,Wei Ding

DOI: https://doi.org/10.48550/arXiv.1312.1727

2019-05-17

Abstract:We derive a new outer bound on the capacity region of broadcast traffic in multiple input broadcast packet erasure channels with feedback, and extend this outer bound to packet erasure relay networks with feedback. We show the tightness of the outer bound for various classes of networks. An important engineering implication of this work is that for network coding schemes for parallel broadcast channels, the `xor' packets should be sent over correlated broadcast subchannels.

Information Theory
Maxflow-Based Bounds for Low-Rate Information Propagation over Noisy Networks

Yan Hao Ling,Jonathan Scarlett

2023-04-05

Abstract:We study error exponents for the problem of low-rate communication over a directed graph, where each edge in the graph represents a noisy communication channel, and there is a single source and destination. We derive maxflow-based achievability and converse bounds on the error exponent that match when there are two messages and all channels satisfy a symmetry condition called pairwise reversibility. More generally, we show that the upper and lower bounds match to within a factor of 4. We also show that with three messages there are cases where the maxflow-based error exponent is strictly suboptimal, thus showing that our tightness result cannot be extended beyond two messages without further assumptions.

Information Theory
Capacity Factors in A Point-To-Point Network

Haibin Kan,Yuan Li,Yue Zhao

DOI: https://doi.org/10.1016/j.ins.2014.06.048

IF: 8.1

2014-01-01

Information Sciences

Abstract:In this paper, we investigate some properties on capacity factors, which were proposed to investigate the link failure problem from network coding. A capacity factor (CF) of a network is an edge set, deleting which will cause the maximum flow to decrease while deleting any proper subset will not. Generally, a k-CF is a minimal (not minimum) edge set which will cause the network maximum flow decrease by k. Under point to point acyclic scenario, we characterize all the edges which are contained in some CF, and propose an efficient algorithm to classify. And we show that all edges on some s-t path in an acyclic point-to-point acyclic network are contained in some 2-CF. We also study some other properties of CF of point to point network, and a simple relationship with CF in multicast network. On the other hand, some computational hardness results relating to capacity factors are obtained. We prove that deciding whether there is a capacity factor of a cyclic network with size not less a given number is NP-complete, and the time complexity of calculating the capacity rank is lowered bounded by solving the maximal flow. Besides that, we propose the analogous definition of CF on vertices and show it captures edge capacity factors as a special case.

Network error correction with limited feedback capacity

Feedback Capacity over Networks

Single-Source/Sink Network Error Correction Is as Hard as Multiple-Unicast

Coding for Network Coding

Capacity of an infinite family of networks related to the diamond network for fixed alphabet sizes

Allocation of Network Error Correction Flow to Combat Byzantine Attacks

Opportunistic capacity and error exponent regions for compound channel with feedback

Bounds for the capacity error function for unidirectional channels with noiseless feedback

Refined Coding Bounds and Code Constructions for Coherent Network Error Correction

Balancing forward and feedback error correction for erasure channels with unreliable feedback

The adaptive zero-error capacity for a class of channels with noisy feedback

An Algebraic Approach to Link Failures Based on Network Coding

Network Coding Capacity of Random Wireless Networks under a Signal-to-Interference-and-Noise Model

Capacity Consideration under Cooperation and Relay in Mobile Ad Hoc Networks

Capacity of Byzantine Consensus with Capacity-Limited Point-to-Point Links

Protection Against Link Errors and Failures Using Network Coding

A characterization of the capacity of online (causal) binary channels

On the Capacity Region of Broadcast Packet Erasure Relay Networks With Feedback

Maxflow-Based Bounds for Low-Rate Information Propagation over Noisy Networks

Capacity Factors in A Point-To-Point Network