State-Dependent Channels with a Message-Cognizant Helper

Amos Lapidoth,Ligong Wang,Yiming Yan

2023-11-14

Abstract:The capacity of a state-dependent discrete memoryless channel (SD-DMC) is derived for the setting where a message-cognizant rate-limited helper observes the state sequence noncausally, produces its description, and provides the description to both encoder and decoder.

Information Theory

What problem does this paper attempt to address?

State-Dependent DMC with a Causal Helper

Amos Lapidoth,Ligong Wang

2023-08-13

Abstract:A memoryless state sequence governing the behavior of a memoryless state-dependent channel is to be described causally to an encoder wishing to communicate over said channel. Given the maximal-allowed description rate, we seek the description that maximizes the Shannon capacity. It is shown that the maximum need not be achieved by a memoryless (symbol-by-symbol) description. Such descriptions are, however, optimal when the receiver is cognizant of the state sequence or when the description is allowed to depend on the message. For other cases, a block-Markov scheme with backward decoding is proposed.

Information Theory
The State-Dependent Channel with a Rate-Limited Cribbing Helper

Amos Lapidoth,Yossef Steinberg

2024-01-23

Abstract:The capacity of a memoryless state-dependent channel is derived for a setting in which the encoder is provided with rate-limited assistance from a cribbing helper that observes the state sequence causally and the past channel inputs strictly-causally. Said cribbing may increase capacity but not to the level achievable by a message-cognizant helper.

Information Theory
An Achievable Rate-Distortion Region for Joint State and Message Communication over Multiple Access Channels

Xinyang Li,Vlad C. Andrei,Ullrich J. Mönich,Holger Boche

2024-09-26

Abstract:This paper derives an achievable rate-distortion (R-D) region for the state-dependent discrete memoryless multiple access channel (SD-DMMAC), where the generalized feedback and causal side information are present at encoders, and the decoder performs the joint task of message decoding and state estimation. The Markov coding and backward-forward two-stage decoding schemes are adopted in the proof. This scenario is shown to be capable of modeling various integrated sensing and communication (ISAC) applications, including the monostatic-uplink system and multi-modal sensor networks, which are then studied as examples.

Information Theory
The State-Dependent Multiple-Access Channel with States Available at a Cribbing Encoder

Shraga I. Bross,Amos Lapidoth

DOI: https://doi.org/10.48550/arXiv.1007.3896

2010-07-22

Abstract:The two-user discrete memoryless state-dependent multiple-access channel (MAC) models a scenario in which two encoders transmit independent messages to a single receiver via a MAC whose channel law is governed by the pair of encoders' inputs and by an i.i.d. state random variable. In the cooperative state-dependent MAC model it is further assumed that Message 1 is shared by both encoders whereas Message 2 is known only to Encoder 2 - the cognitive transmitter. The capacity of the cooperative state-dependent MAC where the realization of the state sequence is known non-causally to the cognitive encoder has been derived by Somekh-Baruch et. al. In this work we dispense of the assumption that Message 1 is shared a-priori by both encoders. Instead, we study the case in which Encoder 2 cribs causally from Encoder 1. We determine the capacity region for both, the case where Encoder 2 cribs strictly causal and the case where Encoder 2 cribs causally from Encoder 1.

Information Theory
Message and State Cooperation in a Relay Channel when Only the Relay Knows the State

Min Li,Osvaldo Simeone,Aylin Yener

DOI: https://doi.org/10.48550/arxiv.1102.0768

2011-01-01

Abstract:A state-dependent relay channel is studied in which strictly causal channelstate information is available at the relay and no state information isavailable at the source and destination. The source and the relay are connectedvia two unidirectional out-of-band orthogonal links of finite capacity, and astate-dependent memoryless channel connects the source and the relay, on oneside, and the destination, on the other. Via the orthogonal links, the sourcecan convey information about the message to be delivered to the destination tothe relay while the relay can forward state information to the source. Thisexchange enables cooperation between the source and the relay on transmissionof message and state information to the destination. First, two achievableschemes are proposed that exploit both message and state cooperation. It isshown that a transmission scheme inspired by noisy network coding performsbetter than a strategy based on block Markov coding and backward decoding.Next, based on the given achievable schemes and appropriate upper bounds,capacity results are identified for some special cases. Finally, a Gaussianmodel is studied, along with corresponding numerical results that illuminatethe relative merits of state and message cooperation.
Joint Identification and Sensing for Discrete Memoryless Channels

Wafa Labidi,Christian Deppe,Holger Boche

2023-05-11

Abstract:In the identification (ID) scheme proposed by Ahlswede and Dueck, the receiver only checks whether a message of special interest to him has been sent or not. In contrast to Shannon transmission codes, the size of ID codes for a Discrete Memoryless Channel (DMC) grows doubly exponentially fast with the blocklength, if randomized encoding is used. This groundbreaking result makes the ID paradigm more efficient than the classical Shannon transmission in terms of necessary energy and hardware components. Further gains can be achieved by taking advantage of additional resources such as feedback. We study the problem of joint ID and channel state estimation over a DMC with independent and identically distributed (i.i.d.) state sequences. The sender simultaneously sends an ID message over the DMC with a random state and estimates the channel state via a strictly causal channel output. The random channel state is available to neither the sender nor the receiver. For the proposed system model, we establish a lower bound on the ID capacity-distortion function.

Information Theory
Generalized Modeling and Fundamental Limits for Multiple-Access Integrated Sensing and Communication Systems

Yao Liu,Min Li,An Liu,Jianmin Lu,Tony Xiao Han

2022-01-01

Abstract: In this paper, we propose a generalized state-dependent channel modeling and present fundamental limits for multiple-access integrated sensing and communication (ISAC) systems. The model proposed extends the latest studies by Kobayashi et al. and Ahmadipour et al., which explicitly accounts for more practical scenarios with correlated sensing and channel states, and imperfect channel state information at receiver (CSIR). For the model considered, we devise an achievable scheme that combines message cooperation and joint compression of past transmitted codeword and echo signals (a form of strictly causal feedback) via distributed Wyner-Ziv coding at each user to realize "simultaneously cooperative communication and sensing". The corresponding achievable rate-distortion region is derived and a numerical example is constructed to illustrate the potential gain of the proposed scheme. It is found that the compressed information sent is not only useful for further enhancing communication (particularly in the case without CSIR), but also helpful in improving the sensing performance of the transmitters.
Message and State Cooperation in a Relay Channel when the Relay Has Strictly Causal State Information

Min Li,Osvaldo Simeone,Aylin Yener

DOI: https://doi.org/10.1109/ita.2011.5743602

2011-01-01

Abstract:A state-dependent relay channel is studied in which strictly causal channel state information is available at the relay and no state information is available at the source and destination. Source and relay are connected via two unidirectional out-of-band orthogonal links of finite capacity, and a state-dependent memoryless channel connects source and relay, on one side, and the destination, on the other. Via the orthogonal links, the source can convey information about the message to be delivered to the destination to the relay while the relay can forward state information to the source. This exchange enables cooperation between source and relay on both transmission of message and state information to the destination. First, an achievable scheme, inspired by noisy network coding, is proposed that exploits both message and state cooperation. Next, based on the given achievable rate and appropriate upper bounds, capacity results are identified for some special cases. Finally, a Gaussian model is studied, along with corresponding numerical results that illuminate the relative merits of state and message cooperation.
Wiretap Channel with Action-Dependent Channel State Information

Bin Dai,A. J. Han Vinck,Yuan Luo,Xiaohu Tang

DOI: https://doi.org/10.3390/e15020445

IF: 2.738

2013-01-01

Entropy

Abstract:In this paper, we investigate the model of wiretap channel with action-dependent channel state information. Given the message to be communicated, the transmitter chooses an action sequence that affects the formation of the channel states, and then generates the channel input sequence based on the state sequence and the message. The main channel and the wiretap channel are two discrete memoryless channels (DMCs), and they are connected with the legitimate receiver and the wiretapper, respectively. Moreover, the transition probability distribution of the main channel depends on the channel state. Measuring wiretapper’s uncertainty about the message by equivocation, inner and outer bounds on the capacity-equivocation region are provided both for the case where the channel inputs are allowed to depend non-causally on the state sequence and the case where they are restricted to causal dependence. Furthermore, the secrecy capacities for both cases are bounded, which provide the best transmission rate with perfect secrecy. The result is further explained via a binary example.
An Analysis of Capacity-Distortion Trade-Offs in Memoryless ISAC Systems

Xinyang Li,Vlad C. Andrei,Aladin Djuhera,Ullrich J. Mönich,Holger Boche

2024-03-28

Abstract:This manuscript investigates the information-theoretic limits of integrated sensing and communications (ISAC), aiming for simultaneous reliable communication and precise channel state estimation. We model such a system with a state-dependent discrete memoryless channel (SD-DMC) with present or absent channel feedback and generalized side information at the transmitter and the receiver, where the joint task of message decoding and state estimation is performed at the receiver. The relationship between the achievable communication rate and estimation error, the capacity-distortion (C-D) trade-off, is characterized across different causality levels of the side information. This framework is shown to be capable of modeling various practical scenarios by assigning the side information with different meanings, including monostatic and bistatic radar systems. The analysis is then extended to the two-user degraded broadcast channel, and we derive an achievable C-D region that is tight under certain conditions. To solve the optimization problem arising in the computation of C-D functions/regions, we propose a proximal block coordinate descent (BCD) method, prove its convergence to a stationary point, and derive a stopping criterion. Finally, several representative examples are studied to demonstrate the versatility of our framework and the effectiveness of the proposed algorithm.

Information Theory,Signal Processing
Multiple Access Channels with States Causally Known at Transmitters

Min Li,Osvaldo Simeone,Aylin Yener

DOI: https://doi.org/10.1109/tit.2012.2229459

IF: 2.5

2013-01-01

IEEE Transactions on Information Theory

Abstract:It has been recently shown by Lapidoth and Steinberg that strictly causal state information can be beneficial in multiple access channels (MACs). Specifically, it was proved that the capacity region of a two-user MAC with independent states, each known strictly causally to one encoder, can be enlarged by letting the encoders send compressed past state information to the decoder. In this study, a generalization of the said strategy is proposed whereby the encoders compress also the past transmitted codewords along with the past state sequences. The proposed scheme uses a combination of long-message encoding, compression of the past state sequences and codewords without binning, and joint decoding over all transmission blocks. The proposed strategy has been recently shown by Lapidoth and Steinberg to strictly improve upon the original one. Capacity results are then derived for a class of channels that include two-user modulo-additive state-dependent MACs. Moreover, the proposed scheme is extended to state-dependent MACs with an arbitrary number of users. Finally, output feedback is introduced and an example is provided to illustrate the interplay between feedback and availability of strictly causal state information in enlarging the capacity region.
Achievable Rate Regions for Discrete Memoryless Interference Channel with State Information

Lili Zhang,Jinhua Jiang,Shuguang Cui

DOI: https://doi.org/10.1109/icc.2011.5962600

2011-06-01

Abstract:In this paper, we study the state-dependent two-user interference channel, where the state information is noncausally known at both transmitters but unknown to either of the receivers. We propose two coding schemes for the discrete memoryless case: simultaneous encoding for the sub-messages in the first one and superposition encoding in the second one, both with rate splitting and Gel'fand-Pinsker coding. The corresponding achievable rate regions are established.
PAC Learnability for Reliable Communication over Discrete Memoryless Channels

Jiakun Liu,Wenyi Zhang,H. Vincent Poor

2024-04-22

Abstract:In practical communication systems, knowledge of channel models is often absent, and consequently, transceivers need be designed based on empirical data. In this work, we study data-driven approaches to reliably choosing decoding metrics and code rates that facilitate reliable communication over unknown discrete memoryless channels (DMCs). Our analysis is inspired by the PAC (probably approximately correct) learning theory and does not rely on any assumptions on the statistical characteristics of DMCs. We show that a naive plug-in algorithm for choosing decoding metrics is likely to fail for finite training sets. We propose an alternative algorithm called the virtual sample algorithm and establish a non-asymptotic lower bound on its performance. The virtual sample algorithm is then used as a building block for constructing a learning algorithm that chooses a decoding metric and a code rate using which a transmitter and a receiver can reliably communicate at a rate arbitrarily close to the channel mutual information. Therefore, we conclude that DMCs are PAC learnable.

Information Theory
On Mismatched Oblivious Relaying

Michael Dikshtein,Nir Weinberger,Shlomo Shamai

2023-05-02

Abstract:We consider the problem of reliable communication over a discrete memoryless channel (DMC) with the help of a relay, termed the information bottleneck (IB) channel. There is no direct link between the source and the destination, and the information flows in two hops. The first hop is a noisy channel from the source to the relay. The second hop is a noiseless but limited-capacity backhaul link from the relay to the decoder. We further assume that the relay is oblivious to the transmission codebook. We examine two mismatch scenarios. In the first setting, we assume the decoder is restricted to use some fixed decoding rule, which is mismatched to the actual channel. In the second setting, we assume that the relay is restricted to use some fixed compression metric, which is again mismatched to the statistics of the relay input. We establish bounds on the random- coding capacity of both settings, some of which are shown to be ensemble tight.

Information Theory
Interference Channel with State Information

Lili Zhang,Jinhua Jiang,Shuguang Cui

DOI: https://doi.org/10.48550/arXiv.1104.3661

2012-04-13

Abstract:In this paper, we study the state-dependent two-user interference channel, where the state information is non-causally known at both transmitters but unknown to either of the receivers. We first propose two coding schemes for the discrete memoryless case: simultaneous encoding for the sub-messages in the first one and superposition encoding in the second one, both with rate splitting and Gel'fand-Pinsker coding. The corresponding achievable rate regions are established. Moreover, for the Gaussian case, we focus on the simultaneous encoding scheme and propose an \emph{active interference cancellation} mechanism, which is a generalized dirty-paper coding technique, to partially eliminate the state effect at the receivers. The corresponding achievable rate region is then derived. We also propose several heuristic schemes for some special cases: the strong interference case, the mixed interference case, and the weak interference case. For the strong and mixed interference case, numerical results are provided to show that active interference cancellation significantly enlarges the achievable rate region. For the weak interference case, flexible power splitting instead of active interference cancellation improves the performance significantly.

Information Theory
On the Multiple Access Channel with Asymmetric Noisy State Information at the Encoders

Nevroz Şen,Fady Alajaji,Serdar Yüksel,Giacomo Como

DOI: https://doi.org/10.48550/arXiv.1201.4109

2012-01-20

Abstract:We consider the problem of reliable communication over multiple-access channels (MAC) where the channel is driven by an independent and identically distributed state process and the encoders and the decoder are provided with various degrees of asymmetric noisy channel state information (CSI). For the case where the encoders observe causal, asymmetric noisy CSI and the decoder observes complete CSI, we provide inner and outer bounds to the capacity region, which are tight for the sum-rate capacity. We then observe that, under a Markov assumption, similar capacity results also hold in the case where the receiver observes noisy CSI. Furthermore, we provide a single letter characterization for the capacity region when the CSI at the encoders are asymmetric deterministic functions of the CSI at the decoder and the encoders have non-causal noisy CSI (its causal version is recently solved in \cite{como-yuksel}). When the encoders observe asymmetric noisy CSI with asymmetric delays and the decoder observes complete CSI, we provide a single letter characterization for the capacity region. Finally, we consider a cooperative scenario with common and private messages, with asymmetric noisy CSI at the encoders and complete CSI at the decoder. We provide a single letter expression for the capacity region for such channels. For the cooperative scenario, we also note that as soon as the common message encoder does not have access to CSI, then in any noisy setup, covering the cases where no CSI or noisy CSI at the decoder, it is possible to obtain a single letter characterization for the capacity region. The main component in these results is a generalization of a converse coding approach, recently introduced in [1] for the MAC with asymmetric quantized CSI at the encoders and herein considerably extended and adapted for the noisy CSI setup.

Information Theory
On Strong Secrecy for Multiple Access Channel with States and Causal CSI

Yiqi Chen,Tobias Oechtering,Mikael Skoglund,Yuan Luo

2023-05-02

Abstract:Strong secrecy communication over a discrete memoryless state-dependent multiple access channel (SD-MAC) with an external eavesdropper is investigated. The channel is governed by discrete memoryless and i.i.d. channel states and the channel state information (CSI) is revealed to the encoders in a causal manner. An inner bound of the capacity is provided. To establish the inner bound, we investigate coding schemes incorporating wiretap coding and secret key agreement between the sender and the legitimate receiver. Two kinds of block Markov coding schemes are studied. The first one uses backward decoding and Wyner-Ziv coding and the secret key is constructed from a lossy reproduction of the CSI. The other one is an extended version of the existing coding scheme for point-to-point wiretap channels with causal CSI. We further investigate some capacity-achieving cases for state-dependent multiple access wiretap channels (SD-MAWCs) with degraded message sets. It turns out that the two coding schemes are both optimal in these cases.

Information Theory
State of the cognitive interference channel: a new unified inner bound

Stefano Rini,Daniela Tuninetti,Natasha Devroye

DOI: https://doi.org/10.48550/arXiv.0910.3028

2010-03-20

Abstract:The capacity region of the interference channel in which one transmitter non-causally knows the message of the other, termed the cognitive interference channel, has remained open since its inception in 2005. A number of subtly differing achievable rate regions and outer bounds have been derived, some of which are tight under specific conditions. In this work we present a new unified inner bound for the discrete memoryless cognitive interference channel. We show explicitly how it encompasses all known discrete memoryless achievable rate regions as special cases. The presented achievable region was recently used in deriving the capacity region of the general deterministic cognitive interference channel, and thus also the linear high-SNR deterministic approximation of the Gaussian cognitive interference channel. The high-SNR deterministic approximation was then used to obtain the capacity of the Gaussian cognitive interference channel to within 1.87 bits.

Information Theory
Maximal-Capacity Discrete Memoryless Channel Identification

Maximilian Egger,Rawad Bitar,Antonia Wachter-Zeh,Deniz Gündüz,Nir Weinberger

2024-01-19

Abstract:The problem of identifying the channel with the highest capacity among several discrete memoryless channels (DMCs) is considered. The problem is cast as a pure-exploration multi-armed bandit problem, which follows the practical use of training sequences to sense the communication channel statistics. A capacity estimator is proposed and tight confidence bounds on the estimator error are derived. Based on this capacity estimator, a gap-elimination algorithm termed BestChanID is proposed, which is oblivious to the capacity-achieving input distribution and is guaranteed to output the DMC with the largest capacity, with a desired confidence. Furthermore, two additional algorithms NaiveChanSel and MedianChanEl, that output with certain confidence a DMC with capacity close to the maximal, are introduced. Each of those algorithms is beneficial in a different regime and can be used as a subroutine in BestChanID. The sample complexity of all algorithms is analyzed as a function of the desired confidence parameter, the number of channels, and the channels' input and output alphabet sizes. The cost of best channel identification is shown to scale quadratically with the alphabet size, and a fundamental lower bound for the required number of channel senses to identify the best channel with a certain confidence is derived.

Information Theory,Machine Learning
Broadcast Channels with Cooperating Decoders

Ron Dabora,Sergio D. Servetto

DOI: https://doi.org/10.1109/TIT.2006.885478

2006-11-01

Abstract:We consider the problem of communicating over the general discrete memoryless broadcast channel (BC) with partially cooperating receivers. In our setup, receivers are able to exchange messages over noiseless conference links of finite capacities, prior to decoding the messages sent from the transmitter. In this paper we formulate the general problem of broadcast with cooperation. We first find the capacity region for the case where the BC is physically degraded. Then, we give achievability results for the general broadcast channel, for both the two independent messages case and the single common message case.

Information Theory

State-Dependent Channels with a Message-Cognizant Helper

State-Dependent DMC with a Causal Helper

The State-Dependent Channel with a Rate-Limited Cribbing Helper

An Achievable Rate-Distortion Region for Joint State and Message Communication over Multiple Access Channels

The State-Dependent Multiple-Access Channel with States Available at a Cribbing Encoder

Message and State Cooperation in a Relay Channel when Only the Relay Knows the State

Joint Identification and Sensing for Discrete Memoryless Channels

Generalized Modeling and Fundamental Limits for Multiple-Access Integrated Sensing and Communication Systems

Message and State Cooperation in a Relay Channel when the Relay Has Strictly Causal State Information

Wiretap Channel with Action-Dependent Channel State Information

An Analysis of Capacity-Distortion Trade-Offs in Memoryless ISAC Systems

Multiple Access Channels with States Causally Known at Transmitters

Achievable Rate Regions for Discrete Memoryless Interference Channel with State Information

PAC Learnability for Reliable Communication over Discrete Memoryless Channels

On Mismatched Oblivious Relaying

Interference Channel with State Information

On the Multiple Access Channel with Asymmetric Noisy State Information at the Encoders

On Strong Secrecy for Multiple Access Channel with States and Causal CSI

State of the cognitive interference channel: a new unified inner bound

Maximal-Capacity Discrete Memoryless Channel Identification

Broadcast Channels with Cooperating Decoders