Abstract:Channels with synchronization errors, exhibiting deletion and insertion errors, find practical applications in DNA storage, data reconstruction, and various other domains. Presence of insertions and deletions render the channel with memory, complicating capacity analysis. For instance, despite the formulation of an independent and identically distributed (i.i.d.) deletion channel more than fifty years ago, and proof that the channel is information stable, hence its Shannon capacity exists, calculation of the capacity remained elusive. However, a relatively recent result establishes the capacity of the deletion channel in the asymptotic regime of small deletion probabilities by computing the dominant terms of the capacity expansion. This paper extends that result to binary insertion channels, determining the dominant terms of the channel capacity for small insertion probabilities and establishing capacity in this asymptotic regime. Specifically, we consider two i.i.d. insertion channel models: insertion channel with possible random bit insertions after every transmitted bit and the Gallager insertion model, for which a bit is replaced by two random bits with a certain probability. To prove our results, we build on methods used for the deletion channel, employing Bernoulli(1/2) inputs for achievability and coupling this with a converse using stationary and ergodic processes as inputs, and show that the channel capacity differs only in the higher order terms from the achievable rates with i.i.d. inputs. The results, for instance, show that the capacity of the random insertion channel is higher than that of the Gallager insertion channel, and quantifies the difference in the asymptotic regime.

Asymptotics of Input-Constrained Erasure Channel Capacity

Capacity Bounds of MIMO Channels with Asymmetric Channel State Information at Transmitter

Bounds for the capacity error function for unidirectional channels with noiseless feedback

On Capacity Regions of Two-Receiver Broadcast Packet Erasure Channels with Feedback and Memory

Binary Fading Interference Channel with No CSIT

On the Capacity of Memoryless Channels with Synchronization Errors

Capacity of Noisy Permutation Channels

Capacity Results for Non-Ergodic Multi-Modal Broadcast Channels with Controllable Statistics

Capacity Definitions for General Channels with Receiver Side Information

Asymptotic Capacity Loss under Spectral Leakage Constraints for Weakly Nonlinear Transmitters

A characterization of the capacity of online (causal) binary channels

The Capacity of Online (Causal) $q$-ary Error-Erasure Channels

Capacity Region of Layered Erasure One-sided Interference Channels without CSIT

A General Formula for Compound Channel Capacity

Capacity Approximations for Insertion Channels with Small Insertion Probabilities

Non-Asymptotic Capacity Lower Bound for Non-Coherent Simo Channels with Memory

Single Letter Expression of Capacity for a Class of Channels with Memory

On the Capacity Region of Broadcast Packet Erasure Relay Networks With Feedback

On Quantum Communication Channels with Constrained Inputs

The zero-error capacity of binary channels with 2-memories

Bounds on Covert Capacity in the Sub-Exponential Slotted Asynchronous Regime