Abstract:Channels with synchronization errors, exhibiting deletion and insertion errors, find practical applications in DNA storage, data reconstruction, and various other domains. Presence of insertions and deletions render the channel with memory, complicating capacity analysis. For instance, despite the formulation of an independent and identically distributed (i.i.d.) deletion channel more than fifty years ago, and proof that the channel is information stable, hence its Shannon capacity exists, calculation of the capacity remained elusive. However, a relatively recent result establishes the capacity of the deletion channel in the asymptotic regime of small deletion probabilities by computing the dominant terms of the capacity expansion. This paper extends that result to binary insertion channels, determining the dominant terms of the channel capacity for small insertion probabilities and establishing capacity in this asymptotic regime. Specifically, we consider two i.i.d. insertion channel models: insertion channel with possible random bit insertions after every transmitted bit and the Gallager insertion model, for which a bit is replaced by two random bits with a certain probability. To prove our results, we build on methods used for the deletion channel, employing Bernoulli(1/2) inputs for achievability and coupling this with a converse using stationary and ergodic processes as inputs, and show that the channel capacity differs only in the higher order terms from the achievable rates with i.i.d. inputs. The results, for instance, show that the capacity of the random insertion channel is higher than that of the Gallager insertion channel, and quantifies the difference in the asymptotic regime.

On Bounds and Closed Form Expressions for Capacities of Discrete Memoryless Channels with Invertible Positive Matrices

Single Letter Expression of Capacity for a Class of Channels with Memory

On the Capacity of Memoryless Channels with Synchronization Errors

Capacity of Noisy Permutation Channels

Information Theory Tutorial Communication over Channels with memory

The zero-error capacity of binary channels with 2-memories

Capacity Bounds via Operator Space Methods

On the Capacity of Discrete-Time Laguerre Channel

Capacity Approximations for Insertion Channels with Small Insertion Probabilities

Capacity Bounds for Broadcast Channels with Confidential Messages

Capacity of a quantum memory channel correlated by matrix product states

Capacity of Known Interference Channel with Gaussian Modulations

On the Capacity of a Class of Cognitive Z-interference Channels

Capacity of the Memoryless Additive Inverse Gaussian Noise Channel

Capacity Definitions for General Channels with Receiver Side Information

Achieving near-Capacity on Large Discrete Memoryless Channels

State of the cognitive interference channel: a new unified inner bound

Quantum Capacity of Pauli Channels with Memory

Compound Channel Capacities under Energy Constraints and Application

The Duality Upper Bound for Finite-State Channels with Feedback

Binomial Channel: On the Capacity-Achieving Distribution and Bounds on the Capacity