On continuous but differentiable nowhere solutions in the moment problem

Miguel Tierz

DOI: https://doi.org/10.48550/arXiv.math/0507458

2005-07-22

Abstract:We show that the moment problem admits solutions that are continuous but differentiable nowhere.

Classical Analysis and ODEs

What problem does this paper attempt to address?

Subsystem symmetry, spin glass order, and criticality from random measurements in a two-dimensional Bacon-Shor circuit

Vaibhav Sharma,Chao-Ming Jian,Erich J Mueller

DOI: https://doi.org/10.1103/PhysRevB.108.024205

2023-08-04

Abstract:We study a 2D measurement-only random circuit motivated by the Bacon-Shor error correcting code. We find a rich phase diagram as one varies the relative probabilities of measuring nearest neighbor Pauli XX and ZZ check operators. In the Bacon-Shor code, these checks commute with a group of stabilizer and logical operators, which therefore represent conserved quantities. Described as a subsystem symmetry, these conservation laws lead to a continuous phase transition between an X-basis and Z-basis spin glass order. The two phases are separated by a critical point where the entanglement entropy between two halves of an L X L system scales as L ln L, a logarithmic violation of the area law. We generalize to a model where the check operators break the subsystem symmetries (and the Bacon-Shor code structure). In tension with established heuristics, we find that the phase transition is replaced by a smooth crossover, and the X- and Z-basis spin glass orders spatially coexist. Additionally, if we approach the line of subsystem symmetries away from the critical point in the phase diagram, some spin glass order parameters jump discontinuously

Quantum Physics,Disordered Systems and Neural Networks,Statistical Mechanics,Strongly Correlated Electrons
Statistical Mechanics and Capacity-Approaching Error-Correcting Codes

Nicolas Sourlas

DOI: https://doi.org/10.1016/S0378-4371%2801%2900439-3

2001-06-28

Abstract:I will show that there is a deep relation between error-correction codes and certain mathematical models of spin glasses. In particular minimum error probability decoding is equivalent to finding the ground state of the corresponding spin system. The most probable value of a symbol is related to the magnetization at a different temperature. Convolutional codes correspond to one-dimensional spin systems and Viterbi's decoding algorithm to the transfer matrix algorithm of Statistical Mechanics. I will also show how the recently discovered (or rediscovered) capacity approaching codes (turbo codes and low density parity check codes) can be analysed using statistical mechanics. It is possible to show, using statistical mechanics, that these codes allow error-free communication for signal to noise ratio above a certain threshold. This threshold depends on the particular code, and can be computed analytically in many cases.

Condensed Matter
Design of capacity-approaching irregular low-density parity-check codes

Thomas J. Richardson,M. Amin Shokrollahi,Rüdiger L. Urbanke,T.J. Richardson,M.A. Shokrollahi,R.L. Urbanke

DOI: https://doi.org/10.1109/18.910578

IF: 2.5

2001-01-01

IEEE Transactions on Information Theory

Abstract:We design low-density parity-check (LDPC) codes that perform at rates extremely close to the Shannon capacity. The codes are built from highly irregular bipartite graphs with carefully chosen degree patterns on both sides. Our theoretical analysis of the codes is based on [1]. Assuming that the underlying communication channel is symmetric, we prove that the probability densities at the message nodes of the graph possess a certain symmetry. Using this symmetry property we then show that, under the assumption of no cycles, the message densities always converge as the number of iterations tends to infinity. Furthermore, we prove a stability condition which implies an upper bound on the fraction of errors that a belief-propagation decoder can correct when applied to a code induced from a bipartite graph with a given degree distribution. Our codes are found by optimizing the degree structure of the underlying graphs. We develop several strategies to perform this optimization. We also present some simulation results for the codes found which show that the performance of the codes is very close to the asymptotic theoretical bounds.

computer science, information systems,engineering, electrical & electronic
Statistical Mechanics and error-correction Codes

Nicolas Sourlas

DOI: https://doi.org/10.48550/arXiv.cond-mat/9811406

1998-11-29

Statistical Mechanics

Abstract:I will show that there is a deep relation between error-correction codes and certain mathematical models of spin glasses. In particular minimum error probability decoding is equivalent to finding the ground state of the corresponding spin system. The most probable value of a symbol is related to the magnetization at a different temperature. Convolutional codes correspond to one-dimensional spin systems and Viterbi's decoding algorithm to the transfer matrix algorithm of Statistical Mechanics. A particular spin-glass model, which is exactly soluble, corresponds to an ideal code, i.e. a code which allows error-free communication if the rate is below channel capacity.
Error counting in a quantum error-correcting code and the ground-state energy of a spin glass

Hidetoshi Nishimori,Peter Sollich

DOI: https://doi.org/10.1143/JPSJ.73.2701

2004-05-14

Abstract:Upper and lower bounds are given for the number of equivalence classes of error patterns in the toric code for quantum memory. The results are used to derive a lower bound on the ground-state energy of the +/-J Ising spin glass model on the square lattice with symmetric and asymmetric bond distributions. This is a highly non-trivial example in which insights from quantum information lead directly to an explicit result on a physical quantity in the statistical mechanics of disordered systems.

Disordered Systems and Neural Networks,Statistical Mechanics,Quantum Physics
Error-Correction Performance of Regular Ring-Linear LDPC Codes over Lee Channels

Jessica Bariffi,Hannes Bartz,Gianluigi Liva,Joachim Rosenthal

2024-07-31

Abstract:Most low-density parity-check (LDPC) code constructions are considered over finite fields. In this work, we focus on regular LDPC codes over integer residue rings and analyze their performance with respect to the Lee metric. Their error-correction performance is studied over two channel models, in the Lee metric. The first channel model is a discrete memoryless channel, whereas in the second channel model an error vector is drawn uniformly at random from all vectors of a fixed Lee weight. It is known that the two channel laws coincide in the asymptotic regime, meaning that their marginal distributions match. For both channel models, we derive upper bounds on the block error probability in terms of a random coding union bound as well as sphere packing bounds that make use of the marginal distribution of the considered channels. We estimate the decoding error probability of regular LDPC code ensembles over the channels using the marginal distribution and determining the expected Lee weight distribution of a random LDPC code over a finite integer ring. By means of density evolution and finite-length simulations, we estimate the error-correction performance of selected LDPC code ensembles under belief propagation decoding and a low-complexity symbol message passing decoding algorithm and compare the performances. The analysis developed in this paper may serve to design regular LDPC codes over integer residue rings for storage and cryptographic application.

Information Theory
Density Evolution Analysis of Generalized Low-density Parity-check Codes under a Posteriori Probability Decoder

Dongxu Chang,Qingqing Peng,Zhiming Ma,Guanghui Wang,Dawei Yin

2024-08-06

Abstract:In this study, the performance of generalized low-density parity-check (GLDPC) codes under the a posteriori probability (APP) decoder is analyzed. We explore the concentration, symmetry, and monotonicity properties of GLDPC codes under the APP decoder, extending the applicability of density evolution to GLDPC codes. On the binary memoryless symmetric channels, using the BEC and BI-AWGN channels as two examples, we demonstrate that with an appropriate proportion of generalized constraint (GC) nodes, GLDPC codes can reduce the original gap to capacity compared to their original LDPC counterparts. Additionally, on the BI-AWGN channel, we apply and improve the Gaussian approximation algorithm in the density evolution of GLDPC codes. By adopting Gaussian mixture distributions to approximate the message distributions from variable nodes and Gaussian distributions for those from constraint nodes, the precision of the channel parameter threshold can be significantly enhanced while maintaining a low computational complexity similar to that of Gaussian approximations. Furthermore, we identify a class of subcodes that can greatly simplify the performance analysis and practical decoding of GLDPC codes, which we refer to as message-invariant subcodes. Using the aforementioned techniques, our simulation experiments provide empirical evidence that GLDPC codes, when decoded with the APP decoder and equipped with the right fraction of GC nodes, can achieve substantial performance improvements compared to low-density parity-check (LDPC) codes.

Information Theory
Statistical-Based Density Evolution Algorithm For Nonbinary Low-Density Parity-Check Codes

Jie Wu,Minjian Zhao,Jie Zhong,Wenyan Zhang,Xuanxuan Lv

DOI: https://doi.org/10.1109/VETECF.2011.6092934

2011-01-01

Abstract:A statistical-based density evolution algorithm is proposed for nonbinary low-density parity-check (LDPC) codes. It is applicable to both regular and irregular codes under study. The algorithm proposed serves as a tool to analyze the performance limit for iterative decoding of nonbinary LDPC codes, which in turn guides code design. Specifically, it provides approximated evaluations of convergence thresholds for codes given specific degree distributions. It is shown that, for a class of quasi-cyclic (QC) structured extended irregular repeat-accumulate (SeIRA) nonbinary LDPC codes, degree distributions can be optimized via the algorithm proposed. Simulation results exhibit that the nonbinary LDPC codes designed outperform the optimized binary LDPC codes on the AWGN channel with similar code length and rate in terms of bits. Performance gap between the binary and nonbinary LDPC codes is larger in the scenario of higher order modulation.
Non binary LDPC codes over the binary erasure channel: density evolution analysis

Valentin Savin

DOI: https://doi.org/10.48550/arXiv.0810.4404

2008-10-24

Information Theory

Abstract:In this paper we present a thorough analysis of non binary LDPC codes over the binary erasure channel. First, the decoding of non binary LDPC codes is investigated. The proposed algorithm performs on-the-fly decoding, i.e. it starts decoding as soon as the first symbols are received, which generalizes the erasure decoding of binary LDPC codes. Next, we evaluate the asymptotical performance of ensembles of non binary LDPC codes, by using the density evolution method. Density evolution equations are derived by taking into consideration both the irregularity of the bipartite graph and the probability distribution of the graph edge labels. Finally, infinite-length performance of some ensembles of non binary LDPC codes for different edge label distributions are shown.
Dissipative phase transitions and passive error correction

Yu-Jie Liu,Simon Lieu

2023-08-03

Abstract:We classify different ways to passively protect classical and quantum information, i.e. we do not allow for syndrome measurements, in the context of local Lindblad models for spin systems. Within this family of models, we suggest that passive error correction is associated with nontrivial phases of matter and propose a definition for dissipative phases based on robust steady state degeneracy of a Lindbladian in the thermodynamic limit. We study three thermalizing models in this context: the 2D Ising model, the 2D toric code, and the 4D toric code. In the low-temperature phase, the 2D Ising model hosts a robust classical steady state degeneracy while the 4D toric code hosts a robust quantum steady state degeneracy. We perturb the models with terms that violate detailed balance and observe that qualitative features remain unchanged, suggesting that $\mathbb{Z}_2$ symmetry breaking in a Lindbladian is useful to protect a classical bit while intrinsic topological order protects a qubit.

Quantum Physics,Mesoscale and Nanoscale Physics,Quantum Gases,Strongly Correlated Electrons
The phase diagram of Lévy spin glasses

I Neri,F L Metz,D Bollé

DOI: https://doi.org/10.1088/1742-5468/2010/01/p01010

2010-01-21

Abstract:We study a fully connected spin-glass model in which the coupling strengths are drawn from a Lévy distribution. In this model each spin can be seen as interacting through a finite number of strong bonds and an infinite number of weak bonds, due to the large tail behavior of the coupling distribution. We solve the model through the replica and the cavity method. The hybrid behavior of Lévy spin glasses becomes transparent in our solution: the local field contains a part propagating along a backbone of strong bonds and a Gaussian noise term due to weak bonds. Our method allows us to determine the complete replica symmetric phase diagram, the replica symmetry breaking line and the entropy. The results are compared with ones from simulations and previous calculations using a Gaussian ansatz for the distribution of fields.

physics, mathematical,mechanics
On the Dynamics of the Error Floor Behavior in (Regular) LDPC Codes

Christian Schlegel,Shuai Zhang

DOI: https://doi.org/10.1109/tit.2010.2048448

IF: 2.5

2010-07-01

IEEE Transactions on Information Theory

Abstract:It is shown that dominant trapping sets of regular low-density parity-check (LDPC) codes, so-called absorption sets, undergo a two-phased dynamic behavior in the iterative message-passing decoding algorithm. Using a linear dynamic model for the iteration behavior of these sets, it is shown that they undergo an initial geometric growth phase which stabilizes in a final bit-flipping behavior where the algorithm reaches a fixed point. This analysis is shown to lead to very accurate numerical calculations of the error floor bit error rates down to error rates that are inaccessible by simulation. The topology of the dominant absorption sets of an example code, the IEEE 802.3an (2048,1723) regular LDPC code, are identified and tabulated using topological relationships in combination with search algorithms.

computer science, information systems,engineering, electrical & electronic
Spin glass models with ferromagnetically biased couplings on the Bethe lattice: analytic solutions and numerical simulations

Tommaso Castellani,Florent Krzakala,Federico Ricci-Tersenghi

DOI: https://doi.org/10.1140/epjb/e2005-00293-1

2005-05-07

Abstract:We derive the zero-temperature phase diagram of spin glass models with a generic fraction of ferromagnetic interactions on the Bethe lattice. We use the cavity method at the level of one-step replica symmetry breaking (1RSB) and we find three phases: A replica-symmetric (RS) ferromagnetic one, a magnetized spin glass one (the so-called mixed phase), and an unmagnetized spin glass one. We are able to give analytic expressions for the critical point where the RS phase becomes unstable with respect to 1RSB solutions: we also clarify the mechanism inducing such a phase transition. Finally we compare our analytical results with the outcomes of a numerical algorithm especially designed for finding ground states in an efficient way, stressing weak points in the use of such numerical tools for discovering RSB effects. Some of the analytical results are given for generic connectivity.

Disordered Systems and Neural Networks,Statistical Mechanics
Topological Quantum Spin Glass Order and its realization in qLDPC codes

Benedikt Placke,Tibor Rakovszky,Nikolas P. Breuckmann,Vedika Khemani

2024-12-18

Abstract:Ordered phases of matter have close connections to computation. Two prominent examples are spin glass order, with wide-ranging applications in machine learning and optimization, and topological order, closely related to quantum error correction. Here, we introduce the concept of topological quantum spin glass (TQSG) order which marries these two notions, exhibiting both the complex energy landscapes of spin glasses, and the quantum memory and long-range entanglement characteristic of topologically ordered systems. Using techniques from coding theory and a quantum generalization of Gibbs state decompositions, we show that TQSG order is the low-temperature phase of various quantum LDPC codes on expander graphs, including hypergraph and balanced product codes. Our work introduces a topological analog of spin glasses that preserves quantum information, opening new avenues for both statistical mechanics and quantum computer science.

Quantum Physics,Disordered Systems and Neural Networks,Statistical Mechanics,Strongly Correlated Electrons
Performance analysis of finite-length LDPC codes

Yingjian Xue,Haige Xiang

DOI: https://doi.org/10.1109/SPAWC.2003.1318927

2003-01-01

Abstract:In this paper, we are concerned with the finite-length analysis of low-density parity-check (LDPC) codes when used over additive white Gaussian noise (AWGN) channels. We present the iterative decoding algorithm of LDPC codes, and we also discuss the encoding methods and the bipartite graph representation of LDPC codes ensemble. Finite-length LDPC code performances are investigated, and the influence of cycle is pointed out. Simulation results show that irregular LDPC codes with variable and check node degree distribution optimized for infinite-length codes are not optimal for finite-length LDPC codes, and the error patterns of both regular and irregular codes are investigated as an effort to improve the performance and design methodology of finite-length LDPC codes.
The Physics of (good) LDPC Codes I. Gauging and dualities

Tibor Rakovszky,Vedika Khemani

2023-10-25

Abstract:Low-depth parity check (LDPC) codes are a paradigm of error correction that allow for spatially non-local interactions between (qu)bits, while still enforcing that each (qu)bit interacts only with finitely many others. On expander graphs, they can give rise to ``good codes'' that combine a finite encoding rate with an optimal scaling of the code distance, which governs the code's robustness against noise. Such codes have garnered much recent attention due to two breakthrough developments: the construction of good quantum LDPC codes and good locally testable classical LDPC codes, using similar methods. Here we explore these developments from a physics lens, establishing connections between LDPC codes and ordered phases of matter defined for systems with non-local interactions and on non-Euclidean geometries. We generalize the physical notions of Kramers-Wannier (KW) dualities and gauge theories to this context, using the notion of chain complexes as an organizing principle. We discuss gauge theories based on generic classical LDPC codes and make a distinction between two classes, based on whether their excitations are point-like or extended. For the former, we describe KW dualities, analogous to the 1D Ising model and describe the role played by ``boundary conditions''. For the latter we generalize Wegner's duality to obtain generic quantum LDPC codes within the deconfined phase of a Z_2 gauge theory. We show that all known examples of good quantum LDPC codes are obtained by gauging locally testable classical codes. We also construct cluster Hamiltonians from arbitrary classical codes, related to the Higgs phase of the gauge theory, and formulate generalizations of the Kennedy-Tasaki duality transformation. We use the chain complex language to discuss edge modes and non-local order parameters for these models, initiating the study of SPT phases in non-Euclidean geometries.

Quantum Physics,Statistical Mechanics,High Energy Physics - Theory
Information Geometry and Low Density Parity Check Codes

韩栋,孙华飞,阎达远

2009-01-01

Journal of Beijing Institute of Technology

Abstract:The application of information geometry in the low density parity check（LDPC）codes based on the work of Ikeda and Amari is considered.The method is to turn the decoding process into the change of the parameter.When the LDPC decoding procedure converges,both the convergent probability distribution and the true probability distribution belong to the same submanifold,but this does not mean they are equimarginal,that points out the origin of the decoding error.
Channel Mismatch Effect on Performance of Low Density Parity Check Codes

Liu Qi,Gong Chen,Cui Huijuan,Tang Kun

DOI: https://doi.org/10.1109/cesa.2006.4281891

2006-01-01

Abstract:Effect of channel mismatch on decoding performance of low density parity check (LDPC) codes over binary symmetric channel (BSC) under sum-product algorithm (SPA) is analyzed in this paper. Density evolution is employed in theoretical analysis to get optimal initial value for SPA. Based on the results, a modified SPA algorithm is proposed. When decoding using this modified SPA algorithm, no channel information is needed at the decoder side. This will be of significant value for time-varying channels. Theoretical claims from density evolution are confirmed by extensive simulations. Our simulations show that by fixing the initial value for all channel conditions, decoding performance can be improved. One channel state estimation algorithm is proposed in this paper based on the error detection ability of LDPC codes. Maximum number of iterations taken when decoding a LDPC code can be dynamically adjusted according to the estimated channel state. Further performance improvements can be achieved by using the dynamic iteration number adjusting scheme together with the modified sum-product algorithm
A Code-specific Conservative Model for the Failure Rate of Bit-flipping Decoding of LDPC Codes with Cryptographic Applications

Paolo Santini,Alessandro Barenghi,Gerardo Pelosi,Marco Baldi,Franco Chiaraluce

DOI: https://doi.org/10.48550/arXiv.1912.05182

2019-12-11

Abstract:Characterizing the decoding failure rate of iteratively decoded Low- and Moderate-Density Parity Check (LDPC/MDPC) codes is paramount to build cryptosystems based on them, able to achieve indistinguishability under adaptive chosen ciphertext attacks. In this paper, we provide a statistical worst-case analysis of our proposed iterative decoder obtained through a simple modification of the classic in-place bit-flipping decoder. This worst case analysis allows both to derive the worst-case behaviour of an LDPC/MDPC code picked among the family with the same length, rate and number of parity checks, and a code-specific bound on the decoding failure rate. The former result allows us to build a code-based cryptosystem enjoying the $\delta$-correctness property required by IND-CCA2 constructions, while the latter result allows us to discard code instances which may have a decoding failure rate significantly different from the average one (i.e., representing weak keys), should they be picked during the key generation procedure.

Cryptography and Security,Information Theory
Typical case behaviour of spin systems in random graph and composite ensembles

Jack Raymond

DOI: https://doi.org/10.48550/arXiv.0904.2506

2009-04-16

Disordered Systems and Neural Networks

Abstract:This thesis includes analysis of disordered spin ensembles corresponding to Exact Cover, a multi-access channel problem, and composite models combining sparse and dense interactions. The satisfiability problem in Exact Cover is addressed using a statistical analysis of a simple branch and bound algorithm. The algorithm can be formulated in the large system limit as a branching process, for which critical properties can be analysed. Far from the critical point a set of differential equations may be used to model the process, and these are solved by numerical integration and exact bounding methods. The multi-access channel problem is formulated as an equilibrium statistical physics problem for the case of bit transmission on a channel with power control and synchronisation. A sparse code division multiple access method is considered and the optimal detection properties are examined in typical case by use of the replica method, and compared to detection performance achieved by iterative decoding methods. These codes are found to have phenomena closely resembling the well-understood dense codes. The composite model is introduced as an abstraction of canonical sparse and dense disordered spin models. The model includes couplings due to both dense and sparse topologies simultaneously. Through an exact replica analysis at high temperature, and variational approaches at low temperature, several phenomena uncharacteristic of either sparse or dense models are demonstrated. An extension of the composite interaction structure to a code division multiple access method is presented. The new type of codes are shown to outperform sparse and dense codes in some regimes both in optimal performance, and in performance achieved by iterative detection methods in finite systems.

On continuous but differentiable nowhere solutions in the moment problem

Subsystem symmetry, spin glass order, and criticality from random measurements in a two-dimensional Bacon-Shor circuit

Statistical Mechanics and Capacity-Approaching Error-Correcting Codes

Design of capacity-approaching irregular low-density parity-check codes

Statistical Mechanics and error-correction Codes

Error counting in a quantum error-correcting code and the ground-state energy of a spin glass

Error-Correction Performance of Regular Ring-Linear LDPC Codes over Lee Channels

Density Evolution Analysis of Generalized Low-density Parity-check Codes under a Posteriori Probability Decoder

Statistical-Based Density Evolution Algorithm For Nonbinary Low-Density Parity-Check Codes

Non binary LDPC codes over the binary erasure channel: density evolution analysis

Dissipative phase transitions and passive error correction

The phase diagram of Lévy spin glasses

On the Dynamics of the Error Floor Behavior in (Regular) LDPC Codes

Spin glass models with ferromagnetically biased couplings on the Bethe lattice: analytic solutions and numerical simulations

Topological Quantum Spin Glass Order and its realization in qLDPC codes

Performance analysis of finite-length LDPC codes

The Physics of (good) LDPC Codes I. Gauging and dualities

Information Geometry and Low Density Parity Check Codes

Channel Mismatch Effect on Performance of Low Density Parity Check Codes

A Code-specific Conservative Model for the Failure Rate of Bit-flipping Decoding of LDPC Codes with Cryptographic Applications

Typical case behaviour of spin systems in random graph and composite ensembles