A Primer for the Walsh Transform

Devin Greene

2023-11-04

Abstract:A mathematical development of the Walsh transform, Walsh basis, and Walsh coefficients is given. The author was prompted to write this by a wish to give a unified treatment of epistatic coordinates as they are used in evolutionary biology. At the end of the article, opinions are expressed regarding the usefulness of these concepts for the practical researcher.

Populations and Evolution

What problem does this paper attempt to address?

Multiallelic Walsh transforms

Devin Greene

2023-11-29

Abstract:A closed formula multiallelic Walsh (or Hadamard) transform is introduced. Basic results are derived, and a statistical interpretation of some of the resulting linear forms is discussed.

Quantitative Methods,Populations and Evolution
Walsh coefficients and circuits for several alleles

Kristina Crona,Devin Greene

2024-01-02

Abstract:Walsh coefficients have been applied extensively to biallelic systems for quantifying pairwise and higher order epistasis, in particular for demonstrating the empirical importance of higher order interactions. Circuits, or minimal dependence relations, and related approaches that use triangulations of polytopes have also been applied to biallelic systems. Here we provide biological interpretations of Walsh coefficients for several alleles, and discuss circuits in the same general setting.

Populations and Evolution
An extension of the Walsh-Hadamard transform to calculate and model epistasis in genetic landscapes of arbitrary shape and complexity

Andre J. Faure,Ben Lehner,Verónica Miró Pina,Claudia Serrano Colome,Donate Weghorn

DOI: https://doi.org/10.1371/journal.pcbi.1012132

2024-05-29

PLoS Computational Biology

Abstract:Accurate models describing the relationship between genotype and phenotype are necessary in order to understand and predict how mutations to biological sequences affect the fitness and evolution of living organisms. The apparent abundance of epistasis (genetic interactions), both between and within genes, complicates this task and how to build mechanistic models that incorporate epistatic coefficients (genetic interaction terms) is an open question. The Walsh-Hadamard transform represents a rigorous computational framework for calculating and modeling epistatic interactions at the level of individual genotypic values (known as genetical, biological or physiological epistasis), and can therefore be used to address fundamental questions related to sequence-to-function encodings. However, one of its main limitations is that it can only accommodate two alleles (amino acid or nucleotide states) per sequence position. In this paper we provide an extension of the Walsh-Hadamard transform that allows the calculation and modeling of background-averaged epistasis (also known as ensemble epistasis) in genetic landscapes with an arbitrary number of states per position (20 for amino acids, 4 for nucleotides, etc.). We also provide a recursive formula for the inverse matrix and then derive formulae to directly extract any element of either matrix without having to rely on the computationally intensive task of constructing or inverting large matrices. Finally, we demonstrate the utility of our theory by using it to model epistasis within both simulated and empirical multiallelic fitness landscapes, revealing that both pairwise and higher-order genetic interactions are enriched between physically interacting positions. An important question in genetics is how the effects of mutations combine to alter phenotypes. Genetic interactions (epistasis) describe non-additive effects of pairs of mutations, but can also involve higher-order (three- and four-way etc.) combinations. Quantifying higher-order interactions is experimentally very challenging requiring a large number of measurements. Techniques based on deep mutational scanning (DMS) represent valuable sources of data to study epistasis. However, the best way to extract the relevant pairwise and higher-order epistatic coefficients (genetic interaction terms) from this data for the task of phenotypic prediction remains an unresolved problem. The Walsh-Hadamard transform represents a rigorous computational framework for calculating and modeling epistatic interactions at the level of individual genotypic values. Critically, this formalism currently only allows for two alleles (amino acid or nucleotide states) per sequence position, hampering applications in more biologically realistic scenarios. Here we present an extension of the Walsh-Hadamard transform that overcomes this limitation and demonstrate the utility of our theory by using it to model epistasis within both simulated and empirical multiallelic genetic landscapes.

biochemical research methods,mathematical & computational biology
Sampling with Walsh Transforms

Yi Lu

DOI: https://doi.org/10.48550/arXiv.1502.06221

2015-02-22

Information Theory

Abstract:With the advent of massive data outputs at a regular rate, admittedly, signal processing technology plays an increasingly key role. Nowadays, signals are not merely restricted to physical sources, they have been extended to digital sources as well. Under the general assumption of discrete statistical signal sources, we propose a practical problem of sampling incomplete noisy signals for which we do not know a priori and the sample size is bounded. We approach this sampling problem by Shannon's channel coding theorem. We use an extremal binary channel with high probability of transmission error, which is rare in communication theory. Our main result demonstrates that it is the large Walsh coefficient(s) that characterize(s) discrete statistical signals, regardless of the signal sources. Note that this is a known fact in specific application domains such as images. By the connection of Shannon's theorem, we establish the necessary and sufficient condition for our generic sampling problem for the first time. Finally, we discuss the cryptographic significance of sparse Walsh transform.
Walsh transforms and cryptographic applications in bias computing

Yi Lu,Yvo Desmedt

DOI: https://doi.org/10.1007/s12095-015-0155-4

2015-08-26

Cryptography and Communications

Abstract:Walsh transform is used in a wide variety of scientific and engineering applications, including bent functions and cryptanalytic optimization techniques in cryptography. In linear cryptanalysis, it is a key question to find a good linear approximation, which holds with probability (1+d)/2 and the bias d is large in absolute value. Lu and Desmedt (2011) take a step toward answering this key question in a more generalized setting and initiate the work on the generalized bias problem with linearly-dependent inputs. In this paper, we give fully extended results. Deep insights on assumptions behind the problem are given. We take an information-theoretic approach to show that our bias problem assumes the setting of the maximum input entropy subject to the input constraint. By means of Walsh transform, the bias can be expressed in a simple form. It incorporates Piling-up lemma as a special case. Secondly, as application, we answer a long-standing open problem in correlation attacks on combiners with memory. We give a closed-form exact solution for the correlation involving the multiple polynomial of any weight for the first time. We also give Walsh analysis for numerical approximation. An interesting bias phenomenon is uncovered, i.e., for even and odd weight of the polynomial, the correlation behaves differently. Thirdly, we introduce the notion of weakly biased distribution, and study bias approximation for a more general case by Walsh analysis. We show that for weakly biased distribution, Piling-up lemma is still valid. Our work shows that Walsh analysis is useful and effective to a broad class of cryptanalysis problems.

English Else
On the relation between Fourier and Walsh–Rademacher spectra for random fields

Anton Kutsenko,Sergey Danilov,Stephan Juricke,Marcel Oliver

DOI: https://doi.org/10.1016/j.acha.2023.101603

IF: 2.974

2024-01-01

Applied and Computational Harmonic Analysis

Abstract:We discuss relations between the expansion coefficients of a discrete random field when analyzed with respect to different hierarchical bases. Our main focus is on the comparison of two such systems: the Walsh–Rademacher basis and the trigonometric Fourier basis. In general, spectra computed with respect to one basis will look different in the other. In this paper, we prove that, in a statistical sense, the rate of spectral decay computed in one basis can be translated to the other. We further provide explicit expressions for this translation on quadrilateral meshes. The results are illustrated with numerical examples for deterministic and random fields.

mathematics, applied
Researches on some theoretical problems of genetic algorithms

Enhong Chen

1997-01-01

Ruan Jian Xue Bao/Journal of Software

Abstract:The relationship between Walsh schemata transformation and schemata processing of GA is studied, GA deception and difficult problems are discussed and analyzed, the relationship between GA-deception problems and the representation of solution spaces has also been explored, the conclusion that GA-deception problems are corresponding to coding methods of their search spaces is given.
New Three-Valued Walsh Transforms from Decimations of Helleseth-Gong Sequences

Guang Gong,Tor Helleseth,Honggang Hu,Chunlei Li

DOI: https://doi.org/10.1109/tit.2011.2169297

2012-01-01

Abstract:The Walsh transform of two-level autocorrelation sequences has played an important role in the construction of the set of sequences in which any two sequences are orthogonal. For p -ary sequences, there are only two basic classes of two-level autocorrelation sequences with no subfield structures for an arbitrary odd prime p. One is the class of p-ary m-sequences and the other is the class of p -ary Helleseth-Gong sequences. In this paper, the Walsh transform of a subclass of p -ary Helleseth-Gong sequences and the Walsh transform of their particular decimations are completely determined and are shown to be three-valued.
A sequency match filtering algorithm based on the generalized Walsh transform for processing rectangular wave signals

Bin Li,Sheng-Nan Zhang,Jie Chen,Wang-Cheng Zhao

DOI: https://doi.org/10.1063/5.0175079

IF: 1.6

2024-02-01

Review of Scientific Instruments

Abstract:The conventional Walsh function just takes values of +1 and −1 and can only track limited signal states. However, based on the characteristics of Walsh functions that can capture the frequency of square wave signals, this article proposes a generalized Walsh transform algorithm to process multi-valued rectangular wave signals. As an extension of the traditional Walsh functions, generalized Walsh functions have advantages in signal frequency matching and sequency spectrum amplitude extraction, which makes them well suited to express the valuable signal. First, we infer the invariance displacement theory in the time and sequency domains, limiting the value of a circular time shift to ensure the concentrated distribution of the signal sequency energy. This limitation lays a good foundation for constructing generalized Walsh functions. Then, two types of generalized Walsh functions are built by combining the characteristics of different periodic rectangular waves. We deduce two properties of orthogonality and completeness to prove the ability of the constructed functions to match the frequency and the extracted energy. Finally, we compare multiple filtering methods to verify the reliability of the proposed method.

instruments & instrumentation,physics, applied
Walsh Diffusions as Time Changed Multi-parameter Processes

Erhan Bayraktar,Jingjie Zhang,Xin Zhang

2024-07-06

Abstract:Inspired by allocation strategies in multi-armed bandit model, we propose a pathwise construction of Walsh diffusions. For any infinitesimal generator on a star shaped graph, there exists a unique time change associated with a multi-parameter process such that the time change of this multi-parameter process is the desired diffusion. The time change has an interpretation of time allocation of the process on each edge, and it can be derived explicitly from a family of equations.

Probability
A Subband Coding System Based on Discrete Walsh Transform

C Huang,J Liu

DOI: https://doi.org/10.1109/icosp.1998.770322

1998-01-01

Abstract:Subband coding is a potential image coding method. Traditional subband coding systems are often based on the Fourier transform, so they have shortcomings such as large calculation quantity, system error etc. A new coding system based on the discrete Walsh transform is represented in this paper. This model has an ideal reconstruction feature and its analyzer/synthesizer can be represented by a set of simple operators. After subband decomposition, energy is concentrated in the low-frequency band mostly. A subband discard scheme is given in this paper which can reconstruct the original image well only needing the low-frequency subband and a few parameters. It is proved by experiments that the complexity, calculating speed and reconstruction effect of the algorithm are all better than traditional subband coding methods
A hybrid classical-quantum algorithm for solution of nonlinear ordinary differential equations

Alok Shukla,Prakash Vedula

DOI: https://doi.org/10.1016/j.amc.2022.127708

2022-05-27

Abstract:A hybrid classical-quantum approach for the solution of nonlinear ordinary differential equations using Walsh-Hadamard basis functions is proposed. Central to this hybrid approach is the computation of the Walsh-Hadamard transform of arbitrary vectors, which is enabled in our framework using quantum Hadamard gates along with state preparation, shifting, scaling, and measurement operations. It is estimated that the proposed hybrid classical-quantum approach for the Walsh-Hadamard transform of an input vector of size N results in a considerably lower computational complexity (O(N) operations) compared to the Fast Walsh-Hadamard transform (O(N log2(N)) operations). This benefit will also be relevant in the context of the proposed hybrid classical-quantum approach for the solution of nonlinear differential equations. Comparisons of results corresponding to the proposed hybrid classical-quantum approach and a purely classical approach for the solution of nonlinear differential equations (for cases involving one and two dependent variables) were found to be satisfactory. Some new perspectives relevant to the natural ordering of Walsh functions (in the context of both classical and hybrid approaches for the solution of nonlinear differential equations) and representation theory of finite groups are also presented here.

Quantum Physics
Hybrid classical-quantum image processing via polar Walsh basis functions

Mohit Rohida,Alok Shukla,Prakash Vedula

2024-03-24

Abstract:We propose a novel hybrid classical-quantum approach for image processing based on polar Walsh basis functions. Using this approach, we present an algorithm for the removal of the circular banding noise (including Airy pattern noise) and the azimuthal banding noise. This approach is based on a formulation of Walsh basis functions in polar coordinates for image representations. This approach also builds upon an earlier work on a hybrid classical-quantum algorithm for Walsh-Hadamard transforms. We provide two kinds of polar representations using uniform area measure and uniform radial measure. Effective smoothening and interpolating techniques are devised relevant to the transformations between Cartesian and polar coordinates, mitigating the challenges posed by the non-injectivity of the transformation in the context of digital images. The hybrid classical-quantum approach presented here involves an algorithm for Walsh-Hadamard transforms, which has a lower computational complexity of $\mathcal{O}(N)$ compared to the well-known classical Fast Walsh-Hadamard Transform, which has a computational complexity of $\mathcal{O}(N \log_2 N)$. We demonstrated the applicability of our approach through computational examples involving the removal of the circular banding noise (including Airy pattern noise) and the azimuthal banding noise.

Quantum Physics
Walsh-synthesized noise-filtering quantum logic

H. Ball,M. J. Biercuk

DOI: https://doi.org/10.48550/arXiv.1410.1624

2014-10-07

Abstract:We study a novel class of open-loop control protocols constructed to perform arbitrary nontrivial single-qubit logic operations robust against time-dependent non-Markovian noise. Amplitude and phase modulation protocols are crafted leveraging insights from functional synthesis and the basis set of Walsh functions. We employ the experimentally validated generalized filter-transfer function formalism in order to find optimized control protocols for target operations in SU(2) by defining a cost function for the filter-transfer function to be minimized through the applied modulation. Our work details the various techniques by which we define and then optimize the filter-synthesis process in the Walsh basis, including the definition of specific analytic design rules which serve to efficiently constrain the available synthesis space. This approach yields modulated-gate constructions consisting of chains of discrete pulse-segments of arbitrary form, whose modulation envelopes possess intrinsic compatibility with digital logic and clocking. We derive novel families of Walsh-modulated noise filters designed to suppress dephasing and coherent amplitude-damping noise, and describe how well-known sequences derived in NMR also fall within the Walsh-synthesis framework. Finally, our work considers the effects of realistic experimental constraints such as limited modulation bandwidth on achievable filter performance.

Quantum Physics,Mesoscale and Nanoscale Physics
Eigenvalues of the Adin-Roichman Matrices

Gil Alon

DOI: https://doi.org/10.48550/arXiv.1301.5760

2014-03-07

Abstract:We find the spectrum of the Walsh-Hadamard type matrices defined by <a class="link-external link-http" href="http://R.Adin" rel="external noopener nofollow">this http URL</a> and <a class="link-external link-http" href="http://Y.Roichman" rel="external noopener nofollow">this http URL</a> in their recent work on character formulas and descent sets for the symmetric group.

Combinatorics
A Basis-preserving Algorithm for Computing the Bezout Matrix of Newton Polynomials

Jing Yang,Wei Yang

2024-04-28

Abstract:This paper tackles the problem of constructing Bezout matrices for Newton polynomials in a basis-preserving approach that operates directly with the given Newton basis, thus avoiding the need for transformation from Newton basis to monomial basis. This approach significantly reduces the computational cost and also mitigates numerical instability caused by basis transformation. For this purpose, we investigate the internal structure of Bezout matrices in Newton basis and design a basis-preserving algorithm that generates the Bezout matrix in the specified basis used to formulate the input polynomials. Furthermore, we show an application of the proposed algorithm on constructing confederate resultant matrices for Newton polynomials. Experimental results demonstrate that the proposed methods perform superior to the basis-transformation-based ones.

Symbolic Computation,Numerical Analysis
On the Walsh and Fourier-Hadamard Supports of Boolean Functions From a Quantum Viewpoint

Claude Carlet,Ulises Pastor-Díaz,José María Tornero

2024-05-07

Abstract:In this paper, we focus on the links between Boolean function theory and quantum computing. In particular, we study the notion of what we call fully-balanced functions and analyse the Fourier--Hadamard and Walsh supports of those functions having such property. We study the Walsh and Fourier supports of other relevant classes of functions, using what we call balancing sets. This leads us to revisit and complete certain classic results and to propose new ones. We complete our study by extending the previous results to pseudo-Boolean functions (in relation to vectorial functions) and giving an insight on its applications in the analysis of the possibilities that a certain family of quantum algorithms can offer.

Combinatorics,Logic
A Primer on Reproducing Kernel Hilbert Spaces

Jonathan H. Manton,Pierre-Olivier Amblard

DOI: https://doi.org/10.1561/2000000050

2015-01-01

Foundations and Trends® in Signal Processing

Abstract:Reproducing kernel Hilbert spaces are elucidated without assuming prior familiarity with Hilbert spaces. Compared with extant pedagogic material, greater care is placed on motivating the definition of reproducing kernel Hilbert spaces and explaining when and why these spaces are efficacious. The novel viewpoint is that reproducing kernel Hilbert space theory studies extrinsic geometry, associating with each geometric configuration a canonical overdetermined coordinate system. This coordinate system varies continuously with changing geometric configurations, making it well-suited for studying problems whose solutions also vary continuously with changing geometry. This primer can also serve as an introduction to infinite-dimensional linear algebra because reproducing kernel Hilbert spaces have more properties in common with Euclidean spaces than do more general Hilbert spaces.

English Else
A Multivariate Fast Discrete Walsh Transform with an Application to Function Interpolation

Kwong-Ip Liu,Josef Dick,Fred J. Hickernell

DOI: https://doi.org/10.1090/S0025-5718-09-02202-9

2008-08-05

Abstract:For high dimensional problems, such as approximation and integration, one cannot afford to sample on a grid because of the curse of dimensionality. An attractive alternative is to sample on a low discrepancy set, such as an integration lattice or a digital net. This article introduces a multivariate fast discrete Walsh transform for data sampled on a digital net that requires only $O(N \log N)$ operations, where $N$ is the number of data points. This algorithm and its inverse are digital analogs of multivariate fast Fourier transforms. This fast discrete Walsh transform and its inverse may be used to approximate the Walsh coefficients of a function and then construct a spline interpolant of the function. This interpolant may then be used to estimate the function's effective dimension, an important concept in the theory of numerical multivariate integration. Numerical results for various functions are presented.

Numerical Analysis
Pauli Decomposition via the Fast Walsh-Hadamard Transform

Timothy N. Georges,Bjorn K. Berntson,Christoph Sünderhauf,Aleksei V. Ivanov

2024-09-30

Abstract:The decomposition of a square matrix into a sum of Pauli strings is a classical pre-processing step required to realize many quantum algorithms. Such a decomposition requires significant computational resources for large matrices. We present a new exact and explicit formula for the Pauli string coefficients which inspires an efficient algorithm to compute them. More specifically, we show that up to a permutation of the matrix elements, the decomposition coefficients are related to the original matrix by a multiplication of a generalised Hadamard matrix. This allows one to use the Fast Walsh-Hadamard transform and calculate all Pauli decomposition coefficients in $\mathcal{O}(N^2\log N)$ time and using $\mathcal{O}(1)$ additional memory, for an $N\times N$ matrix. A numerical implementation of our equation outperforms currently available solutions.

Quantum Physics,Computational Physics

A Primer for the Walsh Transform

Multiallelic Walsh transforms

Walsh coefficients and circuits for several alleles

An extension of the Walsh-Hadamard transform to calculate and model epistasis in genetic landscapes of arbitrary shape and complexity

Sampling with Walsh Transforms

Walsh transforms and cryptographic applications in bias computing

On the relation between Fourier and Walsh–Rademacher spectra for random fields

Researches on some theoretical problems of genetic algorithms

New Three-Valued Walsh Transforms from Decimations of Helleseth-Gong Sequences

A sequency match filtering algorithm based on the generalized Walsh transform for processing rectangular wave signals

Walsh Diffusions as Time Changed Multi-parameter Processes

A Subband Coding System Based on Discrete Walsh Transform

A hybrid classical-quantum algorithm for solution of nonlinear ordinary differential equations

Hybrid classical-quantum image processing via polar Walsh basis functions

Walsh-synthesized noise-filtering quantum logic

Eigenvalues of the Adin-Roichman Matrices

A Basis-preserving Algorithm for Computing the Bezout Matrix of Newton Polynomials

On the Walsh and Fourier-Hadamard Supports of Boolean Functions From a Quantum Viewpoint

A Primer on Reproducing Kernel Hilbert Spaces

A Multivariate Fast Discrete Walsh Transform with an Application to Function Interpolation

Pauli Decomposition via the Fast Walsh-Hadamard Transform