On the sparsity of binary numbers

Meijun Zhu

2024-10-14

Abstract:We introduce the concept of negative coefficients in various number-based systems, with a focus on decimal and binary systems. We demonstrate that every binary number can be transformed into a sparse form, significantly enhancing computational speed by converting binary numbers into this form.

Discrete Mathematics

What problem does this paper attempt to address?

A New Spatial Encoding Method for Sparse Binary Data

Weiwei Duan,Jianxin Luo,Qi Hu,Guiqiang Ni,Yi Gao

DOI: https://doi.org/10.1109/ICMCCE.2017.13

2017-01-01

Abstract:Spatial encoding is an important technique for spatial binary data storage, which differentiates the defined data from the undefined data in many computer graphics applications. However, previous methods make significant memory cost when the spatial data becomes very sparse, particularly for high resolution domains. In this paper, we present a new sparse encoding method which has less storage requirement. It is simple and efficient in storing spatial binary data. Our method utilizes commonly used array to store the specific dimensional coordinate for each defined data. To achieve efficient access on the GPUs, we recur to an auxiliary table to record the first defined element of each row. Compared to several popular approaches, the experimental results on 2D images and 3D models demonstrate that our method has a better memory performance on spatial binary data.
Sparse graph counting and Kelley-Meka bounds for binary systems

Yuval Filmus,Hamed Hatami,Kaave Hosseini,Esty Kelman

2024-05-17

Abstract:In a recent breakthrough, Kelley and Meka (FOCS 2023) obtained a strong upper bound on the density of sets of integers without nontrivial three-term arithmetic progressions. In this work, we extend their result, establishing similar bounds for all linear patterns defined by binary systems of linear forms, where "binary" indicates that every linear form depends on exactly two variables. Prior to our work, no strong bounds were known for such systems even in the finite field model setting. A key ingredient in our proof is a graph counting lemma. The classical graph counting lemma, developed by Thomason (Random Graphs 1985) and Chung, Graham, and Wilson (Combinatorica 1989), is a fundamental tool in combinatorics. For a fixed graph $H$, it states that the number of copies of $H$ in a pseudorandom graph $G$ is similar to the number of copies of $H$ in a purely random graph with the same edge density as $G$. However, this lemma is only non-trivial when $G$ is a dense graph. In this work, we prove a graph counting lemma that is also effective when $G$ is sparse. Moreover, our lemma is well-suited for density increment arguments in additive number theory. As an immediate application, we obtain a strong bound for the Turán problem in abelian Cayley sum graphs: let $\Gamma$ be a finite abelian group with odd order. If a Cayley sum graph on $\Gamma$ does not contain any $r$-clique as a subgraph, it must have at most $2^{-\Omega_r(\log^{1/16}|\Gamma|)}\cdot |\Gamma|^2$ edges. These results hinge on the technology developed by Kelley and Meka and the follow-up work by Kelley, Lovett, and Meka (STOC 2024).

Combinatorics
Composition of Binary Quadratic Forms over Number Fields

Kristýna Zemková

2023-07-15

Abstract:In this article, the standard correspondence between the ideal class group of a quadratic number field and the equivalence classes of binary quadratic forms of given discriminant is generalized to any base number field of narrow class number one. The article contains an explicit description of the correspondence. In the case of totally negative discriminants, equivalent conditions are given for a binary quadratic form to be totally positive definite.

Number Theory
On the Negation of discrete Z-numbers

Qing Liu,Huizi Cui,Ye Tian,Bingyi Kang

DOI: https://doi.org/10.1016/j.ins.2020.05.106

IF: 8.1

2020-10-01

Information Sciences

Abstract:<p>The negation of a problem provides a new perspective for information representation. However, existing negation method has limitations since it can only be applied to the accurately expressed knowledge. Real-world information is imperfect and imprecise. It usually describes in natural language. In view of this, Prof. Zadeh suggested the concept of Z-number as a more adequate way for description of real world information. As Z-number involves both fuzzy and probabilistic uncertainty, a novel method for the negation of Z-number in combination of probability and fuzziness is proposed from the reliability of probability transmission in this paper. Moreover, several examples are used to describe the negation process and result. As far as our latest knowledge is concerned, the negation of Z-number has not been covered by researchers, so this may be another door for us to process Z-number-based information.</p>

computer science, information systems
Adaptive Quantization for Hashing: an Information-Based Approach to Learning Binary Codes.

Caiming Xiong,Wei Chen,Gang Chen,David M. Johnson,Jason J. Corso

DOI: https://doi.org/10.1137/1.9781611973440.20

2014-01-01

Abstract:Previous chapter Next chapter Full AccessProceedings Proceedings of the 2014 SIAM International Conference on Data Mining (SDM)Adaptive Quantization for Hashing: An Information-Based Approach to Learning Binary CodesCaiming Xiong, Wei Chen, Gang Chen, David Johnson, and Jason J. CorsoCaiming XiongDepartment of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Search for more papers by this author, Wei ChenDepartment of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Search for more papers by this author, Gang ChenDepartment of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Search for more papers by this author, David JohnsonDepartment of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Search for more papers by this author, and Jason J. CorsoDepartment of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Department of Computer Science and Engineering, SUNY at Buffalo.Search for more papers by this authorpp.172 - 180Chapter DOI:https://doi.org/10.1137/1.9781611973440.20PDFBibTexSections ToolsAdd to favoritesDownload CitationsTrack CitationsEmail SectionsAboutAbstract Large-scale data mining and retrieval applications have increasingly turned to compact binary data representations as a way to achieve both fast queries and efficient data storage; many algorithms have been proposed for learning effective binary encodings. Most of these algorithms focus on learning a set of projection hyperplanes for the data and simply binarizing the result from each hyperplane, but this neglects the fact that informativeness may not be uniformly distributed across the projections. In this paper, we address this issue by proposing a novel adaptive quantization (AQ) strategy that adaptively assigns varying numbers of bits to different hyperplanes based on their information content. Our method provides an information-based schema that preserves the neighborhood structure of data points, and we jointly find the globally optimal bit-allocation for all hyperplanes. In our experiments, we compare with state-of-the-art methods on four large-scale datasets and find that our adaptive quantization approach significantly improves on traditional hashing methods. Previous chapter Next chapter RelatedDetails Published:2014eISBN:978-1-61197-344-0 https://doi.org/10.1137/1.9781611973440Book Series Name:ProceedingsBook Code:PRDT14Book Pages:1-1086
Beyond Countable Alphabets: an Extension of the Information-Spectrum Approach.

Shengtian Yang,Thomas Honold,Zhaoyang Zhang

DOI: https://doi.org/10.1109/wcsp.2016.7752489

2016-01-01

Abstract:A general approach is established for deriving one-shot performance bounds for information-theoretic problems on general alphabets beyond countable alphabets. It is mainly based on the quantization idea and a novel form of "likelihood ratio". As an example, one-shot lower and upper bounds for random number generation from correlated sources on general alphabets are derived.
A Fibonacci analogue of the two's complement numeration system

Sébastien Labbé,Jana Lepšová

DOI: https://doi.org/10.1051/ita/2023007

2023-06-20

Abstract:Using the classic two's complement notation of signed integers, the fundamental arithmetic operations of addition, subtraction, and multiplication are identical to those for unsigned binary numbers. We introduce a Fibonacci-equivalent of the two's complement notation and we show that addition in this numeration system can be performed by a deterministic finite-state transducer. The result is based on the Berstel adder, which performs addition of the usual Fibonacci representations of nonnegative integers and for which we provide a new constructive proof. Moreover, we characterize the Fibonacci-equivalent of the two's complement notation as an increasing bijection between $\mathbb{Z}$ and a particular language.

Formal Languages and Automata Theory,Number Theory
Turing Compute Model for Non-negative Binary Numbers.

Wenyu Chen,Xiaobin Wang,Xiaoou Cheng,Shixin Sun

DOI: https://doi.org/10.4304/jsw.5.1.123-130

2010-01-01

Journal of Software

Abstract:Turing-computable issue is important in research of Turing Machine and has significant value in both theory and practice. The paper analyzes Turing-computable issue of non-negative numbers by relational operations(includes greater than, less than and equal) and arithmetic operations(includes add operation, subtract, multiply, divide and modulo). The regulation of computing 1-bit binary number and the carry set(or borrow set) are defined to compute multi-bit binary numbers. Algorithms are described through multi-tape Turing machine. For some operations, the discussion is extended to base-N number system(3≤N≤10). Turing regulation for add operation is used to implement the Turing counter for counting the length of the string on the input tape of the Turing machine.
BBS: Bi-directional Bit-level Sparsity for Deep Learning Acceleration

Yuzong Chen,Jian Meng,Jae-sun Seo,Mohamed S. Abdelfattah

DOI: https://doi.org/10.48550/arXiv.2409.05227

2024-09-09

Abstract:Bit-level sparsity methods skip ineffectual zero-bit operations and are typically applicable within bit-serial deep learning accelerators. This type of sparsity at the bit-level is especially interesting because it is both orthogonal and compatible with other deep neural network (DNN) efficiency methods such as quantization and pruning. In this work, we improve the practicality and efficiency of bitlevel sparsity through a novel algorithmic bit-pruning, averaging, and compression method, and a co-designed efficient bit-serial hardware accelerator. On the algorithmic side, we introduce bidirectional bit sparsity (BBS). The key insight of BBS is that we can leverage bit sparsity in a symmetrical way to prune either zero-bits or one-bits. This significantly improves the load balance of bit-serial computing and guarantees the level of sparsity to be more than 50%. On top of BBS, we further propose two bit-level binary pruning methods that require no retraining, and can be seamlessly applied to quantized DNNs. Combining binary pruning with a new tensor encoding scheme, BBS can both skip computation and reduce the memory footprint associated with bi-directional sparse bit columns. On the hardware side, we demonstrate the potential of BBS through BitVert, a bitserial architecture with an efficient PE design to accelerate DNNs with low overhead, exploiting our proposed binary pruning. Evaluation on seven representative DNN models shows that our approach achieves: (1) on average 1.66$\times$ reduction in model sizewith negligible accuracy loss of < 0.5%; (2) up to 3.03$\times$ speedupand 2.44$\times$ energy saving compared to prior DNN accelerators.

Machine Learning,Hardware Architecture
Number of integers represented by families of binary forms II: binomial forms

Étienne Fouvry,Michel Waldschmidt

2023-06-05

Abstract:We consider some families of binary binomial forms $aX^d+bY^d$, with $a$ and $b$ integers. Under suitable assumptions, we prove that every rational integer $m$ with $|m|\ge 2$ is only represented by a finite number of the forms of this family (with varying $d,a,b$). Furthermore {the number of such forms of degree $\ge d_0$ representing $m$ is bounded by $O(|m|^{(1/d_0)+\epsilon})$} uniformly for $\vert m \vert \geq 2$. We also prove that the integers in the interval $[-N,N]$ represented by one of the form of the family with degree $d\geq d_0$ are almost all represented by some form of the family with degree $d=d_0$. In a previous {paper} we investigated the particular case where the binary binomial forms are positive definite. We now treat the general case by using a lower bound for linear forms of logarithms.

Number Theory
Weight Enumerators for Nonbinary Asymmetric Quantum Codes and Their Applications.

Chuangqiang Hu,Shudi Yang,Stephen S-T Yau

DOI: https://doi.org/10.1016/j.aam.2020.102085

IF: 1.271

2020-01-01

Advances in Applied Mathematics

Abstract:In 1997, Shor and Laflamme defined weight enumerators for quantum error-correcting codes and derived a MacWilliams identity. Recently, we proposed two new notions, the double weight enumerators and complete weight enumerators, for binary quantum codes. Now we will extend these results to nonbinary quantum codes. Based on the MacWilliams identities for these enumerators, we explicitly determine the Singleton-type and Hamming-type bounds for arbitrary nonbinary asymmetric quantum codes.
Binary Signed-Digit Integers, the Stern Diatomic Sequence and Stern Polynomials

Laura Monroe

DOI: https://doi.org/10.48550/arXiv.2103.05810

2021-08-31

Abstract:Stern's diatomic sequence is a well-studied and simply defined sequence with many fascinating characteristics. The binary signed-digit (BSD) representation of integers is used widely in efficient computation, coding theory and other applications. We link these two objects, showing that the number of $i$-bit binary signed-digit representations of an integer $n<2^i$ is the $(2^i-n)^\text{th}$ element in Stern's diatomic sequence. This correspondence makes the vast range of results known about the Stern diatomic sequence available for consideration in the study of binary signed-digit integers, and vice versa. Applications of this relationship discussed in this paper include a weight-distribution theorem for BSD representations, linking these representations to Stern polynomials, a recursion for the number of optimal BSD representations of an integer along with their Hamming weight, stemming from an easy recursion for the leading coefficients and degrees of Stern polynomials, and the identification of all integers having a maximal number of such representations.

Number Theory,Discrete Mathematics,Combinatorics
"Negative probabilities" as relative probabilistic expressions

John Realpe-Gómez

DOI: https://doi.org/10.48550/arXiv.1906.05712

2019-06-13

Abstract:Here we briefly discuss how negative numbers, or "negative probabilities", can naturally arise in probabilistic expressions and be given an operational interpretation. Like the use of negative numbers in arithmetical expressions, the use of negative probabilities can have substantial practical value. Indeed, some of the ideas discussed here have led to stochastic simulation algorithms that require much less memory than the best classical algorithms known to date [<a class="link-https" data-arxiv-id="1906.00263" href="https://arxiv.org/abs/1906.00263">arXiv:1906.00263</a>].

Statistical Mechanics
On the Representation of Integers by Binary Forms Defined by Means of the Relation $(x + yi)^n = R_n(x, y) + J_n(x, y)i$

A. Mosunov

DOI: https://doi.org/10.2140/moscow.2022.11.71

2022-03-07

Abstract:Let $F$ be a binary form with integer coefficients, non-zero discriminant and degree $d \geq 3$. Let $R_F(Z)$ denote the number of integers of absolute value at most $Z$ which are represented by $F$. In 2019 Stewart and Xiao proved that $R_F(Z) \sim C_FZ^{2/d}$ for some positive number $C_F$. We compute $C_{R_n}$ and $C_{J_n}$ for the binary forms $R_n(x, y)$ and $J_n(x, y)$ defined by means of the relation $ (x + yi)^n = R_n(x, y) + J_n(x, y)i$, where the variables $x$ and $y$ are real.

Number Theory
On efficient normal bases over binary fields

Mohamadou Sall,M. Anwar Hasan

2024-02-18

Abstract:Binary field extensions are fundamental to many applications, such as multivariate public key cryptography, code-based cryptography, and error-correcting codes. Their implementation requires a foundation in number theory and algebraic geometry and necessitates the utilization of efficient bases. The continuous increase in the power of computation, and the design of new (quantum) computers increase the threat to the security of systems and impose increasingly demanding encryption standards with huge polynomial or extension degrees. For cryptographic purposes or other common implementations of finite fields arithmetic, it is essential to explore a wide range of implementations with diverse bases. Unlike some bases, polynomial and Gaussian normal bases are well-documented and widely employed. In this paper, we explore other forms of bases of $\mathbb{F}_{2^n}$ over $\mathbb{F}_2$ to demonstrate efficient implementation of operations within different ranges. To achieve this, we leverage results on fast computations and elliptic periods introduced by Couveignes and Lercier, and subsequently expanded upon by Ezome and Sall. This leads to the establishment of new tables for efficient computation over binary fields.

Cryptography and Security
Non-standard binary representations and the Stern sequence

Katie Anders,Madeline Locus Dawsey,Rajat Gupta,Joseph Vandehey

2023-08-15

Abstract:We show that the number of short binary signed-digit representations of an integer $n$ is equal to the $n$-th term in the Stern sequence. Various proofs are provided, including direct, bijective, and generating function proofs. We also show that this result can be derived from recent work of Monroe on binary signed-digit representations of a fixed length.

Combinatorics,Number Theory
Binary domain generalization for sparsifying binary neural networks

Riccardo Schiavone,Francesco Galati,Maria A. Zuluaga

2023-06-23

Abstract:Binary neural networks (BNNs) are an attractive solution for developing and deploying deep neural network (DNN)-based applications in resource constrained devices. Despite their success, BNNs still suffer from a fixed and limited compression factor that may be explained by the fact that existing pruning methods for full-precision DNNs cannot be directly applied to BNNs. In fact, weight pruning of BNNs leads to performance degradation, which suggests that the standard binarization domain of BNNs is not well adapted for the task. This work proposes a novel more general binary domain that extends the standard binary one that is more robust to pruning techniques, thus guaranteeing improved compression and avoiding severe performance losses. We demonstrate a closed-form solution for quantizing the weights of a full-precision network into the proposed binary domain. Finally, we show the flexibility of our method, which can be combined with other pruning strategies. Experiments over CIFAR-10 and CIFAR-100 demonstrate that the novel approach is able to generate efficient sparse networks with reduced memory usage and run-time latency, while maintaining performance.

Machine Learning
On the Number of Real Zeros of Random Sparse Polynomial Systems

Alperen A. Ergür,Máté L. Telek,Josué Tonelli-Cueto

2023-08-19

Abstract:Consider a random system $\mathfrak{f}_1(x)=0,\ldots,\mathfrak{f}_n(x)=0$ of $n$ random real polynomials in $n$ variables, where each $\mathfrak{f}_k$ has a prescribed set of exponent vectors in a set $A_k\subseteq \mathbb{Z}^n$ of size $t_k$. Assuming that the coefficients of the $\mathfrak{f}_k$ are independent Gaussian of any variance, we prove that the expected number of zeros of the random system in the positive orthant is bounded from above by $4^{-n} \prod_{k=1}^n t_k(t_k-1)$. This result is a probabilisitc version of Kushnirenko's conjecture; it provides a bound that only depends on the number of terms and is independent of their degree.

Algebraic Geometry,Probability
A note on simple zeros related to Dedekind zeta functions

Wei Zhang

DOI: https://doi.org/10.1007/s11139-024-00831-8

2024-03-24

The Ramanujan Journal

Abstract:We give a conditional lower bound on the number of non-trivial simple zeros for the Dedekind zeta function , where K is a quadratic number field. The conditional result is given by assuming a Lindelöf condition on average (in the sense) for both and , which can be seen as a stronger version of Conrey–Gonek–Ghosh's (Invent Math 86:563–576, 1986) conditional result. This improves upon the work of Wu and Zhao (Mathematika 65:851–861, 2019), who had a similar result.

mathematics
Non-Binary Covering Codes for Low-Access Computations

Vinayak Ramkumar,Netanel Raviv,Itzhak Tamo

2024-05-09

Abstract:Given a real dataset and a computation family, we wish to encode and store the dataset in a distributed system so that any computation from the family can be performed by accessing a small number of nodes. In this work, we focus on the families of linear computations where the coefficients are restricted to a finite set of real values. For two-valued computations, a recent work presented a scheme that gives good feasible points on the access-redundancy tradeoff. This scheme is based on binary covering codes having a certain closure property. In a follow-up work, this scheme was extended to all finite coefficient sets, using a new additive-combinatorics notion called coefficient complexity. In the present paper, we explore non-binary covering codes and develop schemes that outperform the state-of-the-art for some coefficient sets. We provide a more general coefficient complexity definition and show its applicability to the access-redundancy tradeoff.

Information Theory

On the sparsity of binary numbers

A New Spatial Encoding Method for Sparse Binary Data

Sparse graph counting and Kelley-Meka bounds for binary systems

Composition of Binary Quadratic Forms over Number Fields

On the Negation of discrete Z-numbers

Adaptive Quantization for Hashing: an Information-Based Approach to Learning Binary Codes.

Beyond Countable Alphabets: an Extension of the Information-Spectrum Approach.

A Fibonacci analogue of the two's complement numeration system

Turing Compute Model for Non-negative Binary Numbers.

BBS: Bi-directional Bit-level Sparsity for Deep Learning Acceleration

Number of integers represented by families of binary forms II: binomial forms

Weight Enumerators for Nonbinary Asymmetric Quantum Codes and Their Applications.

Binary Signed-Digit Integers, the Stern Diatomic Sequence and Stern Polynomials

"Negative probabilities" as relative probabilistic expressions

On the Representation of Integers by Binary Forms Defined by Means of the Relation $(x + yi)^n = R_n(x, y) + J_n(x, y)i$

On efficient normal bases over binary fields

Non-standard binary representations and the Stern sequence

Binary domain generalization for sparsifying binary neural networks

On the Number of Real Zeros of Random Sparse Polynomial Systems

A note on simple zeros related to Dedekind zeta functions

Non-Binary Covering Codes for Low-Access Computations