Randomized Bit Vector

Lin Sun,Lan Zhang,Xiaojun Ye

DOI: https://doi.org/10.1145/3269206.3271703

2018-01-01

Abstract:Recently, many methods have been proposed to prevent privacy leakage in record linkage by encoding record pair data into another anonymous space. Nevertheless, they cannot perform well in some circumstances due to high computational complexities, low privacy guarantees or loss of data utility.

What problem does this paper attempt to address?

High performance reversible data hiding for block truncation coding compressed images

Wei Sun,Zhe-Ming Lu,Yu-Chun Wen,Fa-Xin Yu,Rong-Jun Shen

DOI: https://doi.org/10.1007/s11760-011-0238-4

2011-01-01

Abstract:Reversible data hiding has been a hot research topic because it can recover both the host media and hidden data without distortion. Because most digital images are stored and transmitted in compressed forms, such as JPEG, vector quantization, and block truncation coding (BTC), the reversible data hiding schemes in compressed domains have been paid more and more attention. Compared with transform coding, BTC has a significantly low complexity and less memory requirement, it therefore becomes an ideal data hiding domain. Traditional data hiding schemes in the BTC domain modify the BTC encoding stage or BTC-compressed data according to the secret bits, and they have a relatively low efficiency and meanwhile may reduce the image quality. This paper presents a novel reversible data hiding scheme based on the joint neighbor coding technique for BTC-compressed images by further losslessly encoding the BTC-compressed data according to the secret bits. First, BTC is performed on the original image to obtain the BTC-compressed data that can be represented by a high mean table, a low mean table, and a bitplane sequence. Then, the secret data are losslessly embedded in both the high mean and low mean tables. Our hiding scheme is a lossless method based on the relation among the current value and the neighboring ones in mean tables. In addition, it can averagely embed 2 bits in each mean value, which increases the capacity and efficiency. Experimental results show that our scheme outperforms three existing BTC-based data hiding works, in terms of the bit rate, capacity, and efficiency.
Privacy-Aware Randomized Quantization via Linear Programming

Zhongteng Cai,Xueru Zhang,Mohammad Mahdi Khalili

2024-06-02

Abstract:Differential privacy mechanisms such as the Gaussian or Laplace mechanism have been widely used in data analytics for preserving individual privacy. However, they are mostly designed for continuous outputs and are unsuitable for scenarios where discrete values are necessary. Although various quantization mechanisms were proposed recently to generate discrete outputs under differential privacy, the outcomes are either biased or have an inferior accuracy-privacy trade-off. In this paper, we propose a family of quantization mechanisms that is unbiased and differentially private. It has a high degree of freedom and we show that some existing mechanisms can be considered as special cases of ours. To find the optimal mechanism, we formulate a linear optimization that can be solved efficiently using linear programming tools. Experiments show that our proposed mechanism can attain a better privacy-accuracy trade-off compared to baselines.

Cryptography and Security,Artificial Intelligence
PrivBV: Distance-aware Encoding for Distributed Data with Local Differential Privacy

Lin Sun,Guolou Ping,Xiaojun Ye

DOI: https://doi.org/10.26599/tst.2021.9010027

2022-01-01

Abstract:Recently,local differential privacy(LDP)has been used as the de facto standard for data sharing and analyzing with high-level privacy guarantees.Existing LDP-based mechanisms mainly focus on learning statistical information about the entire population from sensitive data.For the first time in the literature,we use LDP for distance estimation between distributed data to support more complicated data analysis.Specifically,we propose PrivBV—a locally differentially private bit vector mechanism with a distance-aware property in the anonymized space.We also present an optimization strategy for reducing privacy leakage in the high-dimensional space.The distance-aware property of PrivBV brings new insights into complicated data analysis in distributed environments.As study cases,we show the feasibility of applying PrivBV to privacy-preserving record linkage and non-interactive clustering.Theoretical analysis and experimental results demonstrate the effectiveness of the proposed scheme.
Discrete Double-Bit Hashing

Shengnan Wang,Chunguang Li

DOI: https://doi.org/10.1109/tbdata.2019.2946616

2019-01-01

IEEE Transactions on Big Data

Abstract:Hashing has been widely used for nearest neighbors search over big data. Hashing encodes high dimensional data points into binary codes. Most hashing methods use the single-bit quantization (SBQ) strategy for coding the data. However, this strategy often encodes neighboring points into totally different bits. Recently, a double-bit quantization (DBQ) strategy was proposed, which can better preserve the similarity of the data. The hashing problems are generally NP-hard, due to the discrete constraints. For tractability, some relaxation methods were proposed by discarding the discrete constraints. However, such a manner makes the hash codes less effective, due to the large quantization error. To obtain high-quality hash codes, some discrete hashing methods were proposed, which directly solve the hashing problem without any relaxations. However, the existing discrete hashing methods can only deal with single-bit hashing. In this paper, we propose a discrete hashing method to solve double-bit hashing problems. To address the difficulty brought by the discrete constraints, we propose a method to transform the discrete hashing problem into an equivalent continuous optimization problem. Then, we devise algorithms based on DC (difference of convex functions) programming to solve the problem. Numerical experiments are provided to show the superiority of the proposed methods.
Double-Bit Quantization for Hashing

Weihao Kong,Wu-Jun Li

DOI: https://doi.org/10.1609/aaai.v26i1.8208

2021-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Hashing, which tries to learn similarity-preserving binary codes for data representation, has been widely used for efficient nearest neighbor search in massive databases due to its fast query speed and low storage cost. Because it is NP hard to directly compute the best binary codes for a given data set, mainstream hashing methods typically adopt a two-stage strategy. In the first stage, several projected dimensions of real values are generated. Then in the second stage, the real values will be quantized into binary codes by thresholding. Currently, most existing methods use one single bit to quantize each projected dimension. One problem with this single-bit quantization (SBQ) is that the threshold typically lies in the region of the highest point density and consequently a lot of neighboring points close to the threshold will be hashed to totally different bits, which is unexpected according to the principle of hashing. In this paper, we propose a novel quantization strategy, called double-bit quantization (DBQ), to solve the problem of SBQ. The basic idea of DBQ is to quantize each projected dimension into double bits with adaptively learned thresholds. Extensive experiments on two real data sets show that our DBQ strategy can significantly outperform traditional SBQ strategy for hashing.
Engineering Compact Data Structures for Rank and Select Queries on Bit Vectors

Florian Kurpicz

2022-11-07

Abstract:Bit vectors are fundamental building blocks of many succinct data structures. They can be used to represent graphs, are an important part of many text indices in the form of the wavelet tree, and can be used to encode ordered sequences of integers as Elias-Fano codes. To do so, two queries have to be answered: namely rank and select queries. Given a position in the bit vector, a rank query returns the number of 1-bits before that position. A select query, given a parameter $j$, returns the position of the $j$-th 1-bit. On a length-n bit vector, both queries can be answered in $O(1)$ time and require $o(n)$ bits of additional space. In practice, the smallest (uncompressed) rank and select data structure cs-poppy has a space overhead of $\approx$ 3.51% [Zhou et al., SEA 13]. In this paper, we present an improved rank and select data structure that has the same space overhead but can answer queries up to 8% (rank) and 16.5% (select) faster compared with cs-poppy.

Data Structures and Algorithms
Randomizing RFID Private Authentication

Qingsong Yao,Yong Qi,Jinsong Han,Jizhong Zhao,Xiangyang Li,Yunhao Liu

DOI: https://doi.org/10.1109/percom.2009.4912773

2009-01-01

Abstract:Privacy protection is increasingly important during authentications in Radio Frequency Identification (RFID) systems. In order to achieve high-speed authentication in large-scale RFID systems, researchers propose tree-based approaches, in which any pair of tags share a number of key components. Such designs, being efficient, often fail to achieve forward secrecy and resistance to attacks, such as compromising and desynchronization. Indeed, these attacks may still take effect even after a tag successfully finishes the authentication and key-updating procedure. To address the issue, we propose a lightweight RFID private authentication protocol, RWP, based on the random walk concept. RWP also provides the forward security and temporal resistance to the tracking attack. The analysis results show that RWP effectively enhances the security protection for RFID private authentication, and increases the authentication efficiency from O(logN) to O(1).
Privacy-Preserving Distributed Algorithm for Sparse Vector Sum

Sheng Zhong

DOI: https://doi.org/10.36045/bbms/1274896202

2010-01-01

Bulletin of the Belgian Mathematical Society - Simon Stevin

Abstract:We study the following problem: B-0 and B-1 each has a sparse input vector V-0 and V-1; for each j we need to decide whether B-0[j] + B-1[j] > t. We give a privacy-preserving algorithm, in which B-0 and B-1 do not need to reveal any information about their input vectors to each other, except the output of algorithm. Our algorithm is highly efficient.
Private DNA Sequencing: Hiding Information in Discrete Noise

Kayvon Mazooji,Roy Dong,Ilan Shomorony

2024-11-04

Abstract:When an individual's DNA is sequenced, sensitive medical information becomes available to the sequencing laboratory. A recently proposed way to hide an individual's genetic information is to mix in DNA samples of other individuals. We assume that the genetic content of these samples is known to the individual but unknown to the sequencing laboratory. Thus, these DNA samples act as "noise" to the sequencing laboratory, but still allow the individual to recover their own DNA samples afterward. Motivated by this idea, we study the problem of hiding a binary random variable $X$ (a genetic marker) with the additive noise provided by mixing DNA samples, using mutual information as a privacy metric. This is equivalent to the problem of finding a worst-case noise distribution for recovering $X$ from the noisy observation among a set of feasible discrete distributions. We characterize upper and lower bounds to the solution of this problem, which are empirically shown to be very close. The lower bound is obtained through a convex relaxation of the original discrete optimization problem, and yields a closed-form expression. The upper bound is computed via a greedy algorithm for selecting the mixing proportions.

Information Theory,Cryptography and Security
A New Method of Privacy Protection: Random K-Anonymous

Fagen Song,Tinghuai Ma,Yuan Tian,Mznah Al-Rodhaan

DOI: https://doi.org/10.1109/access.2019.2919165

IF: 3.9

2019-01-01

IEEE Access

Abstract:A new k-anonymous method which is different from traditional k-anonymous was proposed to solve the problem of privacy protection. Specifically, numerical data achieves k-anonymous by adding noises, and categorical data achieves k-anonymous by using randomization. Using the above two methods, the drawback that at least k elements must have the same quasi identifier in the k-anonymous data set has been solved. Since the process of finding anonymous equivalence is very time consuming, a two-step clustering method is used to divide the original data set into equivalence classes. First, the original data set is divided into several different sub-datasets, and then the equivalence classes are formed in the sub-datasets, thus greatly reducing the computational cost of finding anonymous equivalence classes. The experiments are conducted on three different data sets, and the results show that the proposed method is more efficient and the information loss of anonymous dataset is much smaller.
X-ray-driven multi-bit quantum random number generator

Guangshen Lin,Huanbo Feng,Shizhuo Li,Feng Xie,Zhenrong Zhang,Hongbang Liu,Kejin Wei

DOI: https://doi.org/10.1364/oe.524548

IF: 3.8

2024-06-22

Optics Express

Abstract:Guangshen Lin, Huanbo Feng, Shizhuo Li, Feng Xie, Zhenrong Zhang, Hongbang Liu, Kejin Wei Random numbers are vital in cryptography, simulation modeling, and gambling. This study presents a scheme for a multi-bit quantum random ... [Opt. Express 32, 24432-24442 (2024)]

optics
Novel Location-Index Compression Mechanism Based on Bit Vector

CHEN Jian-ying,LIU Xin-song

DOI: https://doi.org/10.3969/j.issn.1001-3695.2011.05.047

2011-01-01

Abstract:To reduce the stress brought by shared resource in large-scale distributed system,tlis paper put forward a kind of novel location-index compression mechanism based on bit vector.It established on hybrid overlay network that was composed with three levels of district/site/node and peer-to-peer district level.After mapping sub nodes of district and site level agent nodes to corresponding bit vector,the location-index of many same replicas could be compressed to one record by bottom-up location-index publish and aggregating.Meanwhile,replicas in system could be located by query on corresponding bit vector.Application and experimental results indicate that this method can achieve high record compression ratio and improve the replica location efficiency.
A Suite of Efficient Randomized Algorithms for Streaming Record Linkage

Dimitrios Karapiperis,Christos Tjortjis,Vassilios S. Verykios

DOI: https://doi.org/10.1109/tkde.2024.3361022

IF: 9.235

2024-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Organizations leverage massive volumes of information and new types of data to generate unprecedented insights and improve their outcomes. Correctly identifying duplicate records that represent the same entity, such as user, customer, patient and so on, a process commonly known as record linkage, can improve service levels, accelerate sales, or elevate healthcare decision support. Towards this direction, blocking methods are used with the aim to group matching records in the same block using a combination of their attributes as blocking keys. This paper introduces a suite of randomized algorithms specifically crafted for streaming record linkage settings. Using a bounded in-memory data structure, in terms of the number of blocks and positions within each block, our algorithms guarantee that the most frequently accessed and the most recently used blocks remain in main memory and, additionally, the records within a block are renewed on a rolling basis. The operation of our algorithms rely on simple random choices, instead of utilizing cumbersome sorting data structures, which ensure that the probability of inactive blocks and older records to remain in main memory decays in order to free space for more promising blocks and fresher records, respectively. We also introduce an algorithm that performs approximate blocking to tackle the problem of misspellings and typos present in the blocking keys. The experimental evaluation showcases that our proposed algorithms scale efficiently to data streams by providing certain accuracy guarantees.

computer science, information systems, artificial intelligence,engineering, electrical & electronic
Distributed Clustering in the Anonymized Space with Local Differential Privacy

Lin Sun,Jun Zhao,Xiaojun Ye

DOI: https://doi.org/10.48550/arxiv.1906.11441

2019-01-01

Abstract:Clustering and analyzing on collected data can improve user experiences and quality of services in big data, IoT applications. However, directly releasing original data brings potential privacy concerns, which raises challenges and opportunities for privacy-preserving clustering. In this paper, we study the problem of non-interactive clustering in distributed setting under the framework of local differential privacy. We first extend the Bit Vector, a novel anonymization mechanism to be functionality-capable and privacy-preserving. Based on the modified encoding mechanism, we propose kCluster algorithm that can be used for clustering in the anonymized space. We show the modified encoding mechanism can be easily implemented in existing clustering algorithms that only rely on distance information, such as DBSCAN. Theoretical analysis and experimental results validate the effectiveness of the proposed schemes.
Randomization Resilient To Sensitive Reconstruction

Ke Wang,Chao Han,Ada Waichee Fu

DOI: https://doi.org/10.48550/arXiv.1202.3179

2012-02-15

Databases

Abstract:With the randomization approach, sensitive data items of records are randomized to protect privacy of individuals while allowing the distribution information to be reconstructed for data analysis. In this paper, we distinguish between reconstruction that has potential privacy risk, called micro reconstruction, and reconstruction that does not, called aggregate reconstruction. We show that the former could disclose sensitive information about a target individual, whereas the latter is more useful for data analysis than for privacy breaches. To limit the privacy risk of micro reconstruction, we propose a privacy definition, called (epsilon,delta)-reconstruction-privacy. Intuitively, this privacy notion requires that micro reconstruction has a large error with a large probability. The promise of this approach is that micro reconstruction is more sensitive to the number of independent trials in the randomization process than aggregate reconstruction is; therefore, reducing the number of independent trials helps achieve (epsilon,delta)-reconstruction-privacy while preserving the accuracy of aggregate reconstruction. We present an algorithm based on this idea and evaluate the effectiveness of this approach using real life data sets.
Adaptive Dynamic Bitvectors

Gonzalo Navarro

2024-07-30

Abstract:While operations \emph{rank} and \emph{select} on static bitvectors can be supported in constant time, lower bounds show that supporting updates raises the cost per operation to $\Theta(\log n/ \log\log n)$. This is a shame in scenarios where updates are possible but uncommon. We develop a representation of bitvectors that supports all the operations in $O(\log(n/q))$ amortized time. Our experimental results support the theoretical findings, displaying speedups of orders of magnitude compared to standard dynamic implementations.

Data Structures and Algorithms
Private Wasserstein Distance with Random Noises

Wenqian Li,Haozhi Wang,Zhe Huang,Yan Pang

2024-04-10

Abstract:Wasserstein distance is a principle measure of data divergence from a distributional standpoint. However, its application becomes challenging in the context of data privacy, where sharing raw data is restricted. Prior attempts have employed techniques like Differential Privacy or Federated optimization to approximate Wasserstein distance. Nevertheless, these approaches often lack accuracy and robustness against potential attack. In this study, we investigate the underlying triangular properties within the Wasserstein space, leading to a straightforward solution named TriangleWad. This approach enables the computation of Wasserstein distance between datasets stored across different entities. Notably, TriangleWad is 20 times faster, making raw data information truly invisible, enhancing resilience against attacks, and without sacrificing estimation accuracy. Through comprehensive experimentation across various tasks involving both image and text data, we demonstrate its superior performance and generalizations.

Machine Learning,Artificial Intelligence
RaBitQ: Quantizing High-Dimensional Vectors with a Theoretical Error Bound for Approximate Nearest Neighbor Search

Jianyang Gao,Cheng Long

2024-05-21

Abstract:Searching for approximate nearest neighbors (ANN) in the high-dimensional Euclidean space is a pivotal problem. Recently, with the help of fast SIMD-based implementations, Product Quantization (PQ) and its variants can often efficiently and accurately estimate the distances between the vectors and have achieved great success in the in-memory ANN search. Despite their empirical success, we note that these methods do not have a theoretical error bound and are observed to fail disastrously on some real-world datasets. Motivated by this, we propose a new randomized quantization method named RaBitQ, which quantizes $D$-dimensional vectors into $D$-bit strings. RaBitQ guarantees a sharp theoretical error bound and provides good empirical accuracy at the same time. In addition, we introduce efficient implementations of RaBitQ, supporting to estimate the distances with bitwise operations or SIMD-based operations. Extensive experiments on real-world datasets confirm that (1) our method outperforms PQ and its variants in terms of accuracy-efficiency trade-off by a clear margin and (2) its empirical performance is well-aligned with our theoretical analysis.

Databases,Data Structures and Algorithms,Information Retrieval
Affinity Preserving Quantization For Hashing: A Vector Quantization Approach To Learning Compact Binary Codes

Zhe Wang,Ling-Yu Duan,Tiejun Huang,Wen Gao

DOI: https://doi.org/10.1609/aaai.v30i1.10098

2016-01-01

Abstract:Hashing techniques are powerful for approximate nearest neighbour (ANN) search. Existing quantization methods in hashing are all focused on scalar quantization (SQ) which is inferior in utilizing the inherent data distribution. In this paper, we propose a novel vector quantization (VQ) method named affinity preserving quantization (APQ) to improve the quantization quality of projection values, which has significantly boosted the performance of state-of-the-art hashing techniques. In particular, our method incorporates the neighbourhood structure in the pre-and post-projection data space into vector quantization. APQ minimizes the quantization errors of projection values as well as the loss of affinity property of original space. An effective algorithm has been proposed to solve the joint optimization problem in APQ, and the extension to larger binary codes has been resolved by applying product quantization to APQ. Extensive experiments have shown that APQ consistently outperforms the state-of-the- art quantization methods, and has significantly improved the performance of various hashing techniques.
Batched Ranged Random Integer Generation

Nevin Brackett-Rozinsky,Daniel Lemire

DOI: https://doi.org/10.1002/spe3369

2024-08-20

Abstract:Pseudorandom values are often generated as 64-bit binary words. These random words need to be converted into ranged values without statistical bias. We present an efficient algorithm to generate multiple independent uniformly-random bounded integers from a single uniformly-random binary word, without any bias. In the common case, our method uses one multiplication and no division operations per value produced. In practice, our algorithm can more than double the speed of unbiased random shuffling for small to moderately large arrays.

Data Structures and Algorithms

Randomized Bit Vector

High performance reversible data hiding for block truncation coding compressed images

Privacy-Aware Randomized Quantization via Linear Programming

PrivBV: Distance-aware Encoding for Distributed Data with Local Differential Privacy

Discrete Double-Bit Hashing

Double-Bit Quantization for Hashing

Engineering Compact Data Structures for Rank and Select Queries on Bit Vectors

Randomizing RFID Private Authentication

Privacy-Preserving Distributed Algorithm for Sparse Vector Sum

Private DNA Sequencing: Hiding Information in Discrete Noise

A New Method of Privacy Protection: Random K-Anonymous

X-ray-driven multi-bit quantum random number generator

Novel Location-Index Compression Mechanism Based on Bit Vector

A Suite of Efficient Randomized Algorithms for Streaming Record Linkage

Distributed Clustering in the Anonymized Space with Local Differential Privacy

Randomization Resilient To Sensitive Reconstruction

Adaptive Dynamic Bitvectors

Private Wasserstein Distance with Random Noises

RaBitQ: Quantizing High-Dimensional Vectors with a Theoretical Error Bound for Approximate Nearest Neighbor Search

Affinity Preserving Quantization For Hashing: A Vector Quantization Approach To Learning Compact Binary Codes

Batched Ranged Random Integer Generation