Abstract:Recently big data and its applications had sharp growth in various fields such as IoT, bioinformatics, eCommerce, and social media. The huge volume of data incurred enormous challenges to the architecture, infrastructure, and computing capacity of IT systems. Therefore, the compelling need of the scientific and industrial community is large-scale and robust computing systems. Since one of the characteristics of big data is value, data should be published for analysts to extract useful patterns from them. However, data publishing may lead to the disclosure of individuals’ private information. Among the modern parallel computing platforms, Apache Spark is a fast and in-memory computing framework for large-scale data processing that provides high scalability by introducing the resilient distributed dataset (RDDs). In terms of performance, Due to in-memory computations, it is 100 times faster than Hadoop. Therefore, Apache Spark is one of the essential frameworks to implement distributed methods for privacy-preserving in big data publishing (PPBDP). This paper uses the RDD programming of Apache Spark to propose an efficient parallel implementation of a new computing model for big data anonymization. This computing model has three-phase of in-memory computations to address the runtime, scalability, and performance of large-scale data anonymization. The model supports partition-based data clustering algorithms to preserve the λ-diversity privacy model by using transformation and actions on RDDs. Therefore, the authors have investigated Spark-based implementation for preserving the λ-diversity privacy model by two designed City block and Pearson distance functions. The results of the paper provide a comprehensive guideline allowing the researchers to apply Apache Spark in their own researches.

Dissemination of Anonymized Streaming Data.

Fast Clustering-Based Anonymization Algorithm for Data Streams

IDEA: A Utility-Enhanced Approach to Incomplete Data Stream Anonymization

Distributed Anonymization for Multiple Data Providers in a Cloud System.

Privacy-preserving Incremental Data Dissemination

Fast clustering-based anonymization approaches with time constraints for data streams

Data-adaptive Privacy-Preserving Mechanism for Data Stream Pub-Lishing in Real-Time

Anonymizing Big Data Streams Using In-memory Processing: A Novel Model Based on One-time Clustering

Efficient approximation and privacy preservation algorithms for real time online evolving data streams

A distributed computing model for big data anonymization in the networks

Adaptive Differentially Private Data Stream Publishing in Spatio-temporal Monitoring of IoT

A divide-and-conquer approach to privacy-preserving high-dimensional big data release

An Incentive-Based Differential Privacy-Preserving Truth Discovery over Streaming Data

Towards Real-Time Privacy Preservation: A Streaming Location Anonymous Method Based On Distributed Framework

z-anonymity: Zero-Delay Anonymization for Data Streams

Peer-Owl: an Adaptive Data Dissemination Scheme for Peer-to-Peer Streaming Services.

A Sampling-Based Method for Highly Efficient Privacy-Preserving Data Publication.

DPI: Ensuring Strict Differential Privacy for Infinite Data Streaming

Anonymity-Based Privacy-Preserving Data Reporting for Participatory Sensing

Samplable Anonymous Aggregation for Private Federated Data Analysis

Rescuedp: Real-Time Spatio-Temporal Crowd-Sourced Data Publishing with Differential Privacy