Abstract:Recently big data and its applications had sharp growth in various fields such as IoT, bioinformatics, eCommerce, and social media. The huge volume of data incurred enormous challenges to the architecture, infrastructure, and computing capacity of IT systems. Therefore, the compelling need of the scientific and industrial community is large-scale and robust computing systems. Since one of the characteristics of big data is value, data should be published for analysts to extract useful patterns from them. However, data publishing may lead to the disclosure of individuals’ private information. Among the modern parallel computing platforms, Apache Spark is a fast and in-memory computing framework for large-scale data processing that provides high scalability by introducing the resilient distributed dataset (RDDs). In terms of performance, Due to in-memory computations, it is 100 times faster than Hadoop. Therefore, Apache Spark is one of the essential frameworks to implement distributed methods for privacy-preserving in big data publishing (PPBDP). This paper uses the RDD programming of Apache Spark to propose an efficient parallel implementation of a new computing model for big data anonymization. This computing model has three-phase of in-memory computations to address the runtime, scalability, and performance of large-scale data anonymization. The model supports partition-based data clustering algorithms to preserve the λ-diversity privacy model by using transformation and actions on RDDs. Therefore, the authors have investigated Spark-based implementation for preserving the λ-diversity privacy model by two designed City block and Pearson distance functions. The results of the paper provide a comprehensive guideline allowing the researchers to apply Apache Spark in their own researches.

Towards Real-Time Privacy Preservation: A Streaming Location Anonymous Method Based On Distributed Framework

Dissemination of Anonymized Streaming Data.

Preserving Location Privacy for Location-Based Services with Continuous Queries on Road Network

Preventing Location-based Inference Attack in Location Based Services

A distributed computing model for big data anonymization in the networks

Achieving Absolute Privacy Preservation in Continuous Query Road Network Services.

CoPrivacy: A Collaborative Location Privacy-Preserving Method Without Cloaking Region

Real-time and private spatio-temporal data aggregation with local differential privacy

Anonymizing Big Data Streams Using In-memory Processing: A Novel Model Based on One-time Clustering

Traffic Information Publication with Privacy Preservation

An Efficient Method for Privacy Preserving Location Queries

Cache-Aware Query Processing With User Privacy Protection In Location-Based Services

Preservation of Implicit Privacy in Spatio-Temporal Data Publication

A Real-Time Location Privacy Protection Method Based on Space Transformation

Scalable Local-Recoding Anonymization using Locality Sensitive Hashing for Big Data Privacy Preservation

Differentially Private Publication of Streaming Trajectory Data.

Proximity-Aware Local-Recoding Anonymization with MapReduce for Scalable Big Data Privacy Preservation in Cloud

Improving Performance for Geo-Distributed Data Process in Wide-Area.

Optimal Locally Private Data Stream Analytics

Rescuedp: Real-Time Spatio-Temporal Crowd-Sourced Data Publishing with Differential Privacy

A Privacy Preserving Scheme for Nearest Neighbor Query