Abstract:Increasing prevalence of large-scale distributed monitoring and computing environments such as sensor networks, scientific federations, Grids etc., has led to a renewed interest in the area of distributed query processing and optimization. In this paper we address a general, distributed multi-query processing problem motivated by the need to minimize the communication cost in these environments. Specifically we address the problem of optimally sharing data movement across the communication edges in a distributed communication network given a set of overlapping queries and query plans for them (specifying the operations to be executed). Most of the problem variations of our general problem can be shown to be NP-Hard by a reduction from the Steiner tree problem. However, we show that the problem can be solved optimally if the communication network is a tree, and present a novel algorithm for finding an optimal data movement plan. For general communication networks, we present efficient approximation algorithms for several variations of the problem. Finally, we present an experimental study over synthetic datasets showing both the need for exploiting the sharing of data movement and the effectiveness of our algorithms at finding such plans.

Query Optimization of Distributed Database Based on Parallel Genetic Algorithm and Max-Min Ant System

Optimization Factor Analysis Of Large-Scale Join Queries On Different Platforms

Database Query Optimization Based On Parallel Ant Colony Algorithm

Genetic algorithms in distribution network planning

Join Query Optimization Based on MapReduce under Skewed Data

A Novel Parallel Multi-Objective Genetic Algorithm And Its Application In Process Scheduling

Adaptive Multi-join Query Processing in PDBMS

New Distributed Spatial Query Optimization Approach by Using Query Analyzer

Distributed Parallel Genetic Algorithms Based on Multi-Agent Cooperation

A multiobjective genetic algorithm for distributed database management

Parallel and distributed architecture of genetic algorithm on Apache Hadoop and Spark

Optimization of sub-query processing in distributed data integration systems

Minimizing Communication Cost in Distributed Multi-Query Processing

Optimizing the Operation of Distributed Generation Using Genetic Algorithms

A distributed genetic algorithm for reactive power optimization

Massively Parallel SPMD Algorithm for Cluster Computing — Combining Genetic Algorithm with Uphill

Distributed Memetic Algorithm for Outsourced Database Fragmentation

On global query optimization in multidatabase systems

PARALLEL LOCAL SEARCH TO IMPROVE THE PERFORMANCE OF GENETIC ALGORITHMS

Locality Sensitive Hashing for Optimizing Subgraph Query Processing in Parallel Computing Systems.

Parallel Genetic Algorithms with Schema Migration