Abstract:With the rapid developments in video processing technologies, video data have increased rapidly and become popular in our daily life for both professional and consumer applications such as surveillance, education and entertainment. Because of the increasing processing workload, more and more queries with expensive video predicates are being implemented in a parallel environment for better performance. Such requirements entail that the data management system not only be able to store and access video content, but also be able to optimize queries that have expensive video predicates in an effective and efficient way in a cloud environment. In previous research literatures, parallel and distributed policies and query optimizations in relational database management systems are often based on the disk input/output (I/O) cost of involved operations and network transmission cost. However, for a query that contains expensive video predicates in a cloud environment, the traditional cost estimation model does not work well. Although researchers have proposed some approaches that can solve the problem in certain situations, there are still some unresolved issues, and these approaches need further optimizations. This paper is motivated by a real-world large supermarket business data and video surveillance data management scenario in a parallel environment. By considering the characteristics of video data and their expensive processing, we present methods named operating results buffer and operating results buffer-C for implementing expensive video predicates at simple node, mapping video data and executing expensive video predicates in a cloud environment, which reduce the cost of video data transmission and the invoking times of expensive video predicates. We propose a novel query optimization approach that reconstructs the join order-based estimation for attribute cardinality and computes the total cost with I/O, network and expensive processing. This approach reduces the invoking times of expensive video predicates to a greater degree and gives a better solution for mixed query optimization, which contains traditional data types and large object operations in a cloud environment. Our query performance improves by 30% to 80% compared with existing expensive predicates query optimization methods. Copyright (c) 2011 John Wiley & Sons, Ltd.

Enhancing Query Performance by Avoiding Negative Interactions

Schema-Driven Performance Evaluation for Highly Concurrent Scenarios.

Optimization Factor Analysis Of Large-Scale Join Queries On Different Platforms

A collaborative performance tuning approach for Portal-based web sites

Hybrid Performance Modeling And Analyzing Of Parallel Systems

New Distributed Spatial Query Optimization Approach by Using Query Analyzer

Survey on performance optimization for database systems

AQP++: Connecting Approximate Query Processing with Aggregate Precomputation for Interactive Analytics

Database Query Optimization Based On Parallel Ant Colony Algorithm

Query optimization for massively parallel data processing.

Optimizing Communications in Processing Data Integration Queries

AQUA+: Query Optimization for Hybrid Database-MapReduce System.

Efficient Query Re-optimization with Judicious Subquery Selections

Optimizing the parallel adaptive indexing algorithm on mul ti-co re CPUs

Efficient Dynamic Workload Balancing Join Algorithm in Parallel Database

Multi-Resource Parallel Query Scheduling and Optimization

Concurrent analytical query processing with GPUs

Locality Sensitive Hashing for Optimizing Subgraph Query Processing in Parallel Computing Systems.

Understanding and Optimizing Conjunctive Predicates Under Memory-Efficient Storage Layouts

Multiple Query Optimization in PBASE/3

Optimizing queries with expensive video predicates in cloud environment.