Abstract:With the rapid developments in video processing technologies, video data have increased rapidly and become popular in our daily life for both professional and consumer applications such as surveillance, education and entertainment. Because of the increasing processing workload, more and more queries with expensive video predicates are being implemented in a parallel environment for better performance. Such requirements entail that the data management system not only be able to store and access video content, but also be able to optimize queries that have expensive video predicates in an effective and efficient way in a cloud environment. In previous research literatures, parallel and distributed policies and query optimizations in relational database management systems are often based on the disk input/output (I/O) cost of involved operations and network transmission cost. However, for a query that contains expensive video predicates in a cloud environment, the traditional cost estimation model does not work well. Although researchers have proposed some approaches that can solve the problem in certain situations, there are still some unresolved issues, and these approaches need further optimizations. This paper is motivated by a real-world large supermarket business data and video surveillance data management scenario in a parallel environment. By considering the characteristics of video data and their expensive processing, we present methods named operating results buffer and operating results buffer-C for implementing expensive video predicates at simple node, mapping video data and executing expensive video predicates in a cloud environment, which reduce the cost of video data transmission and the invoking times of expensive video predicates. We propose a novel query optimization approach that reconstructs the join order-based estimation for attribute cardinality and computes the total cost with I/O, network and expensive processing. This approach reduces the invoking times of expensive video predicates to a greater degree and gives a better solution for mixed query optimization, which contains traditional data types and large object operations in a cloud environment. Our query performance improves by 30% to 80% compared with existing expensive predicates query optimization methods. Copyright (c) 2011 John Wiley & Sons, Ltd.

Accelerating Machine Learning Inference With Probabilistic Predicates

Optimizing Machine Learning Inference Queries with Correlative Proxy Models

Hydro: Adaptive Query Processing of ML Queries

Optimizing LLM Queries in Relational Workloads

Optimizing Query Predicates with Disjunctions for Column-Oriented Engines

Understanding and Optimizing Conjunctive Predicates Under Memory-Efficient Storage Layouts

Database Native Approximate Query Processing Based on Machine-Learning

Electra: Conditional Generative Model based Predicate-Aware Query Approximation

Efficiently Answering Durability Prediction Queries

Optimizing Queries with Expensive Video Predicates Based on Estimation of Attribute Cardinality

PLD+: Accelerating LLM inference by leveraging Language Model Artifacts

A Declarative System for Optimizing AI Workloads

Optimizing queries with expensive video predicates in cloud environment.

The Unreasonable Effectiveness of LLMs for Query Optimization

Scalable Relational Query Processing on Big Matrix Data

End-to-end Optimization of Machine Learning Prediction Queries

Answering Frequent Probabilistic Inference Queries in Databases

Semantic SQL -- Combining and optimizing semantic predicates in SQL

Revisiting Data Prefetching for Database Systems with Machine Learning Techniques

Predictive Indexing

Probabilistic Machine Learning for Healthcare