Research of Stage-by-Stage Executing Strategy and Query Processing Technology

Yi Wang

2000-01-01

Abstract:According to the features of the object oriented database and its query, the stage by stage executing strategy and the data operation parallel executing algorithm are proposed. The theoretical analysis and simulation results show that they are efficient and practical.

What problem does this paper attempt to address?

Schema-Driven Performance Evaluation for Highly Concurrent Scenarios.

Jingwei Zhang,Li Feng,Qing Yang,Yuming Lin

DOI: https://doi.org/10.1007/978-3-319-91455-8_2

2018-01-01

Abstract:Online applications needs to support highly concurrent access and to response to users as soon as possible. Two primary factors make the above requirements to be a technical challenge, one is the large user base, the other is the sharp rise in traffic caused by some specific activities, such as ticketing on 12306.cn during Spring Festival season, shopping on taobao.com during its dual 11 promotions, etc. For the latter, a core focus is how to expand the performance of those existing hardware and software and then to ensure the quality of services when a sharp rise on access happened. Since database schemas have a direct link with data access granularity, etc., this paper considers database schemas as an important factor for performance optimization on highly concurrent access and also covers other elements affecting access performance, such as cache, concurrency, etc., to analyze the performance factors for databases. Extensive experiments are designed to conduct both performance testing and analyzing under different schemas. The experimental results show that a reasonable configuration can contribute a good database performance, which provides factual basis for optimizing highly concurrent applications.
New Distributed Spatial Query Optimization Approach by Using Query Analyzer

LIN Jian,LIU Renyi,LIU Nan,ZHANG Feng

DOI: https://doi.org/10.3778/j.issn.1002-8331.2012.22.032

2012-01-01

Computer Engineering and Applications Journal

Abstract:In order to achieve interoperability between the distributed spatial databases,the user queries optimization of the distributed query processing is an important topic.This kind of distributed query refers to any data processing statement,which access each site of the database rather than the site initiated query requests.Confronted with several kinds of queries optimization problems,a new architecture of query analyzer is presented in this paper.The space selection and connection in complex spatial query is also discussed.In order to demonstrate the effectiveness of this approach,two example experiments are done.The results obtained from performance analysis show that the filters and modification is pivotal factors in queries optimization.This approach has a good effect on time and space cost compared with the traditional solutions.
Design and Implementation of OSCAR Query Optimizer

XU Ping-ge,BU Jia-jun,CHEN Chun

DOI: https://doi.org/10.3969/j.issn.1001-3695.2005.12.060

2005-01-01

Abstract:Query optimization is an important element of database manager system. First,this paper introdues importance of query optimization in database manager system and describes the common processing steps of OSCAR query optimization. Se￣condly,the paper mainly discuss the design and implementation of OSCAR query optimization.In query optimization module,the technique of query preprocessing and pulling subquery up is introduced,then the access path selection and the account method of const evaluation are discussed in detail.Finally,an analysis to experimental is given.It indicates that the query efficiency of optimized OSCR increases obviously.
Multiple Query Optimization in PBASE/3

Hong Chen,Shan Wang,Sheng Zhou

DOI: https://doi.org/10.1109/HPC.2000.843559

2000-01-01

Abstract:We proposed a multi-phase multi-query optimization approach (MMO) for the parallel database. MMO considers multiple objectives. It overcomes the limitations in the two-phase and one-phase approaches, and can be easily integrated into the traditional optimizer. We discussed the strategies and algorithms for searching CO, rewriting queries, cost-based optimization and parallelization in MMO. Theoretic analysis proves that the efficiency of the MMO optimizer is high and the strategies searching for CO has little influence to the performance.
Constructing Object/Relational System of High Performance

王甲民,宋擒豹,沈钧毅,李琳

DOI: https://doi.org/10.3969/j.issn.1000-3428.2002.01.040

2002-01-01

Abstract:Object-oriented technology is the most popular software development method, and relational model is wide-used data model. Combining the advantages of these technologies, the paper discusses how to construct the object applications for high performance with relational databases. ;;;
Enhancing Query Performance by Avoiding Negative Interactions

Zhang Qing-feng,Xu Jing,Li Shan-shan,Wang Qing-ju

DOI: https://doi.org/10.1109/hpcc.and.euc.2013.148

2013-01-01

Abstract:While optimizing database performance, parallel query technology can significantly improve the throughput and resource utilization of the database server. Interactions among different queries which run concurrently can have a great impact on system performance. However, conventional optimizing strategies of parallel query often only focus on individual queries rather than their interactions. In order to capture the impact of parallel query interactions, we propose an interaction-aware scheduling algorithm of parallel queries. Compared with other traditional algorithms, the experimental results demonstrate that our optimizing approach can effectively improve the database performance by avoiding the negative interactions. Finally, some future trends in this area are prospected and discussed.
A Comparison of Objects with Frames and OODBsXindong WuDepartment of Software

Xindong Wu

1995-01-01

Abstract:Objects and frames are two powerful technologies used in Software Engineering and Artiicial Intelligence respectively. Object-oriented databases are currently one of the most important research directions in the database community. This paper discusses and compares the three technologies by looking at their respective characteristics. Object technology in software engineering makes it easier to develop, maintain and reuse a wide range of applications. These applications are mainly concerned with data processing. Object orientation attempts to model the behaviour patterns of collections of cooperating physical entities in the real world. Object-oriented programming (OOP) provides a better way of deening data and procedures that are associated with these physical entities than conventional imperative languages such as C, Pascal and Fortran. OOP was rst discussed in the late 1960's when the so called \software crisis" began in large systems development. Methods have evolved since then and have shifted the emphasis from a problem of coding to object-oriented design (OOD). The primary aim of OOD is to improve productivity, increase quality and elevate the maintainability of large software systems 3]. The well deened and widely accepted principles are the concepts of the class, encapsulation, inheritance and polymorphism. At the core of OOD is the class which represents a real world entity by grouping all of its data attributes and procedural operations together into a neatly encapsulated package. Software productivity is improved primarily by reducing the amount of time required for detecting and removing defects from programming code. Reusing software, in the form of \class libraries" can produce startling increases in productivity and greatly reduce the amount of errors in a large program. However, the emphasis on productivity could have obscured the need for improvements in software quality. Processes that produce high-quality products early in development, such as analysis and design, can greatly reduce 1 errors discovered later in development such as coding and testing and can dramatically improve software quality 3]. Maintainability, the nal objective of OOD, is accomplished by separating the dynamic parts of a system from those parts which are stable. A robust system must be designed with the expectation of change according to the ever changing requirements of clients. Achieving all of these objectives together in a single system is always diicult to accomplish and more than often a trade-oo is necessary. With appropriate use, however, the principles of OOD will assist in achieving these goals. Abstraction is the principle of capturing …
Optimizing Communications in Processing Data Integration Queries

Jia Liu,Yongwei Wu,Guangwen Yang

DOI: https://doi.org/10.1109/chinagrid.2008.7

2008-01-01

Abstract:Since query processing of data integration needs to access data from numerous wide-distributed sources over network, it is crucial to investigate how to deal with the expensive communication overhead. A staged data integration model is introduced for grid environment in this paper. It takes advantage of the abundant computer nodes to process integrated query over a number of highly-distributed and high-volume data sources. The content-based scheduling algorithm in the model groups the queries over the similar data sources together to enhances the opportunities of data sharing among concurrent queries for the same data source. Furthermore, an approach of multiple queries optimization is proposed to exploit data sharing, and avoid redundant data transfer without sacrificing the autonomy of data sources as well. Experimental results validate that our algorithms improve data integration performance in terms of both communication traffic and response time.
Object-oriented parallel execution model

Genjiang Zhu,Li Xie,ZhongXiu Sun

1998-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:This paper proposes an object-oriented parallel execution model EM which aims to find more parallelism at run-time. EM uses reference and path analysis information for message receiving and sending control. Experimental results show that EM has better performance as comparing with the rollback mechanism.
Analysis of the possibilities of optimizing SQL queries

Piotr Rymarski,Grzegorz Kozieł

DOI: https://doi.org/10.35784/jcsi.2641

2021-06-30

Journal of Computer Sciences Institute

Abstract:Most of today's web applications run on relational database systems. Communication with them is possible through statements written in Structured Query Language (SQL). This paper presents the most popular relational database management systems and describes common ways to optimize SQL queries. Using the research environment based on fragment of the imdb.com database, implementing OracleDb, MySQL, Microsoft SQL Server and PostgreSQL engines, a number of test scenarios were performed. The aim was to check the performance changes of SQL queries resulting from syntax modication while maintaining the result, the impact of database organization, indexing and advanced mechanisms aimed at increasing the eciency of operations performed, delivered in the systems used. The tests were carried out using a proprietary application written in Java using the Hibernate framework.
Performance Optimization of Top-k Queries on Multicore Platform

WU Chao,SUN Guang-zhong,CHEN Guo-liang

DOI: https://doi.org/10.3969/j.issn.1000-1220.2012.07.019

2012-01-01

Abstract:With the development of web search engines,the concern on real-time performance of Top-k queries has attracted more and more attention.The author studies implement of classic algorithm No Random Access Algorithm in order to optimize performances of top-k queries on multi-core platforms.Based on multicore architecture,we use data structure modification,job scheduling optimization methods to modify NRA implement.Experiment results show that optimized implement gains about 59% sequential benefits and achieves nearly linear speedup when executed on multicore platform.
Une plate-forme dynamique pour l'évaluation des performances des bases de données à objets

Zhen He,Jérôme Darmont

DOI: https://doi.org/10.48550/arXiv.0704.3500

2007-04-26

Abstract:In object-oriented or object-relational databases such as multimedia databases or most XML databases, access patterns are not static, i.e., applications do not always access the same objects in the same order repeatedly. However, this has been the way these databases and associated optimisation techniques such as clustering have been evaluated up to now. This paper opens up research regarding this issue by proposing a dynamic object evaluation framework (DOEF). DOEF accomplishes access pattern change by defining configurable styles of change. It is a preliminary prototype that has been designed to be open and fully extensible. Though originally designed for the object-oriented model, it can also be used within the object-relational model with few adaptations. Furthermore, new access pattern change models can be added too. To illustrate the capabilities of DOEF, we conducted two different sets of experiments. In the first set of experiments, we used DOEF to compare the performances of four state of the art dynamic clustering algorithms. The results show that DOEF is effective at determining the adaptability of each dynamic clustering algorithm to changes in access pattern. They also led us to conclude that dynamic clustering algorithms can cope with moderate levels of access pattern change, but that performance rapidly degrades to be worse than no clustering when vigorous styles of access pattern change are applied. In the second set of experiments, we used DOEF to compare the performance of two different object stores: Platypus and SHORE. The use of DOEF exposed the poor swapping performance of Platypus.

Databases
Iterative Query Processing based on Unified Optimization Techniques

Kisung Park,Hojin Seo,Mostofa Kamal Rasel,Young-Koo Lee,Chanho Jeong,Sung Yeol Lee,Chungmin Lee,Dong-Hun Lee

DOI: https://doi.org/10.1145/3299869.3324960

2019-06-25

Abstract:Hybrid transactional and analytical processing (HTAP) systems like SAP HANA make it much simpler to manage both operational load and analytical queries without ETL, separate data warehouses, et al. To represent both transactional and analytical business logic in a single database system, stored procedures are often used to express analytical queries using control flow logic and DMLs. Optimizing these complex procedures requires a fair knowledge of imperative programming languages as well as the declarative query language. Therefore, unified optimization techniques considering both program and query optimization techniques are essential for achieving optimal query performance. In this paper, we propose a novel unified optimization technique for efficient iterative query processing. We present a notion of query motion that allows the movement of SQL queries in and out of a loop. Additionally, we exploit a new cost model that measures the quality of the execution plan with consideration for queries and loop iterations. We describe our experimental evaluation that demonstrates the benefit of our technique using both a standard decision support benchmark and real-world workloads. An extensive evaluation shows that our unified optimization technique enumerates plans that achieve performance improvements of up to an order of magnitude faster than plans generated by the existing loop-invariant code motion technique.
Performance Optimization in DBMS Applications

李春晓

DOI: https://doi.org/10.3969/j.issn.1000-7024.2003.11.017

2003-01-01

Abstract:Aiming at the performence problem in DBMS (Database Management System) applications, a stage model combined with software engineering is put forward. And then, the methods on how to improve the performance in the applications at every stage are introduced. As a system project on performance improving, it is not better if only paying attention to the special points but not regarding the project as a whole . So it is necessary to enhance our efficency consciousness from the beginning to the end in the whole application.
Effective Data Distribution And Reallocation Strategies For Fast Query Response In Distributed Query-Intensive Data Environments

Tengjiao Wang,Bishan Yang,Jun Gao,Dongqing Yang

DOI: https://doi.org/10.1007/978-3-540-78849-2_55

2008-01-01

Abstract:Modern large distributed applications, such as mobile communications and banking services, require fast responses to enormous and frequent query requests. This kind of application usually employs in a distributed query-intensive data environment, where the system response time significantly depends on ways of data distribution. Motivated by the efficiency need, we develop two novel strategies: a static data distribution strategy DDH and a dynamic data reallocation strategy DRC to speed up the query response time through load balancing. DDH uses a hash-based heuristic technique to distribute data off-line according to the query history. DRC can reallocate data dynamically at runtime to adapt the changing query patterns in the system. To validate the performance of these two strategies, experiments are conducted using a simulation environment and real customer data. Experimental results show that they both offer favorable performance with the increasing query load of the system.
Spatio-temporal Pattern Query Processing based on Effective Trajectory Splitting Models in Moving Object Database

Wenjie Zhang,Jianzhong Li,Wei Zhang

DOI: https://doi.org/10.1109/IMSCCS.2006.270

2006-01-01

Abstract:Moving objects continuously generate large amounts of spatio-temporal information. A spatio-temporal pattern (STP) query specifies a spatio-temporal pattern as a sequence of distinct spatial predicates where the temporal ordering of predicates matters. STP is a new type of query with many applications in the field of moving object database management. In this paper, our focus is to process historical STP query effectively based on appropriate index techniques. We propose three different methods to deal with STP query. Effective trajectory splitting model is used to index the historical trajectories of moving objects. Finally, we conduct a comprehensive experimental evaluation to show the efficiency of our techniques
Structure-Guided Query Evaluation: Towards Bridging the Gap from Theory to Practice

Georg Gottlob,Matthias Lanzinger,Davide Mario Longo,Cem Okulmus,Reinhard Pichler,Alexander Selzer

2023-05-22

Abstract:Join queries involving many relations pose a severe challenge to today's query optimisation techniques. To some extent, this is due to the fact that these techniques do not pay sufficient attention to structural properties of the query. In stark contrast, the Database Theory community has intensively studied structural properties of queries (such as acyclicity and various notions of width) and proposed efficient query evaluation techniques through variants of Yannakakis' algorithm. However, although most queries in practice actually are acyclic or have low width, structure-guided query evaluation techniques based on Yannakakis' algorithm have not found their way into mainstream database technology yet. The goal of this work is to address this gap between theory and practice and to demonstrate that the consideration of query structure can improve query evaluation performance on modern DBMSs significantly in cases that have been traditionally challenging. In particular, we study the performance of structure-guided query evaluation in three architecturally distinct DBMSs by rewriting SQL queries into a sequence of SQL statements that express an execution of Yannakakis' algorithm. Moreover, we identify a class of queries that is particularly well suited for our approach and allows query answering in a variety of common scenarios without materializing any join. Through empirical evaluation we show that structure-guided query evaluation can make the evaluation of many difficult join queries feasible whereas their evaluation requires a prohibitive amount of time and memory on current DBMSs.

Databases
Implementation of SPARQL Query Engine Based on CouchDB

Yi PENG,Chuan-lei NI,Wen-yang BAI

DOI: https://doi.org/10.3969/j.issn.1673-629X.2014.05.002

2014-01-01

Abstract:Traditional SPARQL query engines optimize queries in terms of triple pattern as basic unit. This brings too many join operations in the face of SPARQL queries comprising many triple patterns,which lead to much query overhead. In this paper,taking the advantage of storing and quering of document-oriented database,propose a subject-classification approach to store RDF triples. RDF triples are parti-tioned into various classes in terms of identical subjects,and saved to the documents of the database. Triple patterns are classified accord-ing to their subjects as well,composing the query graph based on subject-related block. The method of selectivity estimation is improved on the new query graph. Using a document-oriented databse CouchDB to build a SPARQL query engine,the experiment proves the ap-proach is capable of improving the efficiency of SPARQL basic graph pattern query handling.
Service-oriented Execution Model Supporting Data Sharing and Adaptive Query Processing

Yongwei Wu,Jia Liu,Gang Chen,Qiming Fang,Guangwen Yang

DOI: https://doi.org/10.1007/s10586-009-0109-8

2009-01-01

Cluster Computing

Abstract:To deal with the environment's heterogeneity, information providers usually offer access to their data by publishing Web services in the domain of pervasive computing. Therefore, to support applications that need to combine data from a diverse range of sources, pervasive computing requires a middleware to query multiple Web services. There exist works that have been investigating on generating optimal query plans. We however in this paper propose a query execution model, called PQModel, to optimize the process of query execution over Web Services. In other words, we attempt to improve query efficiency from the aspect of optimizing the execution processing of query plans. PQModel is a data-flow execution model. Along with an adaptive query framework it used, PQModel aims to improve query efficiency and resource utilization by exploiting data and computation sharing opportunities across queries. A set of experiments, based on a prototype tool we developed, were carefully designed to evaluate PQModel by comparing it with a model whose query engine evaluates queries independently. Results show that our model can improve query efficiency in terms of both response time and network overhead.
A SURVEY OF PARTITION SCHEMES AND RELEVANT ALGORITHMS IN OBJECT ORIENTED DATABASE SYSTEMS

JIANG Yu,WANG Yu-Ying,HU Ming-Zeng,XU Xiao-Fei

2000-01-01

Journal of Computer Research and Development

Abstract:Data partition is one of the critical issues deserving of being solved well in distributed database management systems. The issue is about how to split databases in applied systems into rational fragments (transparent to end user) so as to achieve the goals of reducing the cost of system processing, improving the power of parallel processing, and enhancing the autonomy of each node of the distributed environment. In this paper, the ways of partitioning relation are presented in brief and then the latest research work in the world on partitioning class in OODBS is surveyed.

Research of Stage-by-Stage Executing Strategy and Query Processing Technology

Schema-Driven Performance Evaluation for Highly Concurrent Scenarios.

New Distributed Spatial Query Optimization Approach by Using Query Analyzer

Design and Implementation of OSCAR Query Optimizer

Multiple Query Optimization in PBASE/3

Constructing Object/Relational System of High Performance

Enhancing Query Performance by Avoiding Negative Interactions

A Comparison of Objects with Frames and OODBsXindong WuDepartment of Software

Optimizing Communications in Processing Data Integration Queries

Object-oriented parallel execution model

Analysis of the possibilities of optimizing SQL queries

Performance Optimization of Top-k Queries on Multicore Platform

Une plate-forme dynamique pour l'évaluation des performances des bases de données à objets

Iterative Query Processing based on Unified Optimization Techniques

Performance Optimization in DBMS Applications

Effective Data Distribution And Reallocation Strategies For Fast Query Response In Distributed Query-Intensive Data Environments

Spatio-temporal Pattern Query Processing based on Effective Trajectory Splitting Models in Moving Object Database

Structure-Guided Query Evaluation: Towards Bridging the Gap from Theory to Practice

Implementation of SPARQL Query Engine Based on CouchDB

Service-oriented Execution Model Supporting Data Sharing and Adaptive Query Processing

A SURVEY OF PARTITION SCHEMES AND RELEVANT ALGORITHMS IN OBJECT ORIENTED DATABASE SYSTEMS