The Application of Data Storing and Querying with Multiple Threads in Delphi

Hecheng Li

2002-01-01

Abstract:The programming with multiple threads in Delphi is one of the most widely used technologies. And it is also a good solution to deal with the synchronic problems and multiple tasks. This paper introduces a way to query and store the data with multiple threads.

What problem does this paper attempt to address?

Design of data management for real-time database in processing industry

王成光,苏宏业,褚健

DOI: https://doi.org/10.3785/j.issn.1008-973X.2003.02.002

2003-01-01

Abstract:The data model theory of real-time database and data characteristics of the processing industry is studied. Then by employing the latest information technology, a new design method for data management of the processing industry's real-time database is presented for the processing enterprises' application of real-time database. In the data model, data from the processing enterprise is organized by tag mapping technology. The model has a fast query system with multi-layer indexing structure by using STL (standard template library). In addition, the data model support distributed computation in the processing enterprises by adopting COM/DCOM (distributed component object model) technology. The validity and feasibility of the presented design method were proved by the method's successful application in the real-time database software of APC-iSYS.
A parallel computing method for irregular work

杨鑫,许端清,杨冰

DOI: https://doi.org/10.3785/j.issn.1008-973X.2013.11.026

2013-01-01

Abstract:In order to effectively use the powerful computing provided by the heterogeneous multi-core architecture, re-organize the data and a reasonable schedule for the execution of tasks is very necessary, according to the characteristics of the hardware architecture. This paper presents a parallel computing method for irregular work, the method is an multiple parallel integration of data parallelism, task parallelism, pipeline parallelism, is particularly suitable for the implementation of the work with dynamic behavior and complex irregular data structures algorithms, and run the program according to the storage locality and SIMD character, using priority-based dynamic scheduling and data management, to maximize the efficient use of CPU and GPU hardware computing resources and storage resources. The experiments results show that the approach can improve the parallel rendering algorithm performance for the dynamic execution and irregular data structures construction and maintenance.
Distributed storage and processing of real-time data in smart grid dispatching and control systems

Jin Liu,Chunlei Xu,Mingyang Sun,Jiaqing Zhao,Weijin Zhuang

DOI: https://doi.org/10.1109/IAEAC.2017.8053983

2017-01-01

Abstract:Existing real-time data processing will come to a performance limitation with the rapid development of power grid. This paper proposes a method of distributed storing and processing for real-time data in smart grid dispatching and control systems. The method applies the multi-machine-multi-thread and parallel computing technology to improve data processing efficiency. Real-time data is partitioned into fragments according to region information. By experiments, we prove that distributed storing and processing technology has obvious advantages on performance compared with the original solution, and it can help to relieve the stress of large-scale real-time data processing in smart grid dispatching and control systems.
Simulation of Disk Scheduling Based on Multithreading

FANG Wang-sheng,ZHANG Ke-jun

DOI: https://doi.org/10.3969/j.issn.1006-1576.2005.03.046

2005-01-01

Abstract:The visual cross-effect, host interface menu, inner/ exterior radii direction, list menu and the simulation of disk spin was used in the simulation of disk scheduling based on multithreading and multi-media technique. When the sub-threading provided a new task, the cylinder number was put into the UP/DOWN mission queue by the main threading according to the disk head direction. And execute the next mission, and save the relevant data into a TXT file.
Research on Mass Process-Planning Data Storing and Parallel Accessing in Large-Scale Manufacturing Enterprise.

Meng Wang,Yi Dong,Zhan Jiang,Lanfen Lin

DOI: https://doi.org/10.1007/978-3-642-10430-5_84

2010-01-01

Abstract:In order to solve the problems existing in the Computer-aided Process Planning (CAPP) system when it handle the mass data storing and parallel accessing, this paper proposes a solution based on the distributed data storing architecture. We analyze the reasons causing the problems and change the system's architecture, furthermore we integrate other technologies such as intelligent and adaptive load balancing algorithm, model lightweighting in multiple granularity and multi-dimensional data clustering to enhance the system's capability on mass data storing and parallel accessing.
STUDY AND APPLICATION OF MULTITHREAD TECHNOLOGY

Bin LUO,Xiang-Lin FEI

2000-01-01

Journal of Computer Research and Development

Abstract:Multithread technology has been adopted in recently developed mainstream operating systems. Firstly the basic concepts of multithread are described. Secondly, three implementation methods of multithread mechanism that is user\|level threads, kernel\|level threads and combined approaches are discussed. Thirdly, application of multithread programming is introduced. Through the object\|oriented database management system NODBMS, how to use multithreads to realize multiple transaction processing is also introduced, and is proposed an effective query optimization algorithm of object\|oriented database system based on multithread technology.
Research on Mass Process-Planning Data Storing and Parallel Accessing in Large-Scale Manufacturing Enterprise

Meng Wang,Dong Hoon Yi,Jun Zhan,Lanfen Lin

2010-01-01

Abstract:In order to solve the problems existing in the Computer-aided Process Planning (CAPP) system when it handle the mass data storing and parallel accessing, this paper proposes a solution based on the distributed data storing architecture. We analyze the reasons causing the problems and change the system’s architecture, furthermore we integrate other technologies such as intelligent and adaptive load balancing algorithm, model lightweighting in multiple granularity and multi-dimensional data clustering to enhance the system’s capability on mass data storing and parallel accessing.
Architecture Design of Wide-area Distributed Real-time Database in Grid Dispatching Control System

Wang Zhihua,Liu Jin,Su Fan,Sun Mingyang,Fan Jing,Zhuang Weijin

DOI: https://doi.org/10.2991/iccte-16.2016.159

2016-01-01

Abstract:Power grid in future will develop into an extra-large interconnected grid with larger transmission capacity and more complex running characteristics. The trend of grid dispatching control system must be global wide-area and dynamic integrated necessarily. In this situation, it makes higher demand for real-time data to support grid supervisory and analysis. However, the existing real-time database with a centralized architecture commonly had the limits of scalability and performance, and it could hardly support a large number of concurrent data access. This paper proposed an architecture design of wide-area distributed real-time database (WDRTDB). WDRTDB divided all the real-time data into parts, and stored them on several servers. In addition, WDRTDB introduced a novel kind of data dictionary to index all data to provide a unified data access service for whole grid. Through experiments, we proved that WDRTDB had a better performance in real-time data processing than existing real-time database system.
Multithread Technology in THDS-100 Automatic Dispatching System

Xiaorong Xie

2001-01-01

Abstract:The performance of an automatic dispatching system is analyzed for medium or small size dispatching systems and county dispatching systems. The system uses the multithread managing ability of the Windows NT operating system. The system analyzes how to utilize thread priority setting to increase the response of important system processes. At the same time, several methods are compared to synchronize threads and avoid inconsistent data. This technology has been successfully used in the THDS 100 Automatic Dispatching System with very good results. It avoids the waste of time in the general timer method. The method uses the multithread dispatching ability of the operating system to manage threads with different functions in the automatic dispatching system for better peak performance while performing other system functions during fault handling.
A Study on Altering PostgreSQL from Multi-Processes Structure to Multi-Threads Structure

Zhiyong Shan

DOI: https://doi.org/10.48550/arXiv.1609.09062

2016-09-29

Abstract:How to altering PostgreSQL database from multi-processes structure to multi-threads structure is a difficult problem. In the paper, we bring forward a comprehensive alteration scheme. Especially, put rational methods to account for three difficult points: semaphores, signal processing and global variables. At last, applied the scheme successfully to modify a famous open source DBMS.

Databases
The Data-Driven Multithreading Programming Model Based On Ddf

Baifeng Wu,Songwen Pei,Kun Zhu,Qiang Yu

DOI: https://doi.org/10.1109/ICPCA.2007.4365510

2007-01-01

Abstract:Currently the compiler technology is far from the need of fully exploring the benefits of chip multi-core architecture of nowadays microprocessor. To further exploit parallelism inside real-world applications, explicit expression of parallelism at thread level will be an important approach. Based on Dynamic Data Flow (DDF) model, this paper presents a multithreading programming model. Using the model parallel execution, analyzability, testability of a multithreading, program can be guaranteed by the property of the model of Computation. With the programming model, a task can be expressed by multiple code blocks allowing execution in parallel and on different processor architectures, thus such a technique can also be applied in pervasive computing area in future.
Adapting to Application Workflow in Processing Data Integration Queries

Yongwei WU,Jia LIU,Gang Chen,Guangwen Yang,Bo Cao,Weimin Zheng

DOI: https://doi.org/10.1109/GCC.2007.38

2007-01-01

Abstract:Data integration has evolved to provide efficient data management across distributed and heterogeneous data sources in grid environment. However, existing works in data integration consider little knowledge about the above applications. In such settings, queries from the same application are processed independently. In this paper, application properties are noticed in order to improve query performance for data integration. We present a general-purpose and well-modular architecture for addressing data integration in grid (DIG) environment first, the modules of which can be flexibly deployed to adapt specific application. Moreover, special attention has been paid on query processing to accommodate application workflow with the component of query flow processor. It introduces multi-query optimization techniques to speed up overall response time for DIG.
A multithreaded parallel Delaunay triangulation algorithm based on lock-free atomic operations

Jun-ji WANG,Chao-yan ZHU,Jian-jun CHEN,Peng ZHENG,Quan XU

DOI: https://doi.org/10.3969/j.issn.1007-130X.2018.05.002

2018-01-01

Abstract:This paper uses OpenMP to implement a fine-grain parallel incremental insertion algorithm for Delaunay triangulation,which adopts an exclusive criterion of cavity overlapping and lock-free atomic operations.Based on the serial algorithm,Hilbert sorting is introduced into the point set so that adjacent points are also geometrically adjacent.An exclusive criterion that the points can be inserted simultaneously only if their cavities share neither common elements nor common boundaries is introduced to guarantee that the whole mesh has the Delaunay property according to the Delaunay lemma.Each element uses an atomic variable to mark whether the element is occupied by any of the threads.While calculating the Delaunay cavities,threads try to occupy those elements,but only one of them can succeed to write the atomic variable,so the exclusivity of the algorithm is guaranteed.Numerical experiments on the platform with a 16-core Intel (R) Xeon (R) CPU E5-2640 v3@2.60GHz and a 64 GiB memory show that,for a 107-point set,the algorithm can reach the speedup of 7.06 with 16 cores.
Heterothread: Hybrid Thread Level Parallelism on Heterogeneous Multicore Architectures.

Chao Wang,Xi Li,Xuehai Zhou

DOI: https://doi.org/10.1145/2518148.2518152

2013-01-01

ACM SIGBED Review

Abstract:In this paper, we introduce middleware architecture to support hybrid thread level parallelism on heterogeneous multicore architectures, called Heterothread. Heterothread constructs a hierarchical level model for user programming and parallel task execution dataflow. Heterothread can provide unified programming interfaces which allow applications remain the same when the physical hardware (CPU, GPU, DSP and FPGA) is reconfigured or migrated. Consequently it can meet the real-time demands more efficiently than most state-of-the-art operating systems. A prototype has been built on FPGA to demonstrate Heterothread can achieve significant speedups against Linux kernels.
Exploiting Single-Threaded Model in Multi-Core Systems

Chang Yao,Divyakant Agrawal,Gang Chen,Qian Lin,Beng Chin Ooi,Weng-Fai Wong,Meihui Zhang

2016-01-01

Abstract:The widely adopted single-threaded OLTP model assigns a single thread to each static partition of the database for processing transactions in a partition. This simplifies concurrency control while retaining parallelism. However, it suffers performance loss arising from skewed workloads as well as transactions that span multiple partitions. In this paper, we present a dynamic single-threaded inmemory OLTP system, called LADS, that extends the simplicity of the single-threaded model. The key innovation in LADS is the separation of dependency resolution and execution into two nonoverlapping phases for batches of transactions. After the first phase of dependency resolution, the record actions of the transactions are partitioned and ordered. Each independent partition is then executed sequentially by a single thread, avoiding the need for locking. By careful mapping of the tasks to be performed to threads, LADS is able to achieve a high degree of balanced parallelism. We evaluate LADS against H-Store, a partition-based database; DORA, a data-oriented transaction processing system; and Silo, a multicore in-memory OLTP engine. The experimental study shows that LADS achieves up to 20× higher throughput than existing systems and exhibits better robustness with various workloads.
A PROCESSING METHOD OF REAL-TIME DATA IN ENERGY MANAGEMENT SYSTEM

TANG Lei,ZHANG Bo-ming,SUN Hong-bin

DOI: https://doi.org/10.3321/j.issn:1000-3673.2001.05.004

2001-01-01

Abstract:Along with the continual extension of the scale of power system, the conventional series processing computation mode is no longer suitable for real-time data processing. To meet the need of processing the real-time data of large-scale SCADA/EMS or other large-scale real time digital emulation decision-making systems, the multiple task based parallel processing method must be used. In this paper the real-time data in SCADA/EMS is researched and a multiple task based real-time data processing method is developed. Two kernel problems in multiple task data processing, i.e., the data sharing and tasks in coordination, are solved,. A method is put forward in which the circulatory queue is used to share the data among multiple tasks to avoid dead-lock and the event-driver is used to harmonize multiple task performance to improve the system efficiency. A multiple task based concrete method of processing real-time data for large scale SCADA/EMS under Windows NT or UNIX system is proposed. Practical applications show that the method can improve the efficiency and meet the need for large-scale SCADA/EMS system.
Application of Multithreading Queue Technology in Communication Server Software

ZHANG Wei,LIU Da-wei

DOI: https://doi.org/10.3969/j.issn.1674-5949.2009.01.009

2009-01-01

Abstract:Communication server software plays an important role in traffic supervision system,which can communicate with field devices in real time.A technical scheme based on multithreading queue is presented.Its design idea is described and software realization is given.Comparison of various multithreading schemes indicates that the scheme based on multithreading queue can meet the needs of traffic supervision system for communication software application and has effectiveness as expected.
Compile-Time Scheduling Of Multithread With Data Localities On Multiple Vector Processors

Chih-yung Chang,Jang-ping Sheu

DOI: https://doi.org/10.1002/cpe.4330070503

1995-01-01

Abstract:A large class of loop programs applied in solving differential equations, Fourier transforms, image processing and neural processing can be translated or rewritten into a vector execution form with a pi-block dependence graph, In the paper we propose a multithreading strategy to partition such vectorized loops into multithread execution form. Each partitioned thread consists of instances of statements with localities in vector registers. The multithreading scheme gives a novel combination of loop unrolling, statement instances reordering, index shifting, vector register reuse exploiting and multithreading. For some cases of loop program with pi-bloek dependence graph, experimental results show that our scheme assists vector compilers of the Convex C38 series to reduce the number of memory accesses and synchronizations among CPUs.
Exploiting Single-Threaded Model in Multi-Core In-Memory Systems.

Chang Yao,Divyakant Agrawal,Gang Chen,Qian Lin,Beng Chin Ooi,Weng-Fai Wong,Meihui Zhang

DOI: https://doi.org/10.1109/TKDE.2016.2578319

2016-01-01

Abstract:The widely adopted single-threaded OLTP model assigns a single thread to each static partition of the database for processing transactions in a partition. This simplifies concurrency control while retaining parallelism. However, it suffers performance loss arising from skewed workloads as well as transactions that span multiple partitions. In this paper, we present a dynamic single-threaded in-memory OLTP system, called LADS, that extends the simplicity of the single-threaded model. The key innovation in LADS is the separation of dependency resolution and execution into two non-overlapping phases for batches of transactions. After the first phase of dependency resolution, the record actions of the transactions are partitioned and ordered. Each independent partition is then executed sequentially by a single thread, avoiding the need for locking. By careful mapping of the tasks to be performed to threads, LADS is able to achieve a high degree of balanced parallelism. We evaluate LADS against H-Store, a partition-based database; DORA, a data-oriented transaction processing system; and SILO, a multi-core in-memory OLTP engine. The experimental study shows that LADS achieves up to 20x higher throughput than existing systems and exhibits better robustness with various workloads.
Threading Model of RTI with Application in Federation Development

HUANG Xiao-dong,HE You,TU Xiao-ming

DOI: https://doi.org/10.3969/j.issn.1004-731x.2006.01.015

2006-01-01

Abstract:Threading model of RTI is an important problem during its design,implement,and application.RTI with Multiple threads supporting a fully reentrant federate benefits performance of real time and is easy to use,but the data shared by RTI calling back thread and federate thread must be access exclusively at one time.The threading model and time management of RTI were firstly analyzed,and then the cases in which federation based on Multiple threads blocked were summarized.Lastly,two approaches of accessing shared data were proposed,and the implementation with application of the first one is introduced.

The Application of Data Storing and Querying with Multiple Threads in Delphi

Design of data management for real-time database in processing industry

A parallel computing method for irregular work

Distributed storage and processing of real-time data in smart grid dispatching and control systems

Simulation of Disk Scheduling Based on Multithreading

Research on Mass Process-Planning Data Storing and Parallel Accessing in Large-Scale Manufacturing Enterprise.

STUDY AND APPLICATION OF MULTITHREAD TECHNOLOGY

Research on Mass Process-Planning Data Storing and Parallel Accessing in Large-Scale Manufacturing Enterprise

Architecture Design of Wide-area Distributed Real-time Database in Grid Dispatching Control System

Multithread Technology in THDS-100 Automatic Dispatching System

A Study on Altering PostgreSQL from Multi-Processes Structure to Multi-Threads Structure

The Data-Driven Multithreading Programming Model Based On Ddf

Adapting to Application Workflow in Processing Data Integration Queries

A multithreaded parallel Delaunay triangulation algorithm based on lock-free atomic operations

Heterothread: Hybrid Thread Level Parallelism on Heterogeneous Multicore Architectures.

Exploiting Single-Threaded Model in Multi-Core Systems

A PROCESSING METHOD OF REAL-TIME DATA IN ENERGY MANAGEMENT SYSTEM

Application of Multithreading Queue Technology in Communication Server Software

Compile-Time Scheduling Of Multithread With Data Localities On Multiple Vector Processors

Exploiting Single-Threaded Model in Multi-Core In-Memory Systems.

Threading Model of RTI with Application in Federation Development