Prefetching Java Objects

Brad Beckmann,Xidong Wang

2002-01-01

Abstract:To be completed when the results section is complete)

What problem does this paper attempt to address?

Method for prefetching object

Hong Mei,Donggang Cao,Minghui Zhou,Liang Lin

2007-01-01

Abstract:This invention relates to a method for pre-taking objects in a permanent object-relationship system including receiving a read request and judging if information of an object is stored in the object buffer storage according to the kind and key words of the object corresponding to the read request, if so, the information of the object is returned, otherwise, the attribute information of said object is analyzed based on the object-relationship mapping information stored in the system then to store the generated information into the buffer storage, which introduces a pre-taking strategy to an object-relationship permanent system to suit the current complicated object design of multiple kinds and large numbers and increase the read hit ratio of the system to the utmost.
A Rule-Based Prefetching Approach for Object-Based Storage Device

Shuibing He,Dan Feng,Chunhua Li,Yanli Yuan

DOI: https://doi.org/10.1080/15501320802540975

IF: 1.938

2009-01-01

International Journal of Distributed Sensor Networks

Abstract:Capturing the advantages of NAS and SAN, Object-based Storage System (OBSS) is becoming an active research area. OBSS is composed of clients, metadata server, and Object-based Storage Devices (OSDs). Similar to the prefetching of file and block, object prefetching is also an effective method to reduce the object access latency in OSD. However, the existing methods focus on intra-object prefetching [1] and they limit the prefetching capability among objects to a certain extent. In this paper, we present a novel inter-object prefetching approach which considers the characteristics of the object access in OSD. This approach adopts a kind of data mining technique called sequential pattern mining to find the object access sequential patterns [2], then produces the object sequential rules according to the patterns, and finally prefetches objects according to the rules and the object access context. The whole process includes the following three modules: Object Request Service Module. It maintains a current object access context, which is a l-length recently accessed object sequence. Furthermore, it appends new object information to the historic object access stream when an object is accessed. Sequential Rules Mining Module. It is composed of the object sequences preprocessing, the sequential pattern mining and the sequential rules producing modules. The preprocessing module divides the object access stream into many subsequences. Base on the discovered object sequential patterns gained by the sequential pattern mining module, object access sequential rules table is constructed. Prefetching Engine Module. When the current requested object is not in the object cache, the prefetching engine selects a matched rule with the highest confidence from the rules table according to the context, then chooses the corresponding objects and preloads them into the object cache. Simulated experimental results show that both prediction accuracy and object hit rate can be improved comparing with the Group-based prefetching method [3] which can also be used for object prefetching.
EXTENDED JAVA COLLECTION FRAMEWORK BASED ON OBJECT-ORIENTED DATABASE

Lu Deng,Li Shanping,Zheng Chunzhao

DOI: https://doi.org/10.3969/j.issn.1000-386X.2011.01.041

2011-01-01

Abstract:Conventional data persistence technology is to store the object to relational database through object-relation mapping,but its easy-use performance and efficiency always remain problems.In this paper,we introduce a more convenient alternative with higher performance:i.e.,to store mass data to object-oriented database.However the use of object-oriented database may be not well known by quite a few programmers since it has not been commonly used at moment yet.Thus we propose an extended Java collection framework based on object-oriented database,through which the programmers can operate the object-oriented database as using common Java collection API.The performance of persistence is also enhanced compared with using common relational database.
Pre-fetching tree-structured data in distributed memory

Lex Weaver,Chris Johnson

DOI: https://doi.org/10.48550/arXiv.cs/9810002

1998-10-02

Distributed, Parallel, and Cluster Computing

Abstract:A distributed heap storage manager has been implemented on the Fujitsu AP1000 multicomputer. The performance of various pre-fetching strategies is experimentally compared. Subjective programming benefits and objective performance benefits of up to 10% in pre-fetching are found for certain applications, but not for all. The performance benefits of pre-fetching depend on the specific data structure and access patterns. We suggest that control of pre-fetching strategy be dynamically under the control of the application.
A Study of the Object-Based Limited Cache Prefetching Strategy in Proxy Servers

Jiatao Song

2009-01-01

Abstract:Prefetching is an active cache technique.It can be used to improve the cache hit ratio.But its performance greatly depends on the prefetching model employed.In this paper,a novel limited cache prefetching strategy based on web objects is presented.The proposed strategy can adaptively adjust the size of the prefetching cache and prevent ineffective pages from excessively occupying the cache space,resulting in a higher cache utilization rate and an enhanced web hit ratio.Experimental results show that the web hit ratio based on our proposed method is much higher than that based on the Least Recently Used(LRU) strategy,and that based on the web object-based LRU strategy.
Research on Prefetching Algrothim in PostgreSQL

HU Qiao-Qiao,WANG Jian-Min,YE Xiao-Jun

2006-01-01

Computer Science

Abstract:Access speed of disk is the key to database performance.In this paper,after discussing a characteristic of se- quential access in PostgreSQL,an algorithm is proposed which can selectively prefetch data blocks ahead of the point of reference.The number of blocks prefetched is chosen based on the observed number of sequential block references im- mediately preceding reference to the current block.Experimental results show the proposed algorithm can improve ac- tess speed effectively.
DJXPerf: Identifying Memory Inefficiencies via Object-centric Profiling for Java

Bolun Li,Pengfei Su,Milind Chabbi,Shuyin Jiao,Xu Liu

DOI: https://doi.org/10.48550/arXiv.2104.03388

2021-04-07

Performance

Abstract:Java is the "go-to" programming language choice for developing scalable enterprise cloud applications. In such systems, even a few percent CPU time savings can offer a significant competitive advantage and cost saving. Although performance tools abound in Java, those that focus on the data locality in the memory hierarchy are rare. In this paper, we present DJXPerf, a lightweight, object-centric memory profiler for Java, which associates memory-hierarchy performance metrics (e.g., cache/TLB misses) with Java objects. DJXPerf uses statistical sampling of hardware performance monitoring counters to attribute metrics to not only source code locations but also Java objects. DJXPerf presents Java object allocation contexts combined with their usage contexts and presents them ordered by the poor locality behaviors. DJXPerf's performance measurement, object attribution, and presentation techniques guide optimizing object allocation, layout, and access patterns. DJXPerf incurs only ~8% runtime overhead and ~5% memory overhead on average, requiring no modifications to hardware, OS, Java virtual machine, or application source code, which makes it attractive to use in production. Guided by DJXPerf, we study and optimize a number of Java and Scala programs, including well-known benchmarks and real-world applications, and demonstrate significant speedups.
An Approach to Data Prefetching Using 2-Dimensional Selection Criteria

Jean Sung,Sebastian Krupa,Andrew Fishberg,Josef Spjut

DOI: https://doi.org/10.48550/arXiv.1505.03899

2015-05-15

Abstract:We propose an approach to data memory prefetching which augments the standard prefetch buffer with selection criteria based on performance and usage pattern of a given instruction. This approach is built on top of a pattern matching based prefetcher, specifically one which can choose between a stream, a stride, or a stream followed by a stride. We track the most recently called instructions to make a decision on the quantity of data to prefetch next. The decision is based on the frequency with which these instructions are called and the hit/miss rate of the prefetcher. In our approach, we separate the amount of data to prefetch into three categories: a high degree, a standard degree and a low degree. We ran tests on different values for the high prefetch degree, standard prefetch degree and low prefetch degree to determine that the most optimal combination was 1, 4, 8 lines respectively. The 2 dimensional selection criteria improved the performance of the prefetcher by up to 9.5% over the first data prefetching championship winner. Unfortunately performance also fell by as much as 14%, but remained similar on average across all of the benchmarks we tested.

Hardware Architecture
Helper Without Threads: Customized Prefetching for Delinquent Irregular Loads

Karthik Sankaranarayanan,Chit-Kwan Lin,Gautham Chinya

DOI: https://doi.org/10.48550/arXiv.2009.00202

2020-09-01

Abstract:The growing memory footprints of cloud and big data applications mean that data center CPUs can spend significant time waiting for memory. An attractive approach to improving performance in such centralized compute settings is to employ prefetchers that are customized per application, where gains can be easily scaled across thousands of machines. Helper thread prefetching is such a technique but has yet to achieve wide adoption since it requires spare thread contexts or special hardware/firmware support. In this paper, we propose an inline software prefetching technique that overcomes these restrictions by inserting the helper code into the main thread itself. Our approach is complementary to and does not interfere with existing hardware prefetchers since we target only delinquent irregular load instructions (those with no constant or striding address patterns). For each chosen load instruction, we generate and insert a customized software prefetcher extracted from and mimicking the application's dataflow, all without access to the application source code. For a set of irregular workloads that are memory-bound, we demonstrate up to 2X single-thread performance improvement on recent high-end hardware (Intel Skylake) and up to 83% speedup over a helper thread implementation on the same hardware, due to the absence of thread spawning overhead.

Hardware Architecture
Understanding Performance of Edge Prefetching

Zhengyuan Pang,Lifeng Sun,Zhi Wang,Yuan Xie,Shiqiang Yang

DOI: https://doi.org/10.1007/978-3-319-51811-4_43

2017-01-01

Abstract:When using online services, the time that users wait for the requested content to be downloaded from online servers to local devices can significantly influence user experience. To reduce user waiting time, the content which are likely to be requested in the future can be pre-downloaded to the local cache on edge proxies (i.e. edge prefetching).
Path Prefetching: Accelerating Index Searches for In-Memory Databases

Shuo Li,Zhiguang Chen,Nong Xiao,Guangyu Sun

DOI: https://doi.org/10.1109/iccd.2018.00049

2018-01-01

Abstract:In-memory databases (IMDBs) store all working data in main memory, which makes memory accesses become the dominant factor of the whole system performance. Micro-architectural studies of mainstream in-memory on-line transaction processing (OLTP) systems show that more than half of the execution time goes to memory stalls. Moreover, for IMDBs that adopt aggressive transaction compilation optimizations, data misses from the last-level cache (LLC) are responsible for the majority of the overall stall time. In this paper, through profiling analysis of IMDBs we observe that index access misses dominate LLC data misses. Based on the key observation that adjacent keys tend to follow similar traversal paths in ordered index searches, we propose the path prefetching to mitigate LLC misses induced by ordered index searches, which records mappings between keys and their traversal paths and then generate prefetches for future same/adjacent keys. Experimental results show that for ordered index searches the proposed path prefetcher provides an average speedup of 27.4% over the baseline with no prefetching.
On Memory Codelets: Prefetching, Recoding, Moving and Streaming Data

Dawson Fox,Jose Monsalve Diaz,Xiaoming Li

DOI: https://doi.org/10.48550/arXiv.2302.00115

2023-02-01

Abstract:For decades, memory capabilities have scaled up much slower than compute capabilities, leaving memory utilization as a major bottleneck. Prefetching and cache hierarchies mitigate this in applications with easily predictable memory accesses or those with high locality. In other applications like sparse linear algebra or graph-based applications, these strategies do not achieve effective utilization of memory. This is the case for the von Neumann model of computation, but other program execution models (PXM) provide different opportunities. Furthermore, the problem is complicated by increasing levels of heterogeneity and devices' varying memory subsystems. The Codelet PXM presented in this paper provides a program structure that allows for well-defined prefetching, streaming, and recoding operations to improve memory utilization and efficiently coordinate data movement with respect to computation. We propose the Memory Codelet, an extension to the original Codelet Model, to provide users these functionalities in a well-defined manner within the Codelet PXM.

Distributed, Parallel, and Cluster Computing
The Non-Sequential Instruction Prefetching Based on Basic Blocks

Wang Zhi

2003-01-01

Abstract:Instruction supply can influence processor performance greatly.Instruction prefetching is an effective mechanism to reduce the instruction cache miss rate.This paper proposes a nonsequential instruction prefetching mechanism,which is directed by branch instructions and prefetches a whole basic block each time.Experimental results show it can increase the instruction cache hit rate effectively.In addition,it predicts program behaviors statically so that it does not need any complex hardware to predict and restore.
Incorporating Caching with Prefetching for Wireless Web Access

JIN Beihong,TIAN Sihua,LIN Chen,HUANG Yu,REN Xin

DOI: https://doi.org/10.3778/j.issn.1673-9418.2007.02.006

2007-01-01

Abstract:Caching and prefetching play an important role in improving the performance of wireless Web access. In this paper, Web caching and prefetching scheme for wireless local area network are studied. The authors present the sequence-mining and lazy-update prediction algorithms respectively based on data mining and information theory, design a context-aware prefetching algorithm and a profit-driven caching replacement policy, and then implement them in Web caching system OnceEasyCache. Performance evaluation experiment results show the integration of the above algorithms can effectively enhance cache hit ratio and delay saving ratio.
Exploring Data Prefetching Mechanisms for Last Level Cache in Chip Multi-Processors

Mingliang Liu,Lin Qiao,Fucen Zeng,Zhizhong Tang

DOI: https://doi.org/10.1007/978-3-642-29458-7_83

2012-01-01

Abstract:Last level cache in chip multi-processors is shared by many cores; prefetchers should be fully simulated and evaluated before integrated in product. However, evaluation methodologies of proposed prefetchers vary from each other without unified simulation framework provided. This paper implements a prefetch simulation framework and evaluates seven important prefetchers, providing comprehensive evaluation methodology to newly proposed prefetchers. Moreover, we analyze the influence of storage cost and memory bandwidth quantitatively.
Hybrid Instruction Prefetch Based on Control Flow

Zhi Wang

2003-01-01

Abstract:Instruction supply can influence processor performance greatly.Instruction prefetching is an effective mechanism to reduce instruction cache miss rate.It proposes an instruction prefetching mechanism based on program control flow graph,while sequential prefetch and non sequential prefetch are both employed to fetch instructions in advance.Experimental results show it can increase instruction cache hit rate effectively.It predicts program behavior statically so that it does not need any complex hardware to predict and restore.
JACO: JAva Code Layout Optimizer Enabling Continuous Optimization without Pausing Application Services

Wenhai Lin,Jingchang Qin,Yiquan Chen,Zhen Jin,Jiexiong Xu,Yuzhong Zhang,Shishun Cai,Lirong Fu,Yi Chen,Wenzhi Chen

DOI: https://doi.org/10.1109/CLUSTER52292.2023.00032

2023-01-01

Abstract:Many Java applications in data centers suffer from severe processor pipeline frontend bottlenecks, which can be mitigated by profile-guided code layout optimizations (PGCLO). To maximize optimization opportunities, state-of-the-art PGCLO solutions adopt continuous optimization to ensure that the code layout consistently matches ever-changing application control flow characteristics. However, existing continuous optimizations inevitably pause the application to execute the new code completely, which leads to high response latency and significantly deteriorates user experience. In this paper, we propose JACO, a novel profile-guided Java code layout optimizer, enabling continuous optimization without pausing application services. The key idea of JACO is to enable the execution of both the old and new code simultaneously rather than completely switching to the new code. In particular, JACO is composed of three components: (1) A lightweight profiler captures the control flow information of the application and then generates an optimized function order. (2) A control flow switcher generates new code based on optimized function order and switches the application to execute the new code without pausing the application services. (3) A selective code reclaimer only frees the memory occupied by the inactive old code. We evaluated JACO on both open-source applications and real-world applications from a world-leading company. JACO achieved up to a 16.36% performance improvement for real-world applications. The state-of-the-art approach introduces up to 37.93x latency overhead that will interrupt application services, while JACO only introduces a negligible 7% latency overhead.
Transparent Access to Persistent Objects in Object-Oriented Databases

Sun Jianling,He Zhijun

1997-01-01

Abstract:A technique for transparent access to persistent objects is presented, which is a key technique for achieving the seamless integration of object-oriented databases and programming languages, in the condition of keeping the object-level concurrency control, version management and constraint checking
Software Prefetching for Indirect Memory Accesses

Sam Ainsworth,Timothy M. Jones

DOI: https://doi.org/10.1145/3319393

2019-08-16

ACM Transactions on Computer Systems

Abstract:Many modern data processing and HPC workloads are heavily memory-latency bound. A tempting proposition to solve this is software prefetching, where special non-blocking loads are used to bring data into the cache hierarchy just before being required. However, these are difficult to insert to effectively improve performance, and techniques for automatic insertion are currently limited. This article develops a novel compiler pass to automatically generate software prefetches for indirect memory accesses, a special class of irregular memory accesses often seen in high-performance workloads. We evaluate this across a wide set of systems, all of which gain benefit from the technique. We then evaluate the extent to which good prefetch instructions are architecture dependent and the class of programs that are particularly amenable. Across a set of memory-bound benchmarks, our automated pass achieves average speedups of 1.3× for an Intel Haswell processor, 1.1× for both an ARM Cortex-A57 and Qualcomm Kryo, 1.2× for a Cortex-72 and an Intel Kaby Lake, and 1.35× for an Intel Xeon Phi Knight’s Landing, each of which is an out-of-order core, and performance improvements of 2.1× and 2.7× for the in-order ARM Cortex-A53 and first generation Intel Xeon Phi.

computer science, theory & methods
Transparent Access to Persistent Objects in Object-Oriented Databases.

JL Sun,JX Dong,ZJ He

DOI: https://doi.org/10.1109/tools.1997.713525

1998-01-01

Abstract:A technique for transparent access to persistent objects is presented. This is a key technique for achieving the seamless integration of object oriented databases and programming languages, with the condition of keeping the object level concurrency control, version management and constraint checking

Prefetching Java Objects

Method for prefetching object

A Rule-Based Prefetching Approach for Object-Based Storage Device

EXTENDED JAVA COLLECTION FRAMEWORK BASED ON OBJECT-ORIENTED DATABASE

Pre-fetching tree-structured data in distributed memory

A Study of the Object-Based Limited Cache Prefetching Strategy in Proxy Servers

Research on Prefetching Algrothim in PostgreSQL

DJXPerf: Identifying Memory Inefficiencies via Object-centric Profiling for Java

An Approach to Data Prefetching Using 2-Dimensional Selection Criteria

Helper Without Threads: Customized Prefetching for Delinquent Irregular Loads

Understanding Performance of Edge Prefetching

Path Prefetching: Accelerating Index Searches for In-Memory Databases

On Memory Codelets: Prefetching, Recoding, Moving and Streaming Data

The Non-Sequential Instruction Prefetching Based on Basic Blocks

Incorporating Caching with Prefetching for Wireless Web Access

Exploring Data Prefetching Mechanisms for Last Level Cache in Chip Multi-Processors

Hybrid Instruction Prefetch Based on Control Flow

JACO: JAva Code Layout Optimizer Enabling Continuous Optimization without Pausing Application Services

Transparent Access to Persistent Objects in Object-Oriented Databases

Software Prefetching for Indirect Memory Accesses

Transparent Access to Persistent Objects in Object-Oriented Databases.