The Garbage Collection Strategy in KVM

Z. Ning

Abstract:Garbage Collection (GC) is the part designed by the developers themselves in JVM. However, traditional garbage collection techniques lead to long and unpredictable delays. This paper discusses the GC strategy based on embedded systems.We will achieve a non-disruptive reclamation by using generation-based GC.

Computer Science,Engineering,Environmental Science

What problem does this paper attempt to address?

Bridging the Performance Gap for Copy-Based Garbage Collectors Atop Non-Volatile Memory

Yanfei Yang,Mingyu Wu,Haibo Chen,Binyu Zang

DOI: https://doi.org/10.1145/3447786.3456246

2021-01-01

Abstract:Non-volatile memory (NVM) is expected to revolutionize the memory hierarchy with not only non-volatility but also large capacity and power efficiency. Memory-intensive applications, which are often written in managed languages like Java, would run atop NVM for better cost-efficiency. Unfortunately, such applications may suffer from performance slowdown due to the unmanaged performance gap between DRAM and NVM. This paper studies the performance of a series of Java applications atop NVM and uncovers that the copy-based garbage collection (GC), the mainstream GC algorithm, is an NVM-unfriendly component in JVM. GC becomes a severe performance bottleneck especially when memory resource is scarce. To this end, this paper analyzes the memory behavior of copy-based GC and uncovers that its inappropriate usage on NVM bandwidth is the main reason for its performance slowdown. This paper thus proposes two NVM-aware optimizations: write cache and header map, to effectively manage the limited NVM bandwidth. It further improves the GC performance with hardware instructions like non-temporal memory accesses and prefetching. We have implemented the optimizations on two mainstream copy-based garbage collectors in OpenJDK. Evaluation with various memory-intensive applications shows that our optimizations can improve the GC time, application execution time, application tail latency by up to 2.69×, 11.0%, and 5.09×, respectively.
PVM: A Memory Management under Vertical Architecture

Xinghui Zhu,Guang Lu,Fei Yu,Shuqiang Yang,Miaoliang Zhu

DOI: https://doi.org/10.1109/IMSCCS.2006.108

2006-01-01

Abstract:In today's operating system, memory management policies based on the data-copying and hidden mechanisms blocks the system performance which is far from expectation. This paper introduces an innovative memory management system powered by vertical architecture PVM. The paper first describes the model and architecture of PVM, followed by an analysis of lazy management of virtual address space and the management of two-layer-cached physical memory.
Analysis And Optimizations Of Java Full Garbage Collection

Haoyu Li,Mingyu Wu,Haibo Chen

DOI: https://doi.org/10.1145/3265723.3265735

2018-01-01

Abstract:Java runtime frees applications from manual memory management by its automatic garbage collection (GC), at the cost of stop-the-world pauses. State-of-the-art collectors leverage multiple generations, which will inevitably suffer from a full GC phase scanning the whole heap and induce a pause tens of times longer than normal collections, which largely affects both throughput and latency of the entire system. In this paper, we analyze the full GC performance of HotSpot Parallel Scavenge garbage collector comprehensively and study its algorithm design in depth. We find out that heavy dependencies among heap regions cause poor thread utilization. Furthermore, many heap regions contain mostly live objects (referred to as dense regions), which are unnecessary to collect. To solve these problems, we introduce two kinds of optimizations: allocating shadow regions dynamically as compaction destination to eliminate region dependencies and skipping dense regions to reduce GC workload. Evaluation results show the optimizations lead to averagely 2.6X (up to 4.5X) improvement in full GC throughput and thereby boost the application performance by 18.2% on average (58.4% at best).
IGCEJ: An Improved Generational Garbage Collector for Embedded Java Processor

Guang Hu,Mi Zhang,Shiliang Tu

DOI: https://doi.org/10.1109/ICISE.2009.645

2009-01-01

Abstract:The embedded Java processor can directly run byte-code, greatly enhance the running speed and reduce the demand for resources. However, simple garbage collectors and pure generational collectors usually require relative large resources and introduce relative long pause time of all the program threads, which are not particularly suitable for the embedded Java processor. This paper gives the analysis and research of the objects allocation feature and the age distribution characteristic in embedded Java processor environment, and proposes an improved generational garbage collector IGCEJ which is suitable for the embedded Java processor, with higher collection efficiency and lower system resources occupancy. In young generation, we adopt a kind of un-stop-the-world strategy, and objects allocation and promotion perform concurrently. As to the mature space, we apply lazy buddy system scheme integrated with mark-sweep algorithm in the garbage collection.
Quantitative Analysis of Boehm' S GC

GUAN Xue-tao~,ZHANG Yuan-rui,GOU Xiao-gang,CHENG Xu (MicroProcessor R ＆ D Center,Peking University,Beijing,China

2003-01-01

Abstract:The term garbage collection describes the automated process of finding previously allocated memory that is no longer in use in order to make the memory available to satisfy subsequent allocation requests. We have reviewed existing papers and implementations of GC, and especially analyzed Boehm' s C codes, which is a real-time mark-sweep GC running under Linux and ANSI C standard. In this paper, we will quantitatively analyze the performance of different configurations of Boehm' s collector subjected to different workloads. Reported measurements demonstrate that a refined garbage collector is a viable alternative to traditional explicit memory management techniques, even for low-level languages. It is more a trade-off for certain system than an all-ornothing proposition.
Performance Analysis and Optimization of Full Garbage Collection in Memory-hungry Environments

Yang Yu,Tianyang Lei,Weihua Zhang,Haibo Chen,Binyu Zang

DOI: https://doi.org/10.1145/3007611.2892251

2016-01-01

ACM SIGPLAN Notices

Abstract:Garbage collection (GC), especially full GC, would non- trivially impact overall application performance, especially for those memory-hungry ones handling large data sets. This paper presents an in-depth performance analysis on the full GC performance of Parallel Scavenge (PS), a state-of-the-art and the default garbage collector in the HotSpot JVM, using traditional and big-data applications running atop JVM on CPU (e.g., Intel Xeon) and many-integrated cores (e.g., Intel Xeon i). The analysis uncovers that unnecessary memory accesses and calculations during reference updating in the compaction ase are the main causes of lengthy full GC. To this end, this paper describes an incremental query model for reference calculation, which is further embodied with three schemes (namely optimistic, sort-based and region-based) for different query patterns. Performance evaluation shows that the incremental query model leads to averagely 1.9X (up to 2.9X) in full GC and 19.3% (up to 57.2%) improvement in application throughput, as well as 31.2% reduction in pause time over the vanilla PS collector on CPU, and the numbers are 2.1X (up to 3.4X), 11.1% (up to 41.2%) and 34.9% for Xeon i accordingly.
ScissorGC: Scalable and Efficient Compaction for Java Full Garbage Collection

Haoyu Li,Mingyu Wu,Binyu Zang,Haibo Chen

DOI: https://doi.org/10.1145/3313808.3313820

2019-01-01

Abstract:Java runtime frees applications from manual memory management through automatic garbage collection (GC). This, however, is usually at the cost of stop-the-world pauses. State-of-the-art collectors leverage multiple generations, which will inevitably suffer from a full GC phase scanning and compacting the whole heap. This induces a pause tens of times longer than normal collections, which largely affects both throughput and latency of applications. In this paper, we comprehensively analyze the full GC performance of the Parallel Scavenge garbage collector in HotSpot. We find that chain-like dependencies among heap regions cause low thread utilization and poor scalability. Furthermore, many heap regions are filled with live objects (referred to as dense regions), which are unnecessary to collect. To address these two problems, we provide , which contains two main optimizations: dynamically allocating shadow regions as compaction destinations to eliminate region dependencies and skipping dense regions to reduce GC workload. Evaluation results against the HotSpot JVM of OpenJDK 8/11 show that works on most benchmarks and leads to 5.6X/5.1X improvement at best in full GC throughput and thereby boost the application performance by up to 61.8%/49.0%.
Stability Optimization of Dynamic Migration Algorithm for Post-Copy of Virtual Machine Based on KVM

CHEN Shuangxi,ZHAO Ruoyan,LIU Hui,WU Chunming,RUAN Wei

DOI: https://doi.org/10.11959/j.issn.1000-0801.2021145

2021-01-01

Abstract:The dynamic migration technology of virtual machine provides a strong support for the resource scheduling of virtualization system.As one of the two core algorithms of virtual machine dynamic migration, Post-Copy algorithm has been a hot issue for scholars at home and abroad for its advantages of stable migration time and short migration downtime.The fault tolerance mechanism of virtual machine, the connection between the transfer mode of memory page and the page missing error during the migration process, and the source code of QEMU-KVM platform were studied.A fault tolerant method based on transaction synchronization was proposed to improve the stability of the Post-Copy migration algorithm.The experimental results show that the proposed algorithm can ensure the fast repair of deep end virtual machine failure, target virtual machine failure and network fault during the migration process, and solve the stability problem at a small cost.The method proposed effectively improves the stability of the Post-Copy migration algorithm, and provides reference for the future optimization research direction.
Research And Analysis Of Garbage Collection Mechanism For Real-Time Embedded Java

W Liu,Zl Chen,St Tu

DOI: https://doi.org/10.1109/CACWD.2004.1349067

2004-01-01

Abstract:Real-time embedded software is mostly written in low level language such as C and assembler. But such systems are hard to test, maintain, and port to other platform. The Java language is entering to the real-time embedded systems because of its robustness, simplicity and portability etc. However, It is very difficult to estimate the worst-case execution time of Java code currently. This is due to dynamic class loading and method calls, especially the automatic garbage collection. The paper has research-ed present solutions for garbage collection, and studied the memory management of the Real-time Specification of Java (RTSJ). Then the rational solute-on for RTSJ is to adapt incremental garbage collection and the region memory management.
Trash Talk: Accelerating Garbage Collection on Integrated GPUs is Worthless

Mohammad Dashti,Alexandra Fedorova

DOI: https://doi.org/10.48550/arXiv.2012.06281

2020-12-11

Abstract:Systems integrating heterogeneous processors with unified memory provide seamless integration among these processors with minimal development complexity. These systems integrate accelerators such as GPUs on the same die with CPU cores to accommodate running parallel applications with varying levels of parallelism. Such integration is becoming very common on modern chip architectures, and it places a burden (or opportunity) on application and system programmers to utilize the full potential of such integrated chips. In this paper we evaluate whether we can obtain any performance benefits from running garbage collection on integrated GPU systems, and discuss how difficult it would be to realize these gains for the programmer. Proliferation of garbage-collected languages running on a variety of platforms from handheld mobile devices to data centers makes garbage collection an interesting target to examine on such platforms and can offer valuable lessons for other applications. We present our analysis of running garbage collection on integrated systems and find that the current state of these systems does not provide an advantage for accelerating such a task. We build a framework that allows us to offload garbage collection tasks on integrated GPU systems from within the JVM. We identify dominant phases of garbage collection and study the viability of offloading them to the integrated GPU. We show that performance advantages are limited, partly because an integrated GPU has limited advantage in memory bandwidth over the CPU, and partly because of costly atomic operations.

Distributed, Parallel, and Cluster Computing
Put an Elephant into a Fridge

Kefei Wang,Jian Liu,Feng Chen

DOI: https://doi.org/10.14778/3397230.3397247

IF: 2.5

2020-01-01

Proceedings of the VLDB Endowment

Abstract:In today's data centers, memory-based key-value systems, such as Memcached and Redis, play an indispensable role in providing high-speed data services. The rapidly growing capacity and quickly falling price of DRAM memory in the past years have enabled us to create a large memory-based key-value store, which is able to serve hundreds of Gigabytes to even Terabytes of key-value data all in memory. Unfortunately, CPU cache in modern processors has not seen a similar growth in capacity, still remaining at the level of a few dozens of Megabytes. Such an extremely low cache-to-memory ratio (less than 0.1%) poses a significant new challenge---the limited CPU cache is becoming a severe performance bottleneck that hinders us from fully exploiting the great potential of high-speed memory-based key-value stores. To address this critical challenge, we propose a highly cache-efficient scheme, called Cavast , to optimize the cache utilization of large-capacity in-memory key-value stores. Our goal is to maximize cache efficiency and system performance without any hardware changes. We first present two light-weight, software-only mechanisms to enable user to indirectly control the cache content at application level. Then we propose a set of optimization policies to address several critical design issues that impair cache's efficacy in the current key-value store systems. By carefully reorganizing the data layout in memory, redesigning the hash indexing structure, and offloading garbage collection, we can effectively improve the utilization of the limited cache space. We have developed a module in Linux as a kernel-level support, and implemented two prototypes based on Memcached and Redis with the proposed Cavast scheme. Our experimental studies show promising results. On a 6-core Intel Xeon processor with only 15-MB cache, we can raise the cache hit ratio up to 82.7% with a very small cache-to-memory ratio (0.023%), and significantly increase the key-value system throughput by a factor of up to 4.2.
Concurrent garbage collector frame based on Java virtual machine

Min Yang,Di Wang,Xun Zhou,Yuan Zhang,Binyu Zang

2011-01-01

Abstract:The invention belongs to the technical field of Java virtual machine garbage retriever, particularly relating to a concurrent garbage collector frame based on a Java virtual machine. The frame is divided into two modules of a concurrent algorithm frame and a dispatcher, wherein the concurrent algorithm frame is designed to mainly carry out variation analysis on the existing concurrent garbage collection algorithm to finally divide modules which are conviennt to be reused or can not be reused, and the division is realized by aiming at different characteristics; the dispatcher is mainly composed of a dispatching trigger module, a dispatching algorithm module and an exhaustion processing module and mainly has two functions on determining when to trigger GC (garbage collection) and to process the situation of system resource exhaustion. According to the invention, the platform transportability of the concurrent garbage collection technology is increased to solve the problem that different concurrent garbage collection technologies are experimented under the same platform, and the superiority or inferiority of different concurrent garbage collection technologies can be researched under a certain specific platform.
Design and Evaluation of an Efficient Semispace-based Memory Reclamation Scheme

Wu Hao,Ji Zhen-Zhou

DOI: https://doi.org/10.1109/imccc.2011.62

2011-01-01

Abstract:Now that in language with garbage collection (GC) mechanism such as Java, the GC should be a direct impact on the performance of the program, and the requirement of real time GC is even higher in a real-time system. We proposed a memory reclamation scheme based on semi-space GC to satisfy the demands of real-time system. In the semi space copying collection process, large number of memory copying operations will bring a significant time overhead. Therefore, a mechanism of object classification and incomplete copying was proposed to reduce the costs of memory copying as well as to maintain a low degree of memory fragmentation. We implemented our solution on the Apache Harmony platform and the effectiveness of our collector prototype was measured through a series of benchmark tests.
NG2C: Pretenuring N-Generational GC for HotSpot Big Data Applications

Rodrigo Bruno,Luís Oliveira,Paulo Ferreira

DOI: https://doi.org/10.48550/arXiv.1704.03764

2017-04-12

Distributed, Parallel, and Cluster Computing

Abstract:Big Data applications suffer from unpredictable and unacceptably high pause times due to Garbage Collection (GC). This is the case in latency-sensitive applications such as on-line credit-card fraud detection, graph-based computing for analysis on social networks, etc. Such pauses compromise latency requirements of the whole application stack and result from applications' aggressive buffering/caching of data, exposing an ill-suited GC design, which assumes that most objects will die young and does not consider that applications hold large amounts of middle-lived data in memory. To avoid such pauses, we propose NG2C, a new GC algorithm that combines pretenuring with an N-Generational heap. By being able to allocate objects into different generations, NG2C is able to group objects with similar lifetime profiles in the same generation. By allocating objects with similar lifetime profiles close to each other, i.e. in the same generation, we avoid object promotion (copying between generations) and heap fragmentation (which leads to heap compactions) both responsible for most of the duration of HotSpot GC pause times. NG2C is implemented for the OpenJDK 8 HotSpot Java Virtual Machine, as an extension of the Garbage First GC. We evaluate NG2C using Cassandra, Lucene, and GraphChi with three different GCs: Garbage First (G1), Concurrent Mark Sweep (CMS), and NG2C. Results show that NG2C decreases the worst observable GC pause time by up to 94.8% for Cassandra, 85.0% for Lucene and 96.45% for GraphChi, when compared to current collectors (G1 and CMS). In addition, NG2C has no negative impact on application throughput or memory usage.
A Hybrid Distributed Garbage Collection of Active Objects

Zhang Ning,Chunyu Zhang,Yang Xia,Guangze Xiong

DOI: https://doi.org/10.1109/ICESS.Symposia.2008.63

2008-01-01

Abstract:Different from traditional garbage collection (GC), in actor system GC identifying whether the object is garbage or not depends on not only its references but also its processing state. It makes garbage collection more complicate. In previous work tracing algorithms such as mark-sweep are utilized which lead to GC too complicated to be suitable for large-scale distributed system. We present in this paper a hybrid distributed garbage collection which is comprised of local GC and global GC. A reverse reference is added for each reference which is from an actor that can be activated (include remotely referenced actors). Then we can utilize tracing algorithm to collect local garbage. We use timestamp algorithm and backward inquiry to identify and collect global garbage. This GC scheme can collect all garbage correctly. Furthermore, it is fault tolerant and suitable for large-scale distributed system.
Learned Garbage Collection

Lujing Cen,Ryan Marcus,Hongzi Mao,Justin Gottschlich,Mohammad Alizadeh,Tim Kraska

DOI: https://doi.org/10.1145/3394450.3397469

2020-04-28

Abstract:Several programming languages use garbage collectors (GCs) to automatically manage memory for the programmer. Such collectors must decide when to look for unreachable objects to free, which can have a large performance impact on some applications. In this preliminary work, we propose a design for a learned garbage collector that autonomously learns over time when to perform collections. By using reinforcement learning, our design can incorporate user-defined reward functions, allowing an autonomous garbage collector to learn to optimize the exact metric the user desires (e.g., request latency or queries per second). We conduct an initial experimental study on a prototype, demonstrating that an approach based on tabular Q learning may be promising.

Programming Languages
Hunting Garbage Collection Related Concurrency Bugs through Critical Condition Restoration

Hanhan Zhou,Tian Lan,Guru Venkataramani

DOI: https://doi.org/10.1145/3411502.3418426

2020-01-01

Abstract:ABSTRACTWith the increasing popularity of multi-core processors and multi-thread languages/frameworks, race conditions -- which are non-deterministic by nature -- are becoming a main root cause for concurrency bugs. It opens doors to malicious attacks such as remote code execution and denial of service attacks, potentially putting millions of users in danger. Yet, such non-deterministic racing conditions are often difficult to identify or reproduce in standard program testing. In this paper, we focus on the Garbage-Collection (GC) feature, which is known to be a frequent victim of concurrency bugs in many software systems. We develop a new approach to facilitate the testing of GC-related bugs through critical condition restoration. In particular, we propose a risk-score mechanism to quantify the risk of GC-related bugs in target functions and leverage the score to select appropriate testing parameters and garbage generation strategy, with a higher chance of producing the critical condition. Our experimental results show that the proposed approach could significantly improve the probability of finding GC-related bugs (from 0 in condition-oblivious testing to 14.8 bugs identified in our experiment) while incurring only around 26% execution overhead.
A Real-Time Relaxed Garbage Collection in Dsm

Wu Junmin,Song Zhenhua

IF: 1.019

2007-01-01

Chinese Journal of Electronics

Abstract:Garbage collection is a memory management mechanism for automatically reclaiming garbage objects in :memory. It can effectively relieve the programmers' burden and optimize the design of programs. Currently many garbage collection methods for distributed systems have been put forth as the distributed systems are more and more popular. Relaxed consistency model is a very important kind of memory consistency model in distributed system, but it is inefficiently to perform garbage collection in the Distributed shared memory system (DSM) on relaxed memory model with traditional methods. This article proposes a trace-based garbage collection algorithm for DSM system based on relaxed memory model. Our algorithm notes the references among active objects of every node in DSM system, which makes the application process and the collection process able to execute concurrently. And it makes use of the relaxed consistency model's features to reduce communication cost and response delay. Furthermore, the use of two tables insures the algorithm correct and effective. This algorithm displays its advantages of real-time and incremental, and it is proved to be correct and effective.
A data affinity based garbage collector for multi-bank flash-memory storage system

Yehua Du,Ming Cai,Jinxiang Dong

DOI: https://doi.org/10.3321/j.issn:1671-4512.2007.11.019

2007-01-01

Abstract:A novel garbage collector based on data affinity was designed. Data with the same update frequencies was detected by update-counter list and clustered into the same bank during data migration. The shutdown time of banks was lengthened greatly. It is highly advantageous to compensate the resynchronization penalty to save energy. Moreover, using energy coefficients to evaluate the cost of recycling a bank being in different energy state. Recycled-object selection algorithm considered energy and migration coefficient simultaneously to minimize the recycling energy consumption. Experimental results show that normalized energy was reduced by 15% and normalized delay was increased by 6.3%. The product of them was reduced by 9.6% compared to the cost-benefit strategy and indicated that large energy savings could be achieved with low overhead.
Two-tier garbage collection for persistent object

Dokeun Lee,Youjip Won,Yongjun Park,Seongjin Lee

DOI: https://doi.org/10.1145/3341105.3373986

2020-03-29

Abstract:An object allocated in NVM is persisted permanently even when the power is turned off. When the persistent object becomes garbage, it causes fatal space overhead in the system, and previous studies on NVM management schemes did not address an effective solution to this problem. In this paper, we propose a Two-Tier Garbage Collection (TTGC) scheme for fast and stable garbage collection in C language based persistent heap system, and validate the algorithm by implementing the technique in HEAPO, a persistent heap library for NVMs. We also verify that this scheme works more effectively than the other garbage collection techniques using other persistent heaps. Proposed technique shows about 4 to 11 times better performance in garbage collection complete time than the techniques.

The Garbage Collection Strategy in KVM

Bridging the Performance Gap for Copy-Based Garbage Collectors Atop Non-Volatile Memory

PVM: A Memory Management under Vertical Architecture

Analysis And Optimizations Of Java Full Garbage Collection

IGCEJ: An Improved Generational Garbage Collector for Embedded Java Processor

Quantitative Analysis of Boehm' S GC

Performance Analysis and Optimization of Full Garbage Collection in Memory-hungry Environments

ScissorGC: Scalable and Efficient Compaction for Java Full Garbage Collection

Stability Optimization of Dynamic Migration Algorithm for Post-Copy of Virtual Machine Based on KVM

Research And Analysis Of Garbage Collection Mechanism For Real-Time Embedded Java

Trash Talk: Accelerating Garbage Collection on Integrated GPUs is Worthless

Put an Elephant into a Fridge

Concurrent garbage collector frame based on Java virtual machine

Design and Evaluation of an Efficient Semispace-based Memory Reclamation Scheme

NG2C: Pretenuring N-Generational GC for HotSpot Big Data Applications

A Hybrid Distributed Garbage Collection of Active Objects

Learned Garbage Collection

Hunting Garbage Collection Related Concurrency Bugs through Critical Condition Restoration

A Real-Time Relaxed Garbage Collection in Dsm

A data affinity based garbage collector for multi-bank flash-memory storage system

Two-tier garbage collection for persistent object