Comprehending performance from real-world execution traces

YuXiao,HanShi,ZhangDongmei,XieTao

2014-01-01

Abstract:Real-world execution traces record performance problems that are likely perceived at deployment sites. However, those problems can be rooted subtly and deeply into system layers or other components...

What problem does this paper attempt to address?

Comprehending Performance from Real-World Execution Traces

Xiao Yu,Shi Han,Dongmei Zhang,Tao Xie

DOI: https://doi.org/10.1145/2541940.2541968

2014-01-01

ACM SIGPLAN Notices

Abstract:Real-world execution traces record performance problems that are likely perceived at deployment sites. However, those problems can be rooted subtly and deeply into system layers or other components far from the place where delays are initially observed. To tackle challenges of identifying deeply rooted problems, we propose a new trace-based approach consisting of two steps: impact analysis and causality analysis. The impact analysis measures performance impacts on a component basis, and the causality analysis discovers patterns of runtime behaviors that are likely to cause the measured impacts. The discovered patterns can help performance analysts quickly identify root causes of perceived performance problems. We instantiate our approach to study the performance of device drivers on over 19,500 real-world execution traces. The impact analysis shows that device drivers constitute a non-trivial part (≈ 38) in the overall system performance, and a big part (≈ 26) is due to interactions between drivers. The causality analysis effectively discovers highly suspicious and high-impact behavioral patterns in device drivers, examined and confirmed by our automated evaluation, developers, and performance analysts.
Distance Based Root Cause Analysis and Change Impact Analysis of Performance Regressions

Junzan Zhou,Shanping Li

DOI: https://doi.org/10.1155/2015/690829

IF: 1.43

2015-01-01

Mathematical Problems in Engineering

Abstract:Performance regression testing is applied to uncover both performance and functional problems of software releases. A performance problem revealed by performance testing can be high response time, low throughput, or even being out of service. Mature performance testing process helps systematically detect software performance problems. However, it is difficult to identify the root cause and evaluate the potential change impact. In this paper, we present an approach leveraging server side logs for identifying root causes of performance problems. Firstly, server side logs are used to recover call tree of each business transaction. We define a novel distance based metric computed from call trees for root cause analysis and apply inverted index from methods to business transactions for change impact analysis. Empirical studies show that our approach can effectively and efficiently help developers diagnose root cause of performance problems.
Hybrid Performance Modeling And Analyzing Of Parallel Systems

Bin Cheng,Weiqin Tong,Xingang Wang

2012-01-01

International Journal of Numerical Analysis and Modeling

Abstract:Performance is a key feature of parallel system. However, there is a great gap between the peak performance and performance attainable by a practical application. The model-based performance evaluation may be used to support the performance-oriented program development for parallel system. In this paper a hybrid TCPN model is proposed to describe the parallel program and the resources respectively. This method can bring less effect to modify the program structure because of running environment changes. And the performance engineering activities based on this model ranges from performance prediction in early development stages, performance analysis in the coding phase, to locate the performance bottleneck and modify it. After the correctness verification of the TCPN model, a reachable graph can be got. Then the further performance-tuning can be done by summing the execution time of corresponding action in the critical path.
P-Tracer: Path-Based Performance Profiling in Cloud Computing Systems

Haibo Mi,Huaimin Wang,Hua Cai,Yangfan Zhou,Michael R. Lyu,Zhenbang Chen

DOI: https://doi.org/10.1109/COMPSAC.2012.69

2012-01-01

Abstract:In large-scale cloud computing systems, the growing scale and complexity of component interactions pose great challenges for operators to understand the characteristics of system performance. Performance profiling has long been proved to be an effective approach to performance analysis; however, existing approaches do not consider two new requirements that emerge in cloud computing systems. First, the efficiency of the profiling becomes of critical concern; second, visual analytics should be utilized to make profiling results more readable. To address the above two issues, in this paper, we present P-Tracer, an online performance profiling approach specifically tailored for large-scale cloud computing systems. P-Tracer constructs a specific search engine that adopts a proactive way to process performance logs and generates particular indices for fast queries; furthermore, PTracer provides users with a suite of web-based interfaces to query statistical information of all kinds of services, which helps them quickly and intuitively understand system behavior. The approach has been successfully applied in Alibaba Cloud Computing Inc. to conduct online performance profiling both in production clusters and test clusters. Experience with one real-world case demonstrates that P-Tracer can effectively and efficiently help users conduct performance profiling and localize the primary causes of performance anomalies.
Trace-based Multi-Dimensional Root Cause Localization of Performance Issues in Microservice Systems

Chenxi Zhang,Zhen Dong,Xin Peng,Bicheng Zhang,Miao Chen

DOI: https://doi.org/10.1145/3597503.3639088

2024-01-01

Abstract:Modern microservice systems have become increasingly complicated due to the dynamic and complex interactions and runtime environment. It leads to the system vulnerable to performance issues caused by a variety of reasons, such as the runtime environments, communications, coordinations, or implementations of services. Traces record the detailed execution process of a request through the system and have been widely used in performance issues diagnosis in microservice systems. By identifying the execution processes and attribute value combinations that are common in anomalous traces but rare in normal traces, engineers may localize the root cause of a performance issue into a smaller scope. However, due to the complex structure of traces and the large number of attribute combinations, it is challenging to find the root cause from the huge search space. In this paper, we propose TraceContrast, a trace-based multidimensional root cause localization approach. TraceContrast uses a sequence representation to describe the complex structure of a trace with attributes of each span. Based on the representation, it combines contrast sequential pattern mining and spectrum analysis to localize multidimensional root causes efficiently. Experimental studies on a widely used microservice benchmark show that TraceContrast outperforms existing approaches in both multidimensional and instance-dimensional root cause localization with significant accuracy advantages. Moreover, Trace-Contrast is efficient and its efficiency can be further improved by parallel execution.
An Online Service-Oriented Performance Profiling Tool for Cloud Computing Systems

Haibo Mi,Huaimin Wang,Yangfan Zhou,Michael Rung-Tsong Lyu,Hua Cai,Gang Yin

DOI: https://doi.org/10.1007/s11704-013-2193-4

2013-01-01

Abstract:The growing scale and complexity of component interactions in cloud computing systems post great challenges for operators to understand the characteristics of system performance. Profiling has long been proved to be an effective approach to performance analysis; however, existing approaches confront new challenges that emerge in cloud computing systems. First, the efficiency of the profiling becomes of critical concern; second, service-oriented profiling should be considered to support separation-of-concerns performance analysis. To address the above issues, in this paper, we present P-Tracer, an online performance profiling tool specifically tailored for cloud computing systems. P-Tracer constructs a specific search engine that proactively processes performance logs and generates a particular index for fast queries; second, for each service, P-Tracer retrieves a statistical insight of performance characteristics from multi-dimensions and provides operators with a suite of web-based interfaces to query the critical information. We evaluate P-Tracer in the aspects of tracing overheads, data preprocessing scalability and querying efficiency. Three real-world case studies that happened in Alibaba cloud computing platform demonstrate that P-Tracer can help operators understand software behaviors and localize the primary causes of performance anomalies effectively and efficiently.
Visualization, transformation, and analysis of execution traces with the eclipse TRACE4CPS trace tool

Martijn Hendriks,Jacques Verriet,Twan Basten

DOI: https://doi.org/10.1007/s10009-024-00736-3

2024-02-10

International Journal on Software Tools for Technology Transfer

Abstract:An execution trace is a model of a single system behavior. Execution traces occur everywhere in the system's lifecycle as they can typically be produced by executable models, by prototypes of (sub)systems, and by the system itself during its operation. An execution trace can be visualized and analyzed with various techniques, providing insight into the dynamic behavior, performance, bottlenecks, etc., of the system. In this paper, we present the Trace tool of the Eclipse Trace4cps project for the visualization and analysis of execution traces. A prominent application is the trace-based performance engineering of embedded or cyber-physical systems. Performance is an important system quality, as it can give a competitive advantage. Reasoning about system-level performance in such systems, however, is hard due to its cross-cutting nature. We show how the Trace tool can support this by various examples. Performance engineering is not the only application of the Trace tool, however: it supports system analysis in a wide range of situations.

computer science, software engineering
Understanding Performance Problems in Deep Learning Systems.

Junming Cao,Bihuan Chen,Chao Sun,Longjie Hu,Shuaihong Wu,Xin Peng

DOI: https://doi.org/10.1145/3540250.3549123

2022-01-01

Abstract:Deep learning (DL) has been widely applied to many domains. Unique challenges in engineering DL systems are posed by the programming paradigm shift from traditional systems to DL systems, and performance is one of the challenges. Performance problems (PPs) in DL systems can cause severe consequences such as excessive resource consumption and financial loss. While bugs in DL systems have been extensively investigated, PPs in DL systems have hardly been explored. To bridge this gap, we present the first comprehensive study to i) characterize symptoms, root causes, and introducing and exposing stages of PPs in DL systems developed in TensorFLow and Keras, with 224 PPs collected from 210 StackOverflow posts, and to ii) assess the capability of existing performance analysis approaches in tackling PPs, with a constructed benchmark of 58 PPs in DL systems. Our findings shed light on the implications on developing high-performance DL systems, and detecting and localizing PPs in DL systems. To demonstrate the usefulness of our findings, we develop a static checker Deep-Perf to detect three types of PPs. It has detected 488 new PPs in 130 GitHub projects. 105 and 27 PPs have been confirmed and fixed.
YTrace: End-to-end Performance Diagnosis in Large Cloud and Content Providers

Partha Kanuparthy,Yuchen Dai,Sudhir Pathak,Sambit Samal,Theophilus Benson,Mojgan Ghasemi,P. P. S. Narayan

DOI: https://doi.org/10.48550/arXiv.1602.03273

2016-05-25

Abstract:Content providers build serving stacks to deliver content to users. An important goal of a content provider is to ensure good user experience, since user experience has an impact on revenue. In this paper, we describe a system at Yahoo called YTrace that diagnoses bad user experience in near real time. We present the different components of YTrace for end-to-end multi-layer diagnosis (instrumentation, methods and backend system), and the system architecture for delivering diagnosis in near real time across all user sessions at Yahoo. YTrace diagnoses problems across service and network layers in the end-to-end path spanning user host, Internet, CDN and the datacenters, and has three diagnosis goals: detection, localization and root cause analysis (including cascading problems) of performance problems in user sessions with the cloud. The key component of the methods in YTrace is capturing and discovering causality, which we design based on a mix of instrumentation API, domain knowledge and blackbox methods. We show three case studies from production that span a large-scale distributed storage system, a datacenter-wide network, and an end-to-end video serving stack at Yahoo. We end by listing a number of open directions for performance diagnosis in cloud and content providers.

Distributed, Parallel, and Cluster Computing
PerfTrace: A New Multi-metric Network Performance Monitoring Tool

Yaozhong Liu,Long Pan,Chenglong Li,Lin He,Yirui Luo,Guanglei Song,Jiahai Yang,Zhiliang Wang

DOI: https://doi.org/10.23919/CNSM55787.2022.9964543

2022-01-01

Abstract:We present PerfTrace, an end-to-end tool for efficient, real-time, and multi-metric network performance monitoring. PerfTrace provides a high integration of different existing measurement functions, supporting the measurement of essential metrics such as latency, jitter, packet loss, and available bandwidth. More importantly, innovative schemes and algorithms are proposed to address the weaknesses of existing tools.After conducting comprehensive evaluations, we find that (i) PerfTrace measures one-way and two-way latency, jitter, and packet loss ∼9.4× faster and ∼3.6× more data-efficiently; (ii) PerfTrace measures available bandwidth in our testbed with minimal mean relative error (5.22%), outperforming all the tools compared (ranging from 8.17% to 37.24%). Meanwhile, PerfTrace consumes a more constant percentage of bandwidth resources than other tools when monitoring available bandwidth. PerfTrace’s data overhead is always only about 1/600 of the total bandwidth for a measurement frequency once per minute.
Contextual analysis of program logs for understanding system behaviors

Qiang Fu,Jian-Guang Lou,Qingwei Lin,Rui Ding,Dongmei Zhang,Tao Xie

DOI: https://doi.org/10.1109/MSR.2013.6624054

2013-01-01

Abstract:Understanding the behaviors of a software system is very important for performing daily system maintenance tasks. In practice, one way to gain knowledge about the runtime behavior of a system is to manually analyze system logs collected during the system executions. With the increasing scale and complexity of software systems, it has become challenging for system operators to manually analyze system logs. To address these challenges, in this paper, we propose a new approach for contextual analysis of system logs for understanding a system's behaviors. In particular, we first use execution patterns to represent execution structures reflected by a sequence of system logs, and propose an algorithm to mine execution patterns from the program logs. The mined execution patterns correspond to different execution paths of the system. Based on these execution patterns, our approach further learns essential contextual factors (e.g., the occurrences of specific program logs with specific parameter values) that cause a specific branch or path to be executed by the system. The mining and learning results can help system operators to understand a software system's runtime execution logic and behaviors during various tasks such as system problem diagnosis. We demonstrate the feasibility of our approach upon two real-world software systems (Hadoop and Ethereal).
Performance Debugging in the Large Via Mining Millions of Stack Traces

Shi Han,Yingnong Dang,Song Ge,Dongmei Zhang,Tao Xie

DOI: https://doi.org/10.1109/icse.2012.6227198

2012-01-01

Abstract:Given limited resource and time before software release, development-site testing and debugging become more and more insufficient to ensure satisfactory software performance. As a counterpart for debugging in the large pioneered by the Microsoft Windows Error Reporting (WER) system focusing on crashing/hanging bugs, performance debugging in the large has emerged thanks to available infrastructure support to collect execution traces with performance issues from a huge number of users at the deployment sites. However, performance debugging against these numerous and complex traces remains a significant challenge for performance analysts. In this paper, to enable performance debugging in the large in practice, we propose a novel approach, called StackMine, that mines callstack traces to help performance analysts effectively discover highly impactful performance bugs (e.g., bugs impacting many users with long response delay). As a successful technology-transfer effort, since December 2010, StackMine has been applied in performance-debugging activities at a Microsoft team for performance analysis, especially for a large number of execution traces. Based on real-adoption experiences of StackMine in practice, we conducted an evaluation of StackMine on performance debugging in the large for Microsoft Windows 7. We also conducted another evaluation on a third-party application. The results highlight substantial benefits offered by StackMine in performance debugging in the large for large-scale software systems.
Tracing Optimization for Performance Modeling and Regression Detection

Kaveh Shahedi,Heng Li,Maxime Lamothe,Foutse Khomh

2024-11-27

Abstract:Software performance modeling plays a crucial role in developing and maintaining software systems. A performance model analytically describes the relationship between the performance of a system and its runtime activities. This process typically examines various aspects of a system's runtime behavior, such as the execution frequency of functions or methods, to forecast performance metrics like program execution time. By using performance models, developers can predict expected performance and thereby effectively identify and address unexpected performance regressions when actual performance deviates from the model's predictions. One common and precise method for capturing performance behavior is software tracing, which involves instrumenting the execution of a program, either at the kernel level (e.g., system calls) or application level (e.g., function calls). However, due to the nature of tracing, it can be highly resource-intensive, making it impractical for production environments where resources are limited. In this work, we propose statistical approaches to reduce tracing overhead by identifying and excluding performance-insensitive code regions, particularly application-level functions, from tracing while still building accurate performance models that can capture performance degradations. By selecting an optimal set of functions to be traced, we can construct optimized performance models that achieve an R-2 score of up to 99% and, sometimes, outperform full tracing models (models using non-optimized tracing data), while significantly reducing the tracing overhead by more than 80% in most cases. Our optimized performance models can also capture performance regressions in our studied programs effectively, demonstrating their usefulness in real-world scenarios. Our approach is fully automated, making it ready to be used in production environments with minimal human effort.

Software Engineering,Performance
How Are Performance Issues Caused and Resolved?-An Empirical Study from a Design Perspective.

Yutong Zhao,Lu Xiao,Xiao Wang,Lei Sun,Bihuan Chen,Yang Liu,Andre B. Bondi

DOI: https://doi.org/10.1145/3358960.3379130

2020-01-01

Abstract:Empirical experience regarding how real-life performance issues are caused and resolved can provide valuable insights for practitioners to effectively and efficiently prevent, detect, and fix performance issues. Prior work shows that most performance issues have their roots in poor architectural decisions. This paper contributes a large scale empirical study of 192 real-life performance issues, with an emphasis on software design. First, this paper contributes a holistic view of eight common root causes and typical resolutions that recur in different projects, and surveyed existing literature, in particular, tools, that can detect and fix each type of performance issue. Second, this study is first-of-its-kind to investigate performance issues from a design perspective. In the 192 issues, 33% required design-level optimization, i.e. simultaneously revising a group of related source files for resolving the issues. We reveal four design-level optimization patterns, which have shown different prevalence in resolving different root causes. Finally, this study investigated the Return on Investment for addressing performance issues, to help practitioners choose between localized or design-level optimization resolutions, and to prioritize issues due to different root causes.
Localizing Root Causes of Performance Anomalies in Cloud Computing Systems by Analyzing Request Trace Logs

HaiBo Mi,HuaiMin Wang,YangFan Zhou,Michael R. Lyu,Hua Cai

DOI: https://doi.org/10.1007/s11432-012-4747-8

2012-01-01

Science China Information Sciences

Abstract:It is hard to localize the primary cause of performance anomalies in cloud computing systems because of the complexity of interactions between components.The hidden connections in the huge number of request execution paths in such systems usually contain useful information for diagnosing performance anomalies.We propose an approach to localize anomalous invoked methods and their physical locations by leveraging request trace logs,which involves two steps:（1） firstly,cluster the requests according to their corresponding call sequences,identify anomalous requests with principal component analysis,and then pick out anomalous methods with Mann-Whitney hypothesis test;（2） secondly,compare the behavior similarities of all replicated instances of the anomalous methods with Jensen-Shannon divergence,and select the ones whose behaviors are different from those of others,which will be chosen as the final culprits of performance anomalies.We conduct experiments with four real-world cases to validate our approach in Alibaba Cloud Computing Inc.The results demonstrate that our approach can locate the prime causes of performance anomalies with the low false-positive rate and false-negative rate.
Match Tracing: A Unified Framework for Real-time Win Prediction and Quantifiable Performance Evaluation

Kai Wang,Hao Li,Linxia Gong,Jianrong Tao,Runze Wu,Changjie Fan,Liang Chen,Peng Cui

DOI: https://doi.org/10.1145/3340531.3412727

2020-01-01

Abstract:Win prediction and performance evaluation are two core subjects in the sport analytics. Traditionally, they are treated separately and studied by two independent communities. However, this is not the intuitive way how humans interpret the matches: we predict the match results with the competition carrying on, and simultaneously evaluate each action based on the game context and its downstream impact. Predicting the match outcomes and evaluating the actions are coupled tasks, and the more accurately we predict, the better the evaluation is To this end, we develop a unified Match Tracing framework (namely, MT), for tackling the win prediction and performance evaluation jointly. The main idea of MT is to learn a real-time look-ahead win rate curve rather than a single scalar (win or lose). And the value of an action can be objectively measured with respect to the increase or decrease of the curve. To meet the low-latency restrictions of the online deployments, an efficient model equipped with recurrent attention mechanism and matrix perturbation (i.e., MT-Net) is built for learning and yielding the win rate curve. MT-Net encodes the players' behavior sequence through an attention mechanism and captures the player-interaction effects through a graph embedding method. With the action values derived from the win rate curve, performance can be quantified at different granularities (action/player/match level) by integrated analysis. Experiments on an e-sport game demonstrate the prediction effectiveness and the feasibility of the MT framework. Furthermore, we present the detailed application cases of MT, including key actions recognition and close match detection.
Locating Performance Regression Root Causes in the Field Operations of Web-based Systems: An Experience Report

Lizhi Liao,Jinfu Chen,Heng Li,Yi Zeng,Weiyi Shang,Catalin Sporea,Andrei Toma,Sarah Sajedi

DOI: https://doi.org/10.1109/tse.2021.3131529

IF: 7.4

2021-01-01

IEEE Transactions on Software Engineering

Abstract:Software developers usually rely on in-house performance testing to detect performance regressions and locate their root causes. Such performance testing is typically resource and time-consuming, making it impractical to conduct when the software is delivered in fast-paced release cycles. On the other hand, the operational data generated in the field environment provides rich information about the performance of a software system and its runtime activities. Therefore, this work explores the idea of leveraging the readily-available field operational data to locate the root causes of performance regression instead of running expensive performance tests. However, due to the ever-changing workloads from the end users and the noise from the field, directly analyzing performance metrics such as response time of the system may not be able to help locate the root causes of performance regressions. In this paper, we report our experience of designing and adopting an approach that automatically locates the root causes of performance regressions while the software systems are deployed and running in the field. First, our approach uses black-box performance models to capture the relationship between the performance of a system and its runtime activities. Then, our approach analyzes the performance models and uses statistical techniques to suggest the problematic system runtime activities (i.e., the root causes) that are related to a performance regression. Our evaluation considered three open-source projects and one industrial product. In the three open-source systems, we find that our approach can successfully locate the root causes of all arbitrarily injected synthetic performance regressions. Our approach has successfully detected and located the root causes of three performance regressions in an industry system and it has been adopted by our industrial partner and used in practice on a daily basis over a 12-month period. In addition, we share the challenges that we encountered during the design and adoption of our approach, how we address those challenges, and the lessons that we learned during the process. We believe that our novel approach together with our documented experience can benefit practitioners and researchers who wish to leverage the field-operation data of a software system to conduct performance assurance activities.

engineering, electrical & electronic,computer science, software engineering
DeepProf: Performance Analysis for Deep Learning Applications via Mining GPU Execution Patterns

Jiazhen Gu,Huan Liu,Yangfan Zhou,Xin Wang

DOI: https://doi.org/10.48550/arXiv.1707.03750

2017-07-12

Software Engineering

Abstract:Deep learning applications are computation-intensive and often employ GPU as the underlying computing devices. Deep learning frameworks provide powerful programming interfaces, but the gap between source codes and practical GPU operations make it difficult to analyze the performance of deep learning applications. In this paper, through examing the features of GPU traces and deep learning applications, we use the suffix tree structure to extract the repeated patten in GPU traces. Performance analysis graphs can be generated from the preprocessed GPU traces. We further present \texttt{DeepProf}, a novel tool to automatically process GPU traces and generate performance analysis reports for deep learning applications. Empirical study verifies the effectiveness of \texttt{DeepProf} in performance analysis and diagnosis. We also find out some interesting properties of Tensorflow, which can be used to guide the deep learning system setup.
Performance Issue Diagnosis for Online Service Systems

Qiang Fu,Jian-Guang Lou,Qing-Wei Lin,Rui Ding,Dongmei Zhang,Zihao Ye,Tao Xie

DOI: https://doi.org/10.1109/SRDS.2012.49

2012-01-01

Abstract:Monitoring and diagnosing performance issues of an online service system are critical to assure satisfactory performance of the system. Given a detected performance issue and collected system metrics for an online service system, engineers usually need to make great efforts to conduct diagnosis by first identifying performance issue beacons, which are metrics that pinpoint to the root causes. In order to reduce the manual efforts, in this paper, we propose a new approach to effectively detecting performance issue beacons to help with performance issue diagnosis. Our approach includes techniques for mining system metric data to address limitations when applying previous classification-based approaches. Our evaluations on both a controlled environment and a real production environment show that our approach can more effectively identify performance issue beacons from system metric data than previous approaches.
Characterizing Job Microarchitectural Profiles at Scale: Dataset and Analysis

Kangjin Wang,Ying Li,Cheng Wang,Tong Jia,Kingsum Chow,Yang Wen,Yaoyong Dou,Guoyao Xu,Chuanjia Hou,Jie Yao,Liping Zhang

DOI: https://doi.org/10.1145/3545008.3545026

2022-01-01

Abstract:Understanding the microarchitectural resource characteristics of datacenter jobs has become increasingly critical to guarantee the performance of jobs while improving resource utilization. Prior work studied the resource characteristics of datacenter jobs at the OS level, little reveals the deep and detailed characteristics at the microarchitecture level due to the lack of related open traces. In this paper, we provide a new open trace, AMTrace (Alibaba Microarchitecture Trace) 1, which is profiled from 8,577 high-end physical hosts from Alibaba's datacenter by a hardware/software co-design monitoring method. AMTrace provides the microarchitectural metrics of 9.8 x 10(5) Linux containers with "Per-Container-Per-Logic CPU" granularity. Different from existing open traces, AMTrace provides a new perspective to analyze the microarchitectural resource characteristics of datacenter jobs. Based on AMTrace, we first reveal the uneven resource usage of jobs among multiple logic CPUs. Then, we analyze the impact of resource contention of CPU and memory bandwidth on job performance. Finally, we analyze the job performance under different CPU provisioning modes from microarchitecture perspective. These analyses lead to constructive insights for datacenter resource management and optimization. Furthermore, we discuss possible research opportunities on AMTrace and we believe that AMTrace will inspire more exciting research on microarchitecture and resource management.

Comprehending performance from real-world execution traces

Comprehending Performance from Real-World Execution Traces

Distance Based Root Cause Analysis and Change Impact Analysis of Performance Regressions

Hybrid Performance Modeling And Analyzing Of Parallel Systems

P-Tracer: Path-Based Performance Profiling in Cloud Computing Systems

Trace-based Multi-Dimensional Root Cause Localization of Performance Issues in Microservice Systems

An Online Service-Oriented Performance Profiling Tool for Cloud Computing Systems

Visualization, transformation, and analysis of execution traces with the eclipse TRACE4CPS trace tool

Understanding Performance Problems in Deep Learning Systems.

YTrace: End-to-end Performance Diagnosis in Large Cloud and Content Providers

PerfTrace: A New Multi-metric Network Performance Monitoring Tool

Contextual analysis of program logs for understanding system behaviors

Performance Debugging in the Large Via Mining Millions of Stack Traces

Tracing Optimization for Performance Modeling and Regression Detection

How Are Performance Issues Caused and Resolved?-An Empirical Study from a Design Perspective.

Localizing Root Causes of Performance Anomalies in Cloud Computing Systems by Analyzing Request Trace Logs

Match Tracing: A Unified Framework for Real-time Win Prediction and Quantifiable Performance Evaluation

Locating Performance Regression Root Causes in the Field Operations of Web-based Systems: An Experience Report

DeepProf: Performance Analysis for Deep Learning Applications via Mining GPU Execution Patterns

Performance Issue Diagnosis for Online Service Systems

Characterizing Job Microarchitectural Profiles at Scale: Dataset and Analysis