Abstract:With widening vectors and the proliferation of advanced vector instructions in today’s processors, vectorization plays an ever-increasing role in delivering application performance. Achieving the performance potential of this vector hardware has required significant support from the software level such as new explicit vector programming models and advanced vectorizing compilers. Today, with the combination of these software tools plus new SIMD ISA extensions like gather/scatter instructions it is not uncommon to find that even codes with complex and irregular data access patterns can be vectorized. In this paper we focus on these vectorized codes with irregular accesses, and show that while the best-in-class Intel Compiler Vectorizer does indeed provide speedup through efficient vectorization, there are some opportunities where clever program transformations can increase performance further. After identifying these opportunities, this paper describes two automatic compiler optimizations to target these data access patterns. The first optimization focuses on improving the performance for a group of adjacent gathers/scatters. The second optimization improves performance for a group of stencil vector accesses using more efficient SIMD instructions. Both optimizations are now implemented in the 17.0 version of the Intel Compiler. We evaluate the optimizations using an extensive set of micro-kernels, representative benchmarks and application kernels. On these benchmarks, we demonstrate performance gains of 3–750% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon processor (Haswell—HSW), up to 25% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon PhiTM\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\hbox {Phi}^{\mathrm{TM}}$$\end{document} coprocessor (Knights Corner—KNC), and up to 430% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon PhiTM\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\hbox {Phi}^{\mathrm{TM}}$$\end{document} processor with AVX-512 instructions support (Knights Landing—KNL).

Lazy Code Selector in a Just-in-time Compiler

JACO: JAva Code Layout Optimizer Enabling Continuous Optimization without Pausing Application Services

Compiling Java just in time

Accelerating XOR-based Erasure Coding using Program Optimization Techniques

Two-level Just-in-Time Compilation with One Interpreter and One Engine

Using Code Caching and Reusing to Improve Efficiency of Android JIT Compiler

Automated Compiler Optimization of Multiple Vector Loads/Stores

A Java Virtual Machine Based on Hybrid Concurrent Compilation and Execution Model

DJXPerf: Identifying Memory Inefficiencies via Object-centric Profiling for Java

Optimization of software data prefetching in the IA-64 architecture

Just-In-Time Compilation on ARM—A Closer Look at Call-Site Code Consistency

Redesigning OP2 Compiler to Use HPX Runtime Asynchronous Techniques

Intelligent-Unrolling: Exploiting Regular Patterns in Irregular Applications

A Java Virtual Machine Design Based On Hybrid Concurrent Compilation Model

Opencj: A research Java static compiler based on Open64

OJXPerf: Featherlight Object Replica Detection for Java Programs

Design and Implementation of an OpenMP Compiler Based on ORC

Method Invocation Localizing Optimization in Parallelizing Object-Oriented Language

Exploration of the Relationship Between Just-in-Time Compilation Policy and Number of Cores.

MCompiler: A Synergistic Compilation Framework