Abstract:With widening vectors and the proliferation of advanced vector instructions in today’s processors, vectorization plays an ever-increasing role in delivering application performance. Achieving the performance potential of this vector hardware has required significant support from the software level such as new explicit vector programming models and advanced vectorizing compilers. Today, with the combination of these software tools plus new SIMD ISA extensions like gather/scatter instructions it is not uncommon to find that even codes with complex and irregular data access patterns can be vectorized. In this paper we focus on these vectorized codes with irregular accesses, and show that while the best-in-class Intel Compiler Vectorizer does indeed provide speedup through efficient vectorization, there are some opportunities where clever program transformations can increase performance further. After identifying these opportunities, this paper describes two automatic compiler optimizations to target these data access patterns. The first optimization focuses on improving the performance for a group of adjacent gathers/scatters. The second optimization improves performance for a group of stencil vector accesses using more efficient SIMD instructions. Both optimizations are now implemented in the 17.0 version of the Intel Compiler. We evaluate the optimizations using an extensive set of micro-kernels, representative benchmarks and application kernels. On these benchmarks, we demonstrate performance gains of 3–750% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon processor (Haswell—HSW), up to 25% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon PhiTM\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\hbox {Phi}^{\mathrm{TM}}$$\end{document} coprocessor (Knights Corner—KNC), and up to 430% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon PhiTM\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\hbox {Phi}^{\mathrm{TM}}$$\end{document} processor with AVX-512 instructions support (Knights Landing—KNL).

Target-Aware Implementation of Real Expressions

AHA: An Agile Approach to the Design of Coarse-Grained Reconfigurable Accelerators and Compilers

Automated Compiler Optimization of Multiple Vector Loads/Stores

Compiler-Driven Simulation of Reconfigurable Hardware Accelerators

Expression Acceleration: Seamless Parallelization of Typed High-Level Languages

Abstract Compilation for Verification of Numerical Accuracy Properties

Accelerated linear algebra compiler for computationally efficient numerical models: Success and potential area of improvement

BenchDirect: A Directed Language Model for Compiler Benchmarks

Coverage Prediction for Accelerating Compiler Testing

Learning to accelerate compiler testing

Synthesis of a Unified Unit for Evaluating an Application-Specific Set of Elementary Functions.

Efficient arithmetic expression optimization withweightedadjointmatrixwith weighted adjoint matrix

Chimera: an Analytical Optimizing Framework for Effective Compute-intensive Operators Fusion

Fast And Automatic Floating Point Error Analysis With CHEF-FP

Survey and design of paleozoic: a high-performance compiler tool chain for deep learning inference accelerator

Mathematical Execution: A Unified Approach for Testing Numerical Code

A Quantitative Evaluation of Vector Transcendental Functions on ARMv8-Based Processors

Efficient Execution of Quantized Deep Learning Models: A Compiler Approach

MCompiler: A Synergistic Compilation Framework

Fast Matrix Multiplication via Compiler-only Layered Data Reorganization and Intrinsic Lowering

A CGRA Front-end Compiler Enabling Extraction of General Control and Dedicated Operators