Abstract:With widening vectors and the proliferation of advanced vector instructions in today’s processors, vectorization plays an ever-increasing role in delivering application performance. Achieving the performance potential of this vector hardware has required significant support from the software level such as new explicit vector programming models and advanced vectorizing compilers. Today, with the combination of these software tools plus new SIMD ISA extensions like gather/scatter instructions it is not uncommon to find that even codes with complex and irregular data access patterns can be vectorized. In this paper we focus on these vectorized codes with irregular accesses, and show that while the best-in-class Intel Compiler Vectorizer does indeed provide speedup through efficient vectorization, there are some opportunities where clever program transformations can increase performance further. After identifying these opportunities, this paper describes two automatic compiler optimizations to target these data access patterns. The first optimization focuses on improving the performance for a group of adjacent gathers/scatters. The second optimization improves performance for a group of stencil vector accesses using more efficient SIMD instructions. Both optimizations are now implemented in the 17.0 version of the Intel Compiler. We evaluate the optimizations using an extensive set of micro-kernels, representative benchmarks and application kernels. On these benchmarks, we demonstrate performance gains of 3–750% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon processor (Haswell—HSW), up to 25% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon PhiTM\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\hbox {Phi}^{\mathrm{TM}}$$\end{document} coprocessor (Knights Corner—KNC), and up to 430% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon PhiTM\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\hbox {Phi}^{\mathrm{TM}}$$\end{document} processor with AVX-512 instructions support (Knights Landing—KNL).

Efficient arithmetic expression optimization withweightedadjointmatrixwith weighted adjoint matrix

Low Cost Design for Elementary Function Approximation Based on Piecewise Quadratic Interpolation

Multiprocessors for Evaluating Compound Arithmetic Functions

A sparse interpolation algorithm based on modular arithmetic coefficient parsing

Optimizing Techniques for Saturated Arithmetic with First-Order Linear Recurrence

A Novel Enhanced Arithmetic Optimization Algorithm for Global Optimization

Automated Compiler Optimization of Multiple Vector Loads/Stores

Optimized Interpolation of Four-Term Karatsuba Multiplication and a Method of Avoiding Negative Multiplicands

Fast Matrix Multiplication via Compiler-only Layered Data Reorganization and Intrinsic Lowering

Target-Aware Implementation of Real Expressions

ACC Saturator: Automatic Kernel Optimization for Directive-Based GPU Code

Weighted-Adder-Based Polynomial Computation Using Correlated Unipolar Stochastic Bitstreams

Parallel Integer Polynomial Multiplication

Compiler-Level Matrix Multiplication Optimization for Deep Learning

Optimizing Compiler for Shared-Memory Multiple Simd Architecture

Combining Power and Arithmetic Optimization via Datapath Rewriting

Performance Optimization for Sparse A(T)Ax in Parallel on Multicore Cpu

Improving SIMD Parallelism via Dynamic Binary Translation

AxOMaP : Designing FPGA-based A ppro x imate Arithmetic O perators using Ma thematical P rogramming

Energy-efficient instruction compression with programmable dictionaries

AxOMaP: Designing FPGA-based Approximate Arithmetic Operators using Mathematical Programming