Abstract:With widening vectors and the proliferation of advanced vector instructions in today’s processors, vectorization plays an ever-increasing role in delivering application performance. Achieving the performance potential of this vector hardware has required significant support from the software level such as new explicit vector programming models and advanced vectorizing compilers. Today, with the combination of these software tools plus new SIMD ISA extensions like gather/scatter instructions it is not uncommon to find that even codes with complex and irregular data access patterns can be vectorized. In this paper we focus on these vectorized codes with irregular accesses, and show that while the best-in-class Intel Compiler Vectorizer does indeed provide speedup through efficient vectorization, there are some opportunities where clever program transformations can increase performance further. After identifying these opportunities, this paper describes two automatic compiler optimizations to target these data access patterns. The first optimization focuses on improving the performance for a group of adjacent gathers/scatters. The second optimization improves performance for a group of stencil vector accesses using more efficient SIMD instructions. Both optimizations are now implemented in the 17.0 version of the Intel Compiler. We evaluate the optimizations using an extensive set of micro-kernels, representative benchmarks and application kernels. On these benchmarks, we demonstrate performance gains of 3–750% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon processor (Haswell—HSW), up to 25% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon PhiTM\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\hbox {Phi}^{\mathrm{TM}}$$\end{document} coprocessor (Knights Corner—KNC), and up to 430% on the Intel®\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$${\textregistered }$$\end{document} Xeon PhiTM\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\hbox {Phi}^{\mathrm{TM}}$$\end{document} processor with AVX-512 instructions support (Knights Landing—KNL).

ROVEC: Runtime Optimization of Vectorized Expression Evaluation for Column Store.

SIMD-ified R-tree Query Processing and Optimization

Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last

Roaring Bitmaps: Implementation of an Optimized Software Library

Towards Optimizing Storage Costs on the Cloud

A Parallel Function Evaluation Approach for Solution to Large-Scale Equation-Oriented Models.

IDCOS: Optimization Strategy for Parallel Complex Expression Computation on Big Data

Case Study: Optimization Methods With TVM Hybrid-OP on RISC-V Packed SIMD

Scalable Relational Query Processing on Big Matrix Data

Improved vectorization of OpenCV algorithms for RISC-V CPUs

Automated Compiler Optimization of Multiple Vector Loads/Stores

R-Store: A scalable distributed system for supporting real-time analytics

A Quantitative Evaluation of Vector Transcendental Functions on ARMv8-Based Processors

ROLEX: A Scalable RDMA-oriented Learned Key-Value Store for Disaggregated Memory Systems

A Data Optimizer for Region-Aware Self-describing Files in Scientific Computing

Experiments and optimizations for TVM on RISC-V Architectures with P Extension

Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing

QUEST: An Efficient Query Evaluation Scheme Towards Scan-Intensive Cross-Model Analysis

Optimizing LLM Queries in Relational Workloads

ROSA: R Optimizations with Static Analysis

Blitzcrank: Fast Semantic Compression for In-memory Online Transaction Processing