New Search Strategy and Automatic Algorithm for Systolic Array Transformations

CHEN Mu-yi,HU Hai-jun,LI Hui

DOI: https://doi.org/10.3969/j.issn.1001-3695.2007.04.023

2007-01-01

Abstract:This paper revealed an optimized strategy to search for systolic array transformations for nested loops,when the upper and lower bound of inner index was affine functions of there outer loop indexes.

What problem does this paper attempt to address?

Searching Algorithm for Space and Time Mapping in Linear Systolic Array Transformation

CHEN Mu-yi,LI Hui

DOI: https://doi.org/10.3969/j.issn.1000-1220.2007.02.023

2007-01-01

Abstract:The realization of mapping a class of nested loop algorithms to linear systolic array is studied. A heuristic algorithm that decreases the computation complexity for the searching of space transformation S is introduced. Moreover, the basis reduction and a branch-and-bound algorithm are adopted in order to reduce the time complexity from exponential to polynomial. Finally, by rearranging the verification order and combining the verification with the structure of an actual processing element, the time complexity is further reduced and a better PE structure has been achieved. The experiments show that this method can lead to better results in relatively shorter time compared to previous algorithms.
Difference Based Search Algorithm for Fast Block-Matching Motion Estimation

Haibin Shen

2013-01-01

Computer Engineering and Applications Journal

Abstract:By researching into the redundancy in the Diamond Search algorithm(DS),a new improved Difference Based Search (DBS)algorithm is proposed.By making use of the relationship between distortions of search points,the direction that leads to global minimum distortion point is predicted.In this way,the number of points which needs to be calculated is reduced.Experiment results show that the new algorithm achieves higher coding speed while maintaining the matching precision.
Efficient and Low-Latency Systolic Array Architecture for Full Searches in Block-Matching Motion Estimation

张武健,邱晓海,周润德,陈弘毅

2012-01-01

Abstract:This paper describes an efficient, low-latency systolic array architecture for full searches in block-matching motion estimation. Conventional one-dimensional systolic array architecture is used to develop a novel ring-like systolic array architecture through operator rescheduling considering the symmetry of the data flow. High-latency delay due to stuffing of the array pipeline in the conventiona...
Search for Optimal Systolic Arrays: A Comprehensive Automated Exploration Framework and Lessons Learned

Jie Wang,Jason Cong

DOI: https://doi.org/10.48550/arXiv.2111.14252

2021-11-28

Hardware Architecture

Abstract:Systolic arrays have been widely used for accelerating HPC and deep learning applications. There is a plethora of previous works on the performance tuning of systolic arrays, but usually based on a number of oversimplified assumptions (e.g., only considering divisors for loop tiling, pruning based on off-chip data communication) to reduce the design space. In this paper, we present a comprehensive design space exploration tool named Odyssey for systolic array optimization. Odyssey does not rely on artificial assumptions to limit the design space, and yet it is highly efficient and scalable with a hybrid optimization technique. For example, for a 1024x1024x1024 matrix multiplication, it finds designs that reach 90% of the optimal performance in 5 seconds with a single CPU thread. Moreover, using Odyssey, we unveil and quantify the suboptimality introduced by multiple commonly used oversimplifications in prior studies for systolic array design space exploration. For example, Odyssey results show that limiting to divisors for loop tiling leads to a 39% performance loss, and pruning based on off-chip data movement results in a 45% performance loss. We applied Odyssey to explore the architecture trade-offs for matrix multiplication and convolutional neural network, providing inspiration into possible optimizations for these two applications.
An Improved Shape Shifting Method of Critical Area Extraction

Zhu Jiaojiao,Luo Xiaohua,Chen Lisheng,Ye Yi,Yan Xiaolang

DOI: https://doi.org/10.1088/1674-4926/35/2/026006

2014-01-01

Abstract:As die size and complexity increase, accurate and efficient extraction of the critical area is essential for yield prediction. Aiming at eliminating the potential integration errors of the traditional shape shifting method, an improved shape shifting method is proposed for Manhattan layouts. By mathematical analyses of the relevance of critical areas to defect sizes, the critical area for all defect sizes is modeled as a piecewise quadratic polynomial function of defect size, which can be obtained by extracting critical area for some certain defect sizes. Because the improved method calculates critical areas for all defect sizes instead of several discrete values with traditional shape shifting method, it eliminates the integration error of the average critical area. Experiments on industrial layouts show that the improved shape shifting method can improve the accuracy of the average critical area calculation by 24.3% or reduce about 59.7% computational expense compared with the traditional method.
An enhanced heuristic searching algorithm for complicated constrained optimization problems

Feng Yu,Yanjun Li,Tie-Jun Wu

DOI: https://doi.org/10.1007/11816157_106

2006-01-01

Abstract:In many complicated constrained optimization problems, intelligent searching technique based algorithms are very inefficient even to get a feasible solution. This paper presents an enhanced heuristic searching algorithm to solve this kind of problems. The proposed algorithm uses known feasible solutions as heuristic information, then orients and shrinks the search spaces towards the feasible set. It is capable of improving the search performance significantly without any complicated and specialized operators. Benchmark problems are tested to validate the effectiveness of the proposed algorithm.
New Advanced Template-matching Algorithm

杨勇兵,何绪昊,戚其丰,胡跃明

DOI: https://doi.org/10.3969/j.issn.1001-3474.2010.03.002

2010-01-01

Abstract:Advanced template-matching algorithm is based on fast fourier transform(FFT).Because the existing template matching algorithm needs a huge computation,and the cacutation speed is limited in current technology situation,so put forward a new template-matching algorithm based on fourier transform convolution theorem.This algorithm combined fast fourier transform(FFT),will greatly reduce the amount of computation.
Improved Affine Partition Algorithm for Compile-Time and Runtime Performance.

Yuan Xinyu,Li Ying,Deng Shuiguang,Cheng Jie

DOI: https://doi.org/10.1080/10798587.2011.10643220

2011-01-01

Abstract:The Affine partitioning framework, which unifies many useful program transforms such as unimodular transformations, loop fusion, fission, scaling, reindexing, and statement reordering, has been proved to be successful in automatic discovery of the loop-level parallelization in programs. The affine partition algorithm was improved from the aspects of compile-time and runtime efficiency in this paper. Firstly, it improves compile-time speed of affine partition algorithm by using of generalized GCD test which is a basic dependence testing algorithm. This paper proved that generalized GCD test has a strong relationship with affine partition algorithm which can improve the compiling speed of the affine partition algorithm. Secondly, a method is put forward to select an optimal solution among the infinite legal solutions of the affine partition algorithm which ensures the minimum communication volume and the simplified processor space expression. Proved by experiments, the two innovations mentioned above can promote the compile-time and runtime efficiency of the affine partition algorithm.
Synthesizing Nested Loop Algorithms Using Nonlinear Transformation Method.

JP SHEU,CY CHANG

DOI: https://doi.org/10.1109/71.86106

IF: 5.3

1991-01-01

IEEE Transactions on Parallel and Distributed Systems

Abstract:FOR-loops are the main source of parallelism in programs. A nonlinear transformation algorithm for parallelizing the execution of FOR-loop models is proposed. It is shown that by the mapping of nonlinear transformation, iterations of FOR-loops can be executed in a parallel form. The algorithm is useful in exploiting the parallelism of FOR-loops with one or more partitions on the innermost loop. Algorithms to partition and map the nested FOR-loops onto fixed size systolic arrays are discussed. Based on the time and space mapping schemes, all the iterations of FOR-loops can be correctly executed on the array processors in a parallel form.
Low-latency array architecture for telescopic-search-based motion estimation

Wujian Zhang,Runde Zhou,T. Kondo

DOI: https://doi.org/10.1049/el:20000991

2000-01-01

Electronics Letters

Abstract:An efficient low-latency array architecture is presented for telescopic-search-based block-matching motion estimation. It consists of a novel ring-like systolic array and a comparing tree. The new architecture achieves higher processor utilisation, delivers a higher throughput rate, and requires minimal memory bandwidth.
Extreme Sparse-Array Synthesis Via Iterative Convex Optimization and Simulated-Annealing Expanded Array

Boxuan Gu,Rongxin Jiang,Xuesong Liu,Yaowu Chen

DOI: https://doi.org/10.3390/electronics12061401

IF: 2.9

2023-01-01

Electronics

Abstract:Sparse-array synthesis can considerably reduce the number of sensor elements while optimizing the beam-pattern response performance. The sparsity of an array is related to the degrees of freedom of the array elements. A sparse-array method based on iterative convex optimization and a simulated-annealing expanded array is proposed in this paper. This method transforms the sparse-array problem into a minimum l1 norm problem and obtains the sparse array by solving the convex optimization problem using the primal-dual algorithm. Meanwhile, to improve the degree of freedom, array elements are expanded using stochastic perturbation. According to the simulated-annealing algorithm, the closed array elements are reopened with a specific probability, which is iteratively thinned and expanded. The results show that the proposed method can obtain an extremely sparse array, which is better than that obtained using the existing methods.
A comparison of block-matching algorithms mapped to systolic-array implementation

Sheu-Chih Cheng,Hsueh-Min Hang

DOI: https://doi.org/10.1109/76.633491

IF: 5.859

1997-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:This paper presents an evaluation of several well-known block-matching motion estimation algorithms from a system-level very large scale integration (VLSI) design viewpoint. Because a straightforward block-matching algorithm (BMA) demands a very large amount of computing power, many fast algorithms have been developed. However, these fast algorithms are often designed to merely reduce arithmetic operations without considering their overall performance in VLSI implementation. Three criteria are used to compare various block-matching algorithms: (1) silicon area, (2) input/output requirement, and (3) image quality. A basic systolic array architecture is chosen to implement all the selected algorithms. The purpose of this study is to compare these representative BMAs using the aforementioned criteria. The advantages/disadvantages of these algorithms in terms of their hardware tradeoff are discussed. The methodology and results presented provide useful guidelines to system designers in selecting a BMA for VLSI implementation.

engineering, electrical & electronic
Systolic Structure for DCT with Low Area-Time Complexity

CAO Xiao-yang,PAN Yun,YAN Xiao-lang,HUAN Ruo-hong

DOI: https://doi.org/10.3785/j.issn.1008-973x.2011.04.011

2011-01-01

Abstract:A systolic-array based discrete cosine transform(DCT) was proposed in order to study the application of systolic array in DCT and balance the area complexity and time complexity in the very large scale integrated-circuit(VLSI) implementation of DCT.The characteristic of DCT was analyzed and the one-dimensional DCT formula was transformed.The data items that can be reused were found to reduce computation.The systolic structure which can save computing time by higher parallelism was used to solve the deformed DCT algorithm.Results show that the structure has lower area-time complexity than the previous systolic-array based structures,and has a smaller restriction on the length of DCT,only requiring an even number.
Facilitating the search for compositions of program transformations

Albert Cohen,Marc Sigler,Sylvain Girbal,Olivier Temam,David Parello,Nicolas Vasilache

DOI: https://doi.org/10.1145/1088149.1088169

2005-01-01

Abstract:Static compiler optimizations can hardly cope with the complex run-time behavior and hardware components interplay of modern processor architectures. Multiple architectural phenomena occur and interact simultaneously, which requires the optimizer to combine multiple program transformations. Whether these transformations are selected through static analysis and models, runtime feedback, or both, the underlying infrastructure must have the ability to perform long and complex compositions of program transformations in a flexible manner. Existing compilers are ill-equipped to perform that task because of rigid phase ordering, fragile selection rules using pattern matching, and cumbersome expression of loop transformations on syntax trees. Moreover, iterative optimization emerges as a pragmatic and general means to select an optimization strategy via machine learning and operations research. Searching for the composition of dozens of complex, dependent, parameterized transformations is a challenge for iterative approaches.The purpose of this article is threefold: (1) to facilitate the automatic search for compositions of program transformations, introducing a richer framework which improves on classical polyhedral representations, suitable for iterative optimization on a simpler, structured search space, (2) to illustrate, using several examples, that syntactic code representations close to the operational semantics hamper the composition of transformations, and (3) that complex compositions of transformations can be necessary to achieve significant performance benefits. The proposed framework relies on a unified polyhedral representation of loops and statements. The key is to clearly separate four types of actions associated with program transformations: iteration domain, schedule, data layout and memory access functions modifications. The framework is implemented within the Open64/ORC compiler, aiming for native IA64, AMD64 and IA32 code generation, along with source-to-source optimization of Fortran90, C and C++.
Generating Systolic Array Accelerators with Reusable Blocks

Liancheng Jia,Liqiang Lu,Xuechao Wei,Yun Liang

DOI: https://doi.org/10.1109/mm.2020.2997611

IF: 2.8212

2020-01-01

IEEE Micro

Abstract:Systolic array architecture is widely used in spatial hardware and well-suited for many tensor processing algorithms. Many systolic array architectures are implemented with high-level synthesis (HLS) design flow. However, existing HLS tools do not favor of modular and reusable design, which brings inefficiency for design iteration. In this article, we analyze the systolic array design space, and identify the common structures of different systolic dataflows. We build hardware module templates using Chisel infrastructure, which can be reused for different dataflows and computation algorithms. This remarkably improves the productivity for the development and optimization of systolic architecture. We further build a systolic array generator that transforms the tensor algorithm definition to a complete systolic hardware architecture. Experiments show that we can implement systolic array designs for different applications and dataflows with little engineering effort, and the performance throughput outperforms HLS designs.
An Efficient and Universal Static and Dynamic Convex Optimization for Array Synthesis

Chen Zhang Feng,Wen Tao Li,Can Cui,Yong Qiang Hei,Jin Chao Mou,Xiao Wei Shi

DOI: https://doi.org/10.1109/lawp.2022.3190421

IF: 4.2

2022-10-08

IEEE Antennas and Wireless Propagation Letters

Abstract:In this letter, a novel static-dynamic convex optimization algorithm is proposed for array synthesis, which can be divided into static and dynamic successive optimization stages. At the first stage, the synthetic direction graph is constructed as a second-order cone programming problem so that an initial excitation is quickly obtained. Next, by serving the results obtained previously as the initial excitation, an iterative operation is implemented to obtain a high-precise solution. Moreover, in order to effectively ensure the continuity of the solution process and approach the feasible solution, shrinkage factor and crossover operator are introduced. Four tough examples of synthesizing different kinds of patterns are conducted to validate the feasibility and effectiveness of the proposed method. Results show that compared with the existing representative methods, the proposed algorithm is of high computational efficiency and universality.

telecommunications,engineering, electrical & electronic
Efficient Local Search for Nonlinear Real Arithmetic

Zhonghan Wang,Bohua Zhan,Bohan Li,Shaowei Cai

2023-11-24

Abstract:Local search has recently been applied to SMT problems over various arithmetic theories. Among these, nonlinear real arithmetic poses special challenges due to its uncountable solution space and potential need to solve higher-degree polynomials. As a consequence, existing work on local search only considered fragments of the theory. In this work, we analyze the difficulties and propose ways to address them, resulting in an efficient search algorithm that covers the full theory of nonlinear real arithmetic. In particular, we present two algorithmic improvements: incremental computation of variable scores and temporary relaxation of equality constraints. We also discuss choice of candidate moves and a look-ahead mechanism in case when no critical moves are available. The resulting implementation is competitive on satisfiable problem instances against complete methods such as MCSAT in existing SMT solvers.

Symbolic Computation
An efficient numerical algorithm for solving linear systems with cyclic tridiagonal coefficient matrices

Jia, Ji-Teng,Xie, Rong,Wang, Yi-Fan

DOI: https://doi.org/10.1007/s10910-024-01631-7

2024-06-09

Journal of Mathematical Chemistry

Abstract:In the present paper, we mainly consider the direct solution of cyclic tridiagonal linear systems. By using the specific low-rank and Toeplitz-like structure, we derive a structure-preserving factorization of the coefficient matrix. Based on the combination of such matrix factorization and Sherman–Morrison–Woodbury formula, we then propose a cost-efficient algorithm for numerically solving cyclic tridiagonal linear systems, which requires less memory storage and data transmission. Furthermore, we show that the structure-preserving matrix factorization can provide us with an explicit formula for n -th order cyclic tridiagonal determinants. Numerical examples are given to demonstrate the performance and efficiency of our algorithm. All of the experiments are performed on a computer with the aid of programs written in MATLAB.

chemistry, multidisciplinary,mathematics, interdisciplinary applications
A New Loop Partition Method - Clustering

Sy Tseng,Ct King,Cy Tang

DOI: https://doi.org/10.5555/647025.714376

1993-01-01

Abstract:Array subscript, in general, is a linear function of loop indices, called linear subscripts, if array enclosed by loops. For linear subscripts, the dependences among iterations could be complex. In case of complex dependence, it is very difficult to extract parallelism from the loops. In this paper, we propose a new compiler technique, called clustering, to overcome this difficulties in parallelizing nested loops with linear subscripts. By applying the integer programming and linearizing the nested loops, we can partition the iterations of loops into clusters. All iterations in the same cluster can be executed at the same time. We can observe that this compiler technique can greatly enhance the parallelism of a nested loop.
Multi-strategy adaptive cuckoo search algorithm for numerical optimization

Jiatang Cheng,Yan Xiong

DOI: https://doi.org/10.1007/s10462-022-10222-4

IF: 9.588

2022-06-29

Artificial Intelligence Review

Abstract:Cuckoo search (CS) algorithm is a popular and efficient search technique for tackling numerical optimization problems. Nevertheless, CS algorithm is prone to premature convergence in solving complex multimode problems. Motivated by this observation, we propose a novel CS algorithm named multi-strategy adaptive CS (MACS). Specifically, in MACS, a parameter control strategy based on the Cauchy distribution and Lehmer mean is employed to dynamically update the step size. After that, three search strategies with different advantages are integrated to complement one another throughout the evolution process, which further strengthens the versatility and robustness. Besides, after every certain number of generations, a probability matching scheme is adopted to adaptively determine the best performing search strategy to produce more promising offspring. Extensive experiments are conducted on 42 benchmark problems from two different test suites. In comparison to seven advanced CS variants as well as other several popular algorithms, the experimental results indicate that MACS exhibits better overall performance.

computer science, artificial intelligence

New Search Strategy and Automatic Algorithm for Systolic Array Transformations

Searching Algorithm for Space and Time Mapping in Linear Systolic Array Transformation

Difference Based Search Algorithm for Fast Block-Matching Motion Estimation

Efficient and Low-Latency Systolic Array Architecture for Full Searches in Block-Matching Motion Estimation

Search for Optimal Systolic Arrays: A Comprehensive Automated Exploration Framework and Lessons Learned

An Improved Shape Shifting Method of Critical Area Extraction

An enhanced heuristic searching algorithm for complicated constrained optimization problems

New Advanced Template-matching Algorithm

Improved Affine Partition Algorithm for Compile-Time and Runtime Performance.

Synthesizing Nested Loop Algorithms Using Nonlinear Transformation Method.

Low-latency array architecture for telescopic-search-based motion estimation

Extreme Sparse-Array Synthesis Via Iterative Convex Optimization and Simulated-Annealing Expanded Array

A comparison of block-matching algorithms mapped to systolic-array implementation

Systolic Structure for DCT with Low Area-Time Complexity

Facilitating the search for compositions of program transformations

Generating Systolic Array Accelerators with Reusable Blocks

An Efficient and Universal Static and Dynamic Convex Optimization for Array Synthesis

Efficient Local Search for Nonlinear Real Arithmetic

An efficient numerical algorithm for solving linear systems with cyclic tridiagonal coefficient matrices

A New Loop Partition Method - Clustering

Multi-strategy adaptive cuckoo search algorithm for numerical optimization