A Compact Multiway Merge Sorter using Linear-Array Comparators

T. Satoh,H. Takeda,N. Tsuda

DOI: https://doi.org/10.1007/3-540-51295-0_130

1989-07-21

Abstract:

What problem does this paper attempt to address?

TwinArray Sort: An Ultrarapid Conditional Non-Comparison Based Sorting Algorithm

Amin Amini

2024-09-30

Abstract:In computer science, sorting algorithms are crucial for data processing and machine learning. Large datasets and high efficiency requirements provide challenges for comparison-based algorithms like Quicksort and Merge sort, which achieve O(n log n) time complexity. Non-comparison-based algorithms like Spreadsort and Counting Sort have memory consumption issues and a relatively high computational demand, even if they can attain linear time complexity under certain circumstances. We present TwinArray Sort, a novel conditional non-comparison-based sorting algorithm that effectively uses array indices. When it comes to worst-case time and space complexities, TwinArray Sort achieves O(n+k). The approach remains efficient under all settings and works well with datasets with randomly sorted, reverse-sorted, or nearly sorted distributions. TwinArray Sort can handle duplicates and optimize memory efficiently since thanks to its two auxiliary arrays for value storage and frequency counting, as well as a conditional distinct array verifier. TwinArray Sort constantly performs better than conventional algorithms, according to experimental assessments and particularly when sorting unique arrays under all data distribution scenarios. The approach is suitable for massive data processing and machine learning dataset management due to its creative use of dual auxiliary arrays and a conditional distinct array verification, which improves memory use and duplication handling. TwinArray Sort overcomes conventional sorting algorithmic constraints by combining cutting-edge methods with non-comparison-based sorting advantages. Its reliable performance in a range of data distributions makes it an adaptable and effective answer for contemporary computing requirements.

Data Structures and Algorithms,Computational Complexity
Optimized Merge Sort on Modern Commodity Multi-core CPUs

Ming Xu,Xianbin Xu,MengJia Yin,Fang Zheng

DOI: https://doi.org/10.12928/telkomnika.v14i1.2741

2016-01-01

TELKOMNIKA (Telecommunication Computing Electronics and Control)

Abstract:Sorting is a kind of widely used basic algorithms. As the high performance computing devices are increasingly common, more and more modern commodity machines have the capability of parallel concurrent computing. A new implementation of sorting algorithms is proposed to harness the power of newer SIMD operations and multi-core computing provided by modern CPUs. The algorithm is hybrid by optimized bitonic sorting network and multi-way merge. New SIMD instructions provided by modern CPUs are used in the bitonic network implementation, which adopted a different method to arrange data so that the number of SIMD operations is reduced. Balanced binary trees are used in multi-way merge, which is also different with former implementations. Efforts are also paid on minimizing data moving in memory since merge sort is a kind of memory-bound application. The performance evaluation shows that the proposed algorithm is twice as fast as the sort function in C++ standard library when only single thread is used. It also outperforms radix sort implemented in Boost library.
Fully Flexible Parallel Merge Sort for Multicore Architectures

Zbigniew Marszałek,Marcin Woźniak,Dawid Połap

DOI: https://doi.org/10.1155/2018/8679579

IF: 2.3

2018-12-02

Complexity

Abstract:The development in multicore architectures gives a new line of processors that can flexibly distribute tasks between their logical cores. These need flexible models of efficient algorithms, both fast and stable. A new line of efficient sorting algorithms can support these systems to efficiently use all available resources. Processes and calculations shall be flexibly distributed between cores to make the performance as high as possible. In this article we present a fully flexible sorting method designed for parallel processing. The idea we describe in this article is based on modified merge sort, which in parallel form is designed for multicore architectures. The novelty of this idea is in particular way of processing. We have developed a fully flexible method that can be implemented for a number of processors. The tasks are flexibly distributed between logical cores to increase the efficiency of sorting. The method preserves separation of concerns; therefore, each of the processors works separately without any cross actions and interruptions. The proposed method was described in theoretical way, examined in tests, and compared to other methods. The results confirm high efficiency and show that with each newly added processor sorting becomes faster and more efficient.

mathematics, interdisciplinary applications,multidisciplinary sciences
COMPARATIVE STUDY OF TWO DIVIDE AND CONQUER SORTING ALGORITHMS: QUICKSORT AND MERGESORT

Oladipupo Esau Taiwo,Abikoye Oluwakemi Christianah,Akande Noah Oluwatobi,Kayode Anthonia Aderonke,Adeniyi Jide kehinde

DOI: https://doi.org/10.1016/j.procs.2020.04.274

2020-01-01

Procedia Computer Science

Abstract:<p>Divide and Conquer is a well-known technique for designing algorithms. Many of the existing algorithms are a product of this popular algorithm design technique. Such include Quick sort and Merge sort sorting algorithms. These two algorithms have been widely employed for sorting, however, determining the most efficient among the two has always been a contentious issue. Most of the existing literature have compared these algorithms using machine dependent factors such as computational complexity but few have employed machine independent factors such as internal/external sorting, algorithm complexity: best, average, and worst cases, memory usage, stability etc. This study intends to contribute to this discuss using both machine dependent and independent factors. The implementation was carried out in MATLAB programming environment and the internal system clock was set to keep track of the time required for sorting. Results obtained revealed that in terms of computational speed using array of small sizes, Quick sort algorithm is faster, though Merge sort algorithm is faster with array of large sizes. Also, both algorithms are of O(nlogn) best case and average case complexity while the worst case for quicksort is O(n<sup>2</sup>) and that of merge sort remains unchanged. In terms of stability, Quick sort is stable while Merge sort is not. Despite the excellent performance of Merge sort algorithm, the need for an auxiliary memory for sorting makes it less preferable than Quick sort algorithm for applications where a good cache locality is of paramount importance.</p>
The Curious Case of Modified Merge Sort

Harsh Sagar Garg,Vanita Jain,Gopal Chaudhary

DOI: https://doi.org/10.1007/978-981-15-4992-2_45

2020-07-02

Abstract:We propose an O(N logN) sorting method by Modified Merge Sort Method, which shows huge potential to sort big data sets, and even better potential to sort big data sets with a smaller range. Six sorting algorithms: Selection Sort, Insertion sort, Merge sort, Quick sort, Bubble Sort and Modified Merge Sort were implemented in C++ programming languages and tested for the random sequence input of length 100, 1000, 4000, 9000 on random numbers and the IPL Dataset.
A bargain for mergesorts (functional pearl) -- How to prove your mergesort correct and stable, almost for free

Cyril Cohen,Kazuhiko Sakaguchi

2024-03-13

Abstract:We present a novel characterization of stable mergesort functions using relational parametricity, and show that it implies the correctness of mergesort. As a result, one can prove the correctness of several variations of mergesort (e.g., top-down, bottom-up, tail-recursive, non-tail-recursive, smooth, and non-smooth mergesorts) by proving the characterization property for each variation. To further motivate this work, we show a performance trade-off between tail-recursive and non-tail-recursive mergesorts that (1) the former in call-by-value evaluation avoids using up stack space and is efficient and (2) the latter in call-by-need evaluation is an optimal incremental sort, meaning that it performs only $\mathcal{O}(n + k \log k)$ comparisons to compute the least (or greatest) $k$ items of a list of length $n$. Thanks to our characterization and the parametricity translation, we deduced the correctness results, including stability, of various implementations of mergesort for lists, including highly optimized ones, in the Coq proof assistant.

Data Structures and Algorithms,Logic in Computer Science,Programming Languages
Improved Affine Partition Algorithm for Compile-Time and Runtime Performance.

Yuan Xinyu,Li Ying,Deng Shuiguang,Cheng Jie

DOI: https://doi.org/10.1080/10798587.2011.10643220

2011-01-01

Abstract:The Affine partitioning framework, which unifies many useful program transforms such as unimodular transformations, loop fusion, fission, scaling, reindexing, and statement reordering, has been proved to be successful in automatic discovery of the loop-level parallelization in programs. The affine partition algorithm was improved from the aspects of compile-time and runtime efficiency in this paper. Firstly, it improves compile-time speed of affine partition algorithm by using of generalized GCD test which is a basic dependence testing algorithm. This paper proved that generalized GCD test has a strong relationship with affine partition algorithm which can improve the compiling speed of the affine partition algorithm. Secondly, a method is put forward to select an optimal solution among the infinite legal solutions of the affine partition algorithm which ensures the minimum communication volume and the simplified processor space expression. Proved by experiments, the two innovations mentioned above can promote the compile-time and runtime efficiency of the affine partition algorithm.
Efficient parallel merge sort for fixed and variable length keys

Andrew Davidson,David Tarjan,Michael Garland,John D. Owens

DOI: https://doi.org/10.1109/inpar.2012.6339592

2012-05-01

Abstract:We design a high-performance parallel merge sort for highly parallel systems. Our merge sort is designed to use more register communication (not shared memory), and does not suffer from over segmentation as opposed to previous comparison based sorts. Using these techniques we are able to achieve a sorting rate of 250 MKeys/sec, which is about 2.5 times faster than Thrust merge sort performance, and 70% faster than non-stable state-of-the-art GPU merge sorts. Building on this sorting algorithm, we develop a scheme for sorting variable-length key/value pairs, with a special emphasis on string keys. Sorting non-uniform, unaligned data such as strings is a fundamental step in a variety of algorithms, yet it has received comparatively little attention. To our knowledge, our system is the first published description of an efficient string sort for GPUs. We are able to sort strings at a rate of 70 MStrings/s on an NVidia GTX 580 on one dataset, and up to 1.25 GB/s on another dataset.
Parallel Merge Sort with Load Balancing

Minsoo Jeon,Dongseung Kim

DOI: https://doi.org/10.1023/a:1021734202931

2003-01-01

International Journal of Parallel Programming

Abstract:Parallel merge sort is useful for sorting a large quantity of data progressively. The merge sort should be parallelized carefully since the conventional algorithm has poor performance due to the successive reduction of the number of participating processors by half, and down to one in the last merging stage. The proposed load-balanced merge sort utilizes all processors throughout the computation. It evenly distributes data to all processors in each stage. Thus every processor is forced to work in all phases. Significant performance enhancement has been achieved up to a speedup of (P−1)/log P where P is the number of processors. Experimental results demonstrate a speedup of 9.6 (upper bound of 10.7) on 32-processor Cray T3E when sorting 4M 32-bit integers, and a speed up of 2.3 (upper bound of 2.8) on an 8-node PC cluster.

computer science, theory & methods
Merge sort enhanced in place sorting algorithm

R. Vignesh,Tribikram Pradhan,R Vignesh

DOI: https://doi.org/10.1109/icaccct.2016.7831730

2016-05-01

Abstract:This paper aims at introducing a new sorting al-gorithm which sorts the elements of an array In Place. This algorithm has O(n) best case Time Complexity and O(nlogn) average and worst case Time Complexity. We achieve our goal using Recursive Partitioning combined with In Place merging to sort a given array. A comparison is made between this particular idea and other popular implementations. We finally draw out a conclusion and observe the cases where this outperforms other sorting algorithms. We also look at its shortcomings and list the scope for future improvements that could be made.
Modular Serial Pipelined Sorting Architecture For Continuous Variable-Length Sequences With A Very Simple Control Strategy

Tingting Chen,Weijun Li,Feng Yu,Qianjian Xing

DOI: https://doi.org/10.1587/transfun.E100.A.1074

2017-01-01

IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences

Abstract:A modular serial pipelined sorting architecture for continuous input sequences is presented. It supports continuous sequences, whose lengths can be dynamically changed, and does so using a very simple control strategy. It consists of identical serial cascaded sorting cells, and lends itself to high frequency implementation with any number of sorting cells, because both data and control signals are pipelined. With L cascaded sorting cells, it produces a fully sorted result for sequences whose length N is equal to or less than L + 1; for longer sequences, the largest L elements are sorted out. Being modularly designed, several independent smaller sorters can be dynamically configured to form a larger sorter.
Enhanced Merge Sort- A New Approach to the Merging Process

Smita Paira,Sourabh Chandra,S.K. Safikul Alam

DOI: https://doi.org/10.1016/j.procs.2016.07.292

2016-01-01

Procedia Computer Science

Abstract:One of the major fundamental issues of Computer Science is arrangement of elements in the database. The efficiency of the sorting algorithms is to optimize the importance of other sorting algorithms11. The optimality of these sorting algorithms is judged while calculating their time and space complexities12. The idea behind this paper is to modify the conventional Merge Sort Algorithm and to present a new method with reduced execution time. The newly proposed algorithm is faster than the conventional Merge Sort algorithm having a time complexity of O(n log2 n). The proposed algorithm has been tested, implemented, compared and the experimental results are promising.
A Generalized GCD Test Based Affine Partitioning Algorithm

Yuan Xinyu,Li Ying,Deng Shuiguang,Cheng Jie

DOI: https://doi.org/10.1109/icise.2010.5690981

2010-01-01

Abstract:The Affine partitioning framework unifies many useful program transforms such as unimodular transformations, loop fusion, fission, scaling, reindexing, and statement reordering. The affine partitioning algorithm put forward by the SUIF compiler team has been proved to be successful in automatic discovery of the loop-level parallelization in programs. Generalized GCD Test is a basic dependence testing algorithm. In this paper, we proved that generalized GCD test has a strong relationship with affine partitioning algorithm. Then we presented an improved affine partitioning algorithm based on generalized GCD test. We illustrated that the compiling speed of affine partitioning algorithm can be significantly improved by our method.
DL-Sort: A Hybrid Approach to Scalable Hardware-Accelerated Fully-Streaming Sorting

Hyun Woo Oh,Joungmin Park,Seung Eun Lee

DOI: https://doi.org/10.1109/tcsii.2024.3377255

2024-01-01

Abstract:Designing high-performance hardware sorter for resource-constrained systems is challenging due to physical limitations and the need to balance streaming bandwidth with memory throughput. This paper introduces a novel, scalable hardware sorter architecture with fully-streaming support and an accompanying RTL generator to provide versatile, energy-efficient hardware acceleration. Our solution employs a dual-layer architecture consisting of a parallel one-way linear insertion sorter (OLIS) for bandwidth optimization and a cyclic bitonic merge network (CBMN) for a compact, high-throughput implementation. Furthermore, we developed the RTL generator written in Chisel to provide the agile implementation of the scalable architecture. Experimental results targeting the Xilinx XVU37P-FSVH2892-2L-E FPGA show that our design achieves throughput increasing by 126.26% and latency decreasing by 68.46%, with an area increment of no more than 132.94% for LUTs and a decrement of flip-flops by 79.84%, compared to state-of-the-art streaming sorter. The source code is available at https://github.com/hyun-woo-oh/DL-Sort-Generator.

engineering, electrical & electronic
A Hybrid Vectorized Merge Sort on ARM NEON

Jincheng Zhou,Jin Zhang,Xiang Zhang,Tiaojie Xiao,Di Ma,Chunye Gong

2024-09-06

Abstract:Sorting algorithms are the most extensively researched topics in computer science and serve for numerous practical applications. Although various sorts have been proposed for efficiency, different architectures offer distinct flavors to the implementation of parallel sorting. In this paper, we propose a hybrid vectorized merge sort on ARM NEON, named NEON Merge Sort for short (NEON-MS). In detail, according to the granted register functions, we first identify the optimal register number to avoid the register-to-memory access, due to the write-back of intermediate outcomes. More importantly, following the generic merge sort framework that primarily uses sorting network for column sort and merging networks for three types of vectorized merge, we further improve their structures for high efficiency in an unified asymmetry way: 1) it makes the optimal sorting networks with few comparators become possible; 2) hybrid implementation of both serial and vectorized merges incurs the pipeline with merge instructions highly interleaved. Experiments on a single FT2000+ core show that NEON-MS is 3.8 and 2.1 times faster than std::sort and boost::block\_sort, respectively, on average. Additionally, as compared to the parallel version of the latter, NEON-MS gains an average speedup of 1.25.

Distributed, Parallel, and Cluster Computing,Data Structures and Algorithms
A new approach to Mergesort algorithm: Divide smart and conquer

Sahin Emrah Amrahov,Yilmaz Ar,Bulent Tugrul,Bekir Emirhan Akay,Nermin Kartli

DOI: https://doi.org/10.1016/j.future.2024.03.049

IF: 7.307

2024-04-06

Future Generation Computer Systems

Abstract:It is well known that comparison-based algorithms cannot run faster than O(nlogn) . Therefore the running times of Mergesort, Heapsort, and Quicksort algorithms are asymptotically optimal. As well as asymptotic running times, how fast sorting algorithms work in practice has gained importance lately. One algorithm is preferred, if it is slightly more efficient than another, due to the rapid increase in data generation. In this study, we consider the Mergesort algorithm with a different approach. Unlike the Mergesort algorithm, we do not perform unconditional division. Instead, we divide the input array into ascending and descending sub-arrays. Then, we merge the sub-arrays obtained as a result of the division by slightly modifying the classical Merge function. As a result of these two operations, we obtain three new sorting algorithms depending on how we get ascending and descending sub-arrays. Among these three algorithms, the third one, which is our main proposed algorithm, is more important both theoretically and practically. In this algorithm, we divide the input array into alternately ascending and descending sub-arrays. Moreover, the terms of the sub-arrays do not have to be consecutive terms of the input array. The asymptotic running time of our proposed algorithm is O(nlogn) in the worst case and O(n) in the best case. In practice, the proposed algorithm performs better than the classical Mergesort algorithm in arrays with Gaussian and Uniform distributions of various sizes. In an array of four million, it provided a 17% improvement in the Gaussian distribution compared to the classical Mergesort algorithm. In addition, it provided a 29% improvement in the Uniform distribution of the same size. The proposed algorithm performs also much better than traditional sorting algorithms in real data collected from various sources.

computer science, theory & methods
Performance Evaluation of Parallel Sortings on the Supercomputer Fugaku

Tomoyuki Tokuue,Tomoaki Ishiyama

DOI: https://doi.org/10.2197/ipsjjip.31.452

2023-05-09

Abstract:Sorting is one of the most basic algorithms, and developing highly parallel sorting programs is becoming increasingly important in high-performance computing because the number of CPU cores per node in modern supercomputers tends to increase. In this study, we have implemented two multi-threaded sorting algorithms based on samplesort and compared their performance on the supercomputer Fugaku. The first algorithm divides an input sequence into multiple blocks, sorts each block, and then selects pivots by sampling from each block at regular intervals. Each block is then partitioned using the pivots, and partitions in different blocks are merged into a single sorted sequence. The second algorithm differs from the first one in only selecting pivots, where the binary search is used to select pivots such that the number of elements in each partition is equal. We compare the performance of the two algorithms with different sequential sorting and multiway merging algorithms. We demonstrate that the second algorithm with BlockQuicksort (a quicksort accelerated by reducing conditional branches) for sequential sorting and the selection tree for merging shows consistently high speed and high parallel efficiency for various input data types and data sizes.

Distributed, Parallel, and Cluster Computing,Performance,Numerical Analysis
An Algorithm For The Construction Of Concentrators From 2x2 Sorters

Shuo-Yen Robert Li,Gar Man Koo,Hui Li

DOI: https://doi.org/10.1090/dimacs/042/13

1998-01-01

Abstract:This paper presents polynomial-time algorithms for the construction of deterministic and internally non-blocking concentrators from multi-stage parallel cascades of 2 x 2 sorters. The approach is a generalization of "Fast Knockout" and "Sortout" techniques. The goal is to construct best known m-to-n networks of 2 x 2 sorters for m-to-n concentration, where m and n are within the practical range. The main criterion on the complexity of concentration is the number of stages in the cascade.
Comparative Analysis between Selection Sort and Merge Sort Algorithms

A.M. Rabiu,E. J. Garba,B.Y. Baha,M. I. Mukhtar

DOI: https://doi.org/10.4314/njbas.v29i1.5

2022-02-08

Nigerian Journal of Basic and Applied Sciences

Abstract:Sorting and merging are two problems that commonly arise in Computer Science especially in data processing tasks. To solve these problems, several algorithms have been developed. Similarly, existing merge and sorting algorithms have been improved to provide more efficient and accurate results. In this paper, selection and merging algorithms were developed on an octa-core processing machine using System.nanoTime methods in Java in order to compare their running times. The results obtained show that Merge Sort performs far better than selection sort with careful implementations by taking advantage of multiple processing cores in the test machine and some concurrency utility in Java. It was concluded that implementing algorithms using a machine with multiple numbers of cores in their Central Processing Unit (CPU) will result in a significant improvement in the performance of both algorithms.

A Compact Multiway Merge Sorter using Linear-Array Comparators

TwinArray Sort: An Ultrarapid Conditional Non-Comparison Based Sorting Algorithm

Optimized Merge Sort on Modern Commodity Multi-core CPUs

Fully Flexible Parallel Merge Sort for Multicore Architectures

COMPARATIVE STUDY OF TWO DIVIDE AND CONQUER SORTING ALGORITHMS: QUICKSORT AND MERGESORT

The Curious Case of Modified Merge Sort

A bargain for mergesorts (functional pearl) -- How to prove your mergesort correct and stable, almost for free

Improved Affine Partition Algorithm for Compile-Time and Runtime Performance.

Efficient parallel merge sort for fixed and variable length keys

Parallel Merge Sort with Load Balancing

Merge sort enhanced in place sorting algorithm

Modular Serial Pipelined Sorting Architecture For Continuous Variable-Length Sequences With A Very Simple Control Strategy

Enhanced Merge Sort- A New Approach to the Merging Process

A Generalized GCD Test Based Affine Partitioning Algorithm

DL-Sort: A Hybrid Approach to Scalable Hardware-Accelerated Fully-Streaming Sorting

A Hybrid Vectorized Merge Sort on ARM NEON

A new approach to Mergesort algorithm: Divide smart and conquer

Performance Evaluation of Parallel Sortings on the Supercomputer Fugaku

An Algorithm For The Construction Of Concentrators From 2x2 Sorters

Comparative Analysis between Selection Sort and Merge Sort Algorithms