Abstract:In computer science, sorting algorithms are crucial for data processing and machine learning. Large datasets and high efficiency requirements provide challenges for comparison-based algorithms like Quicksort and Merge sort, which achieve O(n log n) time complexity. Non-comparison-based algorithms like Spreadsort and Counting Sort have memory consumption issues and a relatively high computational demand, even if they can attain linear time complexity under certain circumstances. We present TwinArray Sort, a novel conditional non-comparison-based sorting algorithm that effectively uses array indices. When it comes to worst-case time and space complexities, TwinArray Sort achieves O(n+k). The approach remains efficient under all settings and works well with datasets with randomly sorted, reverse-sorted, or nearly sorted distributions. TwinArray Sort can handle duplicates and optimize memory efficiently since thanks to its two auxiliary arrays for value storage and frequency counting, as well as a conditional distinct array verifier. TwinArray Sort constantly performs better than conventional algorithms, according to experimental assessments and particularly when sorting unique arrays under all data distribution scenarios. The approach is suitable for massive data processing and machine learning dataset management due to its creative use of dual auxiliary arrays and a conditional distinct array verification, which improves memory use and duplication handling. TwinArray Sort overcomes conventional sorting algorithmic constraints by combining cutting-edge methods with non-comparison-based sorting advantages. Its reliable performance in a range of data distributions makes it an adaptable and effective answer for contemporary computing requirements.

Towards Parallel Learned Sorting

Parallel Sorting by Approximate Splitting for Multi-core Processors

An $O(N)$ Sorting Algorithm: Machine Learning Sort

Using parallelism techniques to improve sequential and multi-core sorting performance

High-Performance and Flexible Parallel Algorithms for Semisort and Related Problems

Parallel Integer Sort: Theory and Practice

Parallel Multi-Deque Partition Dual-Deque Merge sorting algorithm using OpenMP

Refinement of Parallel Algorithms Down to LLVM: Applied to Practically Efficient Parallel Sorting

Sorting with Predictions

Balanced Learned Sort: a new learned model for fast and balanced item bucketing

Data-centric workloads with MPI_Sort

PCF Learned Sort: a Learning Augmented Sort Algorithm with $O(n \log\log n)$ Expected Complexity

High Performance Parallel Sort for Shared and Distributed Memory MIMD

TwinArray Sort: An Ultrarapid Conditional Non-Comparison Based Sorting Algorithm

Efficient parallel merge sort for fixed and variable length keys

Engineering Faster Sorters for Small Sets of Items

Modular Serial Pipelined Sorting Architecture For Continuous Variable-Length Sequences With A Very Simple Control Strategy

A study of integer sorting on multicores

NN-sort: Neural Network based Data Distribution-aware Sorting

Performance Evaluation of Parallel Sortings on the Supercomputer Fugaku

Parallelization of Modified Merge Sort Algorithm