Abstract:The concept of “all cores are created equal” has been popular for several decades due to its simplicity and effectiveness in CPU (Central Processing Unit) design. The more cores the CPU has, the higher performance the host owns and the higher the power consumption. However, power-saving is also one of the key goals for servers in data centers and embedded devices (e.g., mobile phones). The big.LITTLE multicore architecture, which contains high-performance cores (namely big core) and power-saved cores (namely little core), has been developed by ARM (Advanced RISC Machine) and Intel to trade off performance and power efficiency. Facing the new heterogeneous computing architecture, the traditional lock algorithms, which are designed to run on homogeneous computing architecture, cannot work optimally as usual and drop into the performance issue for the difference between big core and little core. In our preliminary experiment, we observed that, in the big.LITTLE multicore architecture, all these lock algorithms exhibit sub-optimal performance. The FIFO-based (First In First Out) locks experience throughput degradation, while the performance of competition-based locks can be divided into two categories. One of them is big-core-friendly, so their tail latency increases significantly; the other is little-core-friendly. Not only does the tail latency increase, but the throughput is also degraded. Motivated by this observation, we propose a Core-Aware Lock for the big.LITTLE multicore architecture named CAL, which keeps each core having an equal opportunity to access the critical section in the program. The core idea of the CAL is to take the slowdown ratio as the matric to reorder lock requests of these big and little cores. By evaluating benchmarks and a real-world application named LevelDB, CAL is confirmed to achieve fairness goals in heterogeneous computing architecture without sacrificing the performance of the big core. Compared to several traditional lock algorithms, the CAL’s fairness has increased by up to 67%; and Its throughput is 26% higher than FIFO-based locks and 53% higher than competition-based locks, respectively. In addition, the tail latency of CAL is always kept at a low level.

Efficient multi-word lock-free synchronization algorithm based on hardware CAS primitive

A General Lock-Free Algorithm Using Compare-and-swap

Practical Persistent Multi-Word Compare-and-Swap Algorithms for Many-Core CPUs

Lightweight Contention Management for Efficient Compare-and-Swap Operations

Verification of a Lock-Free Implementation of Multiword LL/SC Object.

A study of lock-free based concurrent garbage collectors for multicore platform.

High-efficient queue-based spin locks for Network-on-Chip processors

Practical Lock-Free Implementation of LL/SC Using Only Pointer-size CAS

Plock: A Fast Lock for Architectures with Explicit Inter-core Message Passing.

LL/SC and Atomic Copy: Constant Time, Space Efficient Implementations using only pointer-width CAS

Reducing Scalability Collapse Via Requester-Based Locking on Multicore Systems

Synchronization Coherence: A Transparent Hardware Mechanism For Cache Coherence And Fine-Grained Synchronization

Fence-Free Synchronization with Dynamically Serialized Synchronization Variables

Comparison of Lock Thrashing Avoidance Methods and Its Performance Implications for Lock Design

Instruction-based high-efficient synchronization in a many-core Network-on-Chip processor

Using Hardware Transactional Memory to Correct and Simplify and Readers-Writer Lock Algorithm

A Concurrent Memory Race Recording Algorithm for Snoop-Based Coherence

Opportunities and Pitfalls of Multi-Core Scaling Using Hardware Transaction Memory

Two-Level Synchronization: A Parallel Simulation Mechanism for Many-Core Architecture

Lock Behavior Characterization of Commercial Workloads

CAL: Core-Aware Lock for the Big.little Multicore Architecture