Abstract:Sharding is proposed to enhance blockchain scalability. However, a size-security dilemma where every shard must be large enough to ensure its security constrains the efficacy of individual shards and the degree of sharding itself. Most existing sharding solutions therefore rely on either weakening the adversary or making stronger assumptions on network links. This paper presents Arete, an optimally scalable blockchain sharding protocol designed to resolve the dilemma based on an observation that if individual shards can tolerate a higher fraction of (Byzantine) faults, we can securely create smaller shards in a larger quantity. The key idea of Arete, therefore, is to improve the security resilience/threshold of shards by dividing the blockchain's State Machine Replication (SMR) process itself. Similar to modern blockchains, Arete first decouples SMR in three steps: transaction dissemination, ordering, and execution. However, unlike other blockchains, for Arete, a single ordering shard performs the ordering task while multiple processing shards perform the dissemination and execution of blocks. As processing shards do not run consensus, each of those can tolerate up to half compromised nodes. Moreover, the SMR process in the ordering shard is lightweight as it only operates on the block digests. Second, Arete considers safety and liveness against Byzantine failures separately to improve the safety threshold further while tolerating temporary liveness violations in a controlled manner. Apart from the creation of more optimal-size shards, such a deconstructed SMR scheme also empowers us to devise a novel certify-order-execute architecture to fully parallelize transaction handling, thereby improving the performance of sharding systems. We implement Arete and evaluate it on a AWS environment by running up to 500 nodes, showing that Arete outperforms the state-of-the-art sharding protocol.

SPRING: Improving the Throughput of Sharding Blockchain Via Deep Reinforcement Learning Based State Placement

TATA: Throughput-Aware TAsk Placement in Heterogeneous Stream Processing with Deep Reinforcement Learning

ShardingSim: A Modular Committee-Based Sharding Blockchain Simulator

Estuary: A Low Cross-Shard Blockchain Sharding Protocol Based on State Splitting

TBDD: A New Trust-based, DRL-driven Framework for Blockchain Sharding in IoT

DRL-based Adaptive Sharding for Blockchain-based Federated Learning

HyperChain: A Dynamic State Sharding Protocol Supporting Smart Contracts to Achieve Low Cross-Shard and Scalability

An Overlapping Self-Organizing Sharding Scheme Based on DRL for Large-Scale IIoT Blockchain

Efficient State Sharding in Blockchain via Density-based Graph Partitioning

Secure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks

State sharding model on the blockchain

Understanding the Transaction Placement Problem in Blockchain Sharding Protocols

DynaShard: Secure and Adaptive Blockchain Sharding Protocol with Hybrid Consensus and Dynamic Shard Management

Toward reducing cross-shard transaction overhead in sharded blockchains

Deep Reinforcement Learning Based Performance Optimization in Blockchain-Enabled Internet of Vehicle

SP-Chain: Boosting Intra-Shard and Cross-Shard Security and Performance in Blockchain Sharding

Optimal Sharding for Scalable Blockchains with Deconstructed SMR

LMChain: An Efficient Load-Migratable Beacon-Based Sharding Blockchain System

A Sharding Scheme Based on Graph Partitioning Algorithm for Public Blockchain

Transaction Placement in Sharded Blockchains

Performance Optimization for Blockchain-Enabled Industrial Internet of Things (IIoT) Systems: A Deep Reinforcement Learning Approach