Estuary: A Low Cross-Shard Blockchain Sharding Protocol Based on State Splitting

Sharding is one of the most promising technologies for significantly increasing blockchain transaction throughput. However, as the number of shards increases, the ratio of cross-shard transactions in existing blockchain sharding protocols gradually approaches 100%. Since cross-shard transactions consume many times more resources than intra-shard transactions, the processing overhead of cross-shard transactions already accounts for the majority of the total overhead of the sharding system. There is a very large gap between the transaction throughput of the sharding system and its theoretical upper limit. In this article, we propose Estuary, a novel low cross-shard blockchain sharding protocol. Taking the state model as an entry point, Estuary designs a multi-level state model and state splitting and aggregation mechanism. It decouples the identity and quantity of state units, enabling transactions between users to be completed within one shard. Only when the state quantity for all shards of a user is insufficient a small number of cross-shard transactions are required. On this basis, we propose a community overlap propagation algorithm for sharding. It defines the users’ belonging coefficients of each shard and optimizes the state distribution so that the state distribution can better match the transaction characteristics between users. Finally, we develop an analysis framework for the sharding protocol and experiment with real Bitcoin transactions. The evaluation results show that compared to the state-of-the-art sharding protocol, Estuary reduces the ratio of cross-shard transactions by 88.54% and achieves more than 1.85 times the throughput improvement (92.98% of the theoretical upper limit).