BBB: A Lightweight Approach to Evaluate Private Blockchains in Clouds

Evaluating Blockchain performance is not an easy task. It is difficult to compare different systems, since the evaluation is often incomprehensible and conducted in different environments with distinct workloads. Only a handful of prior tools were proposed, e.g., BLOCKBENCH and HFBench. Unfortunately, these tools have several limitations. We first identify these limitations. Second, motivated by our observations, we then present a benchmarking tool, Boston Blockchain Benchmarking (BBB). BBB is configurable, extensible, and easy-touse. In particular, BBB can be used to test Blockchain from a networking perspective, a feature that we have not observed in prior tools. Similar to BLOCKBENCH, we focus on the private Blockchain. Concretely, we integrate our tool with Mininet, and provide a simple mechanism to test how network properties (e.g., latency, bandwidth, package loss rate) affect the performance of the chosen Blockchain. We present our preliminary result of evaluating Ethereum. We stress that the architecture of BBB is general, and could be extended to other Blockchain systems. BBB is extremely lightweight and can be used on your laptop to test a small network. Such a feature allows quick evaluation of the Blockchain and speeds up innovation and development.