Performance Analysis of Hyperledger Fabric Platforms

Qassim Nasir,Ilham A. Qasse,Manar Abu Talib,Ali Bou Nassif

DOI: https://doi.org/10.1155/2018/3976093

IF: 1.968

2018-09-09

Security and Communication Networks

Abstract:Blockchain is a key technology that has the potential to decentralize the way we store, share, and manage information and data. One of the more recent blockchain platforms that has emerged is Hyperledger Fabric, an open source, permissioned blockchain that was introduced by IBM, first as Hyperledger Fabric v0.6, and then more recently, in 2017, IBM released Hyperledger Fabric v1.0. Although there are many blockchain platforms, there is no clear methodology for evaluating and assessing the different blockchain platforms in terms of their various aspects, such as performance, security, and scalability. In addition, the new version of Hyperledger Fabric was never evaluated against any other blockchain platform. In this paper, we will first conduct a performance analysis of the two versions of Hyperledger Fabric, v0.6 and v1.0. The performance evaluation of the two platforms will be assessed in terms of execution time, latency, and throughput, by varying the workload in each platform up to 10,000 transactions. Second, we will analyze the scalability of the two platforms by varying the number of nodes up to 20 nodes in each platform. Overall, the performance analysis results across all evaluation metrics, scalability, throughput, execution time, and latency, demonstrate that Hyperledger Fabric v1.0 consistently outperforms Hyperledger Fabric v0.6. However, Hyperledger Fabric v1.0 platform performance did not reach the performance level in current traditional database systems under high workload scenarios.

computer science, information systems,telecommunications

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to evaluate and compare the performance, security, and scalability of different versions of the Hyperledger Fabric platform. Specifically, the paper mainly focuses on the performance of two versions of Hyperledger Fabric (v0.6 and v1.0) in terms of execution time, latency, and throughput, and analyzes the scalability of these two versions when the number of nodes is increased to 20. In addition, the paper also points out that although Hyperledger Fabric v1.0 outperforms v0.6 in most tests, its performance still fails to reach the level of current traditional database systems in high - workload scenarios.

### Main contributions of the paper:
1. **Evaluated the new version of Hyperledger Fabric for the first time**: This is the first time that Hyperledger Fabric v1.0 has been compared and evaluated with other blockchain platforms.
2. **Discovered the deficiencies of the two versions**: The paper pointed out the performance deficiencies of Hyperledger Fabric v0.6 and v1.0.
3. **Added new measurement tools**: New measurement tools have been added to the open - source performance evaluation tools.
4. **Studied the impact of system configuration on performance**: Especially in terms of scalability, the impact of the number of transactions and node types on performance has been studied.
5. **Provided a reference for choosing the best blockchain platform**: The results of the paper can help enterprises choose the blockchain platform that is most suitable for their work.

### Evaluation methods:
- **Performance evaluation**: By changing the workload of each platform (up to 10,000 transactions), evaluate execution time, latency, and throughput.
- **Scalability evaluation**: By increasing the number of nodes (up to 20 nodes), evaluate execution time, throughput, and latency.

### Overview of results:
- **Execution time**: Fabric v1.0 generally has better execution time than v0.6 in query functions. In call functions, when the data set is small (10 - 100 transactions), the execution time of v0.6 is slightly better, but as the number of transactions increases, v1.0 performs better.
- **Average latency**: In query functions, the average latency of v0.6 is almost 4 times that of v1.0. In call functions, as the number of transactions increases, the gap in average latency between the two versions gradually increases.
- **Throughput**: In query functions, the throughput of v1.0 is always higher than that of v0.6, and the gap increases as the number of transactions increases. In call functions, when the data set is small, v0.6 has higher throughput, but as the number of transactions increases, the throughput of v1.0 gradually exceeds that of v0.6.
- **Scalability**: As the number of nodes increases, the performance degradation of v1.0 is less than that of v0.6, showing better scalability.

In general, through the detailed performance evaluation of Hyperledger Fabric v0.6 and v1.0, the paper provides an important reference for the application and development of blockchain technology.