DBNode: A Decentralized Storage System for Big Data Storage in Consortium Blockchains

TL;DR

This paper proposes a decentralized storage system for Hyperledger Fabric, which is a well-known consortium blockchain, and employs erasure coding to partition files, subsequently organizing these chunks into a hierarchical structure that fosters efficient and dependable data storage.

Abstract

Storing big data directly on a blockchain poses a substantial burden due to the need to maintain a consistent ledger across all nodes. Numerous studies in decentralized storage systems have been conducted to tackle this particular challenge. Most state-of-the-art research concentrates on developing a general storage system that can accommodate diverse blockchain categories. However, it is essential to recognize the unique attributes of a consortium blockchain, such as data privacy and access control. Beyond ensuring high performance, these specific needs are often overlooked by general storage systems. This paper proposes a decentralized storage system for Hyperledger Fabric, which is a well-known consortium blockchain. First, we employ erasure coding to partition files, subsequently organizing these chunks into a hierarchical structure that fosters efficient and dependable data storage. Second, we design a two-layer hash-slots mechanism and a mirror strategy, enabling high data availability. Third, we design an access control mechanism based on a smart contract to regulate file access.

Figures (11)

• Figure 1: Erasure Coding
• Figure 2: DBNode Architecture
• Figure 3: Two-layer hash slots
• Figure 4: The process of mirror strategy
• Figure 5: The maximum and total number of links that are stored in DBNodes