Table of Contents
Fetching ...

A Weighted Byzantine Fault Tolerance Consensus Driven Trusted Multiple Large Language Models Network

Haoxiang Luo, Gang Sun, Yinqiu Liu, Dongcheng Zhao, Dusit Niyato, Hongfang Yu, Schahram Dustdar

TL;DR

This work tackles reliability and security challenges in open MultiLLM networks by introducing a blockchain-driven Trusted MultiLLMN that employs Weighted Byzantine Fault Tolerance (WBFT). WBFT assigns adaptive voting weights to LLMs based on response quality and trust, implemented in a two-phase prepare/commit protocol with threshold signatures within a pipelined, multi-chain architecture; it is complemented by Hierarchical Secure Clustering (HSC) to dynamically select core consensus nodes and reduce latency. The authors demonstrate, via simulations and evaluation across multiple LLMs and scenarios, that WBFT improves consensus security and efficiency while yielding higher-quality, more credible responses than single LLMs or non-consensus MultiLLMN baselines. The proposed framework offers a practical path toward robust, decentralized AI collaboration suitable for wireless networks and latency-sensitive applications, reducing reliance on centralized authorities and mitigating Byzantine threats.

Abstract

Large Language Models (LLMs) have achieved remarkable success across a wide range of applications. However, individual LLMs often produce inconsistent, biased, or hallucinated outputs due to limitations in their training corpora and model architectures. Recently, collaborative frameworks such as the Multi-LLM Network (MultiLLMN) have been introduced, enabling multiple LLMs to interact and jointly respond to user queries. Nevertheless, MultiLLMN architectures raise critical concerns regarding the reliability and security of the generated content, particularly in open environments where malicious or compromised LLMs may be present. Moreover, reliance on centralized coordination undermines system efficiency and introduces single points of failure. In this paper, we propose a novel Trusted MultiLLMN framework, driven by a Weighted Byzantine Fault Tolerance (WBFT) blockchain consensus mechanism, to ensure the reliability, security, and efficiency of multi-LLM collaboration. In WBFT, voting weights are adaptively assigned to each LLM based on its response quality and trustworthiness, incentivizing reliable behavior, and reducing the impact of malicious nodes. Extensive simulations demonstrate that WBFT significantly improves both consensus security and efficiency compared to classical and modern consensus mechanisms, particularly under wireless network conditions. Furthermore, our evaluations reveal that Trusted MultiLLMN supported by WBFT can deliver higher-quality and more credible responses than both single LLMs and conventional MultiLLMNs, thereby providing a promising path toward building robust, decentralized AI collaboration networks.

A Weighted Byzantine Fault Tolerance Consensus Driven Trusted Multiple Large Language Models Network

TL;DR

This work tackles reliability and security challenges in open MultiLLM networks by introducing a blockchain-driven Trusted MultiLLMN that employs Weighted Byzantine Fault Tolerance (WBFT). WBFT assigns adaptive voting weights to LLMs based on response quality and trust, implemented in a two-phase prepare/commit protocol with threshold signatures within a pipelined, multi-chain architecture; it is complemented by Hierarchical Secure Clustering (HSC) to dynamically select core consensus nodes and reduce latency. The authors demonstrate, via simulations and evaluation across multiple LLMs and scenarios, that WBFT improves consensus security and efficiency while yielding higher-quality, more credible responses than single LLMs or non-consensus MultiLLMN baselines. The proposed framework offers a practical path toward robust, decentralized AI collaboration suitable for wireless networks and latency-sensitive applications, reducing reliance on centralized authorities and mitigating Byzantine threats.

Abstract

Large Language Models (LLMs) have achieved remarkable success across a wide range of applications. However, individual LLMs often produce inconsistent, biased, or hallucinated outputs due to limitations in their training corpora and model architectures. Recently, collaborative frameworks such as the Multi-LLM Network (MultiLLMN) have been introduced, enabling multiple LLMs to interact and jointly respond to user queries. Nevertheless, MultiLLMN architectures raise critical concerns regarding the reliability and security of the generated content, particularly in open environments where malicious or compromised LLMs may be present. Moreover, reliance on centralized coordination undermines system efficiency and introduces single points of failure. In this paper, we propose a novel Trusted MultiLLMN framework, driven by a Weighted Byzantine Fault Tolerance (WBFT) blockchain consensus mechanism, to ensure the reliability, security, and efficiency of multi-LLM collaboration. In WBFT, voting weights are adaptively assigned to each LLM based on its response quality and trustworthiness, incentivizing reliable behavior, and reducing the impact of malicious nodes. Extensive simulations demonstrate that WBFT significantly improves both consensus security and efficiency compared to classical and modern consensus mechanisms, particularly under wireless network conditions. Furthermore, our evaluations reveal that Trusted MultiLLMN supported by WBFT can deliver higher-quality and more credible responses than both single LLMs and conventional MultiLLMNs, thereby providing a promising path toward building robust, decentralized AI collaboration networks.
Paper Structure (23 sections, 1 theorem, 13 equations, 8 figures, 3 tables)

This paper contains 23 sections, 1 theorem, 13 equations, 8 figures, 3 tables.

Key Result

Theorem 1

For any response $R_L$ submitted by the honest nodes, there exists a finite time ${T_\mathsf{finite}}$ such that $R_L$ will be included in block $b_{i,j}^r$ generated by an honest leader.

Figures (8)

  • Figure 1: The blockchain-driven Trusted MultiLLMN. This network is built on a blockchain P2P network and has a decentralized architecture. The best response for UE is derived from the WBFT consensus. The consensus results are packaged into blocks and linked to the chains maintained by distributed LLMs.
  • Figure 2: The consensus process of Weighted Byzantine Fault Tolerance (WBFT) with the pipeline mechanism. It allows the prepare phase of the $(r+1)$-th round consensus to be initiated during the commit phase of the $r$-th round consensus.
  • Figure 3: The prepare and commit phases of WBFT consensus.
  • Figure 4: Consensus security. (a) The initial trust weights of LLMs follow a $N(0.1,0.6)$ distribution. (b) The initial trust weights of LLMs follow a $N(0.1,0.4)$ distribution. (c) The initial trust weights of LLMs follow a $N(0.1,0.2)$ distribution.
  • Figure 5: Consensus latency. (a) The initial trust weights of LLMs follow a $N(0.1,0.6)$ distribution. (b) The initial trust weights of LLMs follow a $N(0.1,0.4)$ distribution. (c) The initial trust weights of LLMs follow a $N(0.1,0.2)$ distribution.
  • ...and 3 more figures

Theorems & Definitions (1)

  • Theorem 1