Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Efficient Parallel Multi-Hop Reasoning: A Scalable Approach for Knowledge Graph Analysis

Jesmin Jahan Tithi, Fabio Checconi, Fabrizio Petrini

TL;DR

A novel parallel algorithm is introduced that harnesses domain-specific learned embeddings to efficiently identify the top K paths between vertices in a knowledge graph to find the best answers to a three-hop query.

Abstract

Multi-hop reasoning (MHR) is a process in artificial intelligence and natural language processing where a system needs to make multiple inferential steps to arrive at a conclusion or answer. In the context of knowledge graphs or databases, it involves traversing multiple linked entities and relationships to understand complex queries or perform tasks requiring a deeper understanding. Multi-hop reasoning is a critical function in various applications, including question answering, knowledge base completion, and link prediction. It has garnered significant interest in artificial intelligence, machine learning, and graph analytics. This paper focuses on optimizing MHR for time efficiency on large-scale graphs, diverging from the traditional emphasis on accuracy which is an orthogonal goal. We introduce a novel parallel algorithm that harnesses domain-specific learned embeddings to efficiently identify the top K paths between vertices in a knowledge graph to find the best answers to a three-hop query. Our contributions are: (1) We present a new parallel algorithm to enhance MHR performance, scalability and efficiency. (2) We demonstrate the algorithm's superior performance on leading-edge Intel and AMD architectures through empirical results. We showcase the algorithm's practicality through a case study on identifying academic affiliations of potential Turing Award laureates in Deep Learning, highlighting its capability to handle intricate entity relationships. This demonstrates the potential of our approach to enabling high-performance MHR, useful to navigate the growing complexity of modern knowledge graphs.

Efficient Parallel Multi-Hop Reasoning: A Scalable Approach for Knowledge Graph Analysis

TL;DR

A novel parallel algorithm is introduced that harnesses domain-specific learned embeddings to efficiently identify the top K paths between vertices in a knowledge graph to find the best answers to a three-hop query.

Abstract

Multi-hop reasoning (MHR) is a process in artificial intelligence and natural language processing where a system needs to make multiple inferential steps to arrive at a conclusion or answer. In the context of knowledge graphs or databases, it involves traversing multiple linked entities and relationships to understand complex queries or perform tasks requiring a deeper understanding. Multi-hop reasoning is a critical function in various applications, including question answering, knowledge base completion, and link prediction. It has garnered significant interest in artificial intelligence, machine learning, and graph analytics. This paper focuses on optimizing MHR for time efficiency on large-scale graphs, diverging from the traditional emphasis on accuracy which is an orthogonal goal. We introduce a novel parallel algorithm that harnesses domain-specific learned embeddings to efficiently identify the top K paths between vertices in a knowledge graph to find the best answers to a three-hop query. Our contributions are: (1) We present a new parallel algorithm to enhance MHR performance, scalability and efficiency. (2) We demonstrate the algorithm's superior performance on leading-edge Intel and AMD architectures through empirical results. We showcase the algorithm's practicality through a case study on identifying academic affiliations of potential Turing Award laureates in Deep Learning, highlighting its capability to handle intricate entity relationships. This demonstrates the potential of our approach to enabling high-performance MHR, useful to navigate the growing complexity of modern knowledge graphs.
Paper Structure (13 sections, 5 figures, 2 tables, 2 algorithms)

This paper contains 13 sections, 5 figures, 2 tables, 2 algorithms.

Table of Contents

  1. Introduction
  2. Related Work
  3. Proposed Algorithm
  4. The Problem and Its Mapping to MHR
  5. Simple Algorithm
  6. Algorithmic Optimizations
  7. Performance Result
  8. Dataset
  9. Systems Specifications
  10. Performance Trends
  11. Generalization of the MHR Algorithm
  12. Conclusions
  13. Acknowledgement

Figures (5)

  • Figure 1: An example snippet of Knowledge Graph (KG) and the composition of a multi-hop reasoning query on the KG.
  • Figure 2: Performance Benefit of the old algorithm compared on SPR Platform.
  • Figure 3: Strong Scaling of Runtime of the MHR Algorithm on SPR Platform.
  • Figure 4: Strong Scaling of Runtime of the MHR Algorithm on EPYC Platform.
  • Figure 5: Performance difference between SPR and EPYC.