Table of Contents
Fetching ...

Efficient Cloud-edge Collaborative Approaches to SPARQL Queries over Large RDF graphs

Shidan Ma, Peng Peng, Xu Zhou, M. Tamer Özsu, Lei Zou, Guo Chen

TL;DR

This work tackles SPARQL query processing over very large RDF graphs in cloud environments by introducing an edge–cloud collaboration that places pattern-driven data fragments on edge servers to curb latency. It proposes pattern-induced subgraphs for data localization and uses isomorphism checks against deployed patterns to decide edge executability, while keeping the full RDF graph in the cloud. The core methodology casts the problem of assigning queries to edge servers or the cloud and allocating edge compute resources as a MINLP over variables $\mathbb{D}$ and $\mathbb{F}$ with edge costs $O^{n,k}_e$ and cloud costs $Q^n_c$, solved via a two-subproblem decomposition (QAD and CRA) and a modified branch-and-bound algorithm for global optimality. Additional contributions include a knapsack-based storage-aware pattern selection, a minimal-DFS-code indexing for fast isomorphism-based matching, and a dynamic pattern-update mechanism to adapt to workload shifts. Experimental results on WatDiv and DBpedia demonstrate superior efficiency and scalability compared with baselines, with code available on GitHub.

Abstract

With the increasing use of RDF graphs, storing and querying such data using SPARQL remains a critical problem. Current mainstream solutions rely on cloud-based data management architectures, but often suffer from performance bottlenecks in environments with limited bandwidth or high system load. To address this issue, this paper explores for the first time the integration of edge computing to move graph data storage and processing to edge environments, thereby improving query performance. This approach requires offloading query processing to edge servers, which involves addressing two challenges: data localization and network scheduling. First, the data localization challenge lies in computing the subgraphs maintained on edge servers to quickly identify the servers that can handle specific queries. To address this challenge, we introduce a new concept of pattern-induced subgraphs. Second, the network scheduling challenge involves efficiently assigning queries to edge and cloud servers to optimize overall system performance. We tackle this by constructing a overall system model that jointly captures data distribution, query characteristics, network communication, and computational resources. Accordingly, we further propose a joint formulation of query assignment and computational resource allocation, modeling it as a Mixed Integer Nonlinear Programming (MINLP) problem and solve this problem using a modified branch-and-bound algorithm. Experimental results on real datasets under a real cloud platform demonstrate that our proposed method outperforms the state-of-the-art baseline methods in terms of efficiency. The codes are available on GitHub

Efficient Cloud-edge Collaborative Approaches to SPARQL Queries over Large RDF graphs

TL;DR

This work tackles SPARQL query processing over very large RDF graphs in cloud environments by introducing an edge–cloud collaboration that places pattern-driven data fragments on edge servers to curb latency. It proposes pattern-induced subgraphs for data localization and uses isomorphism checks against deployed patterns to decide edge executability, while keeping the full RDF graph in the cloud. The core methodology casts the problem of assigning queries to edge servers or the cloud and allocating edge compute resources as a MINLP over variables and with edge costs and cloud costs , solved via a two-subproblem decomposition (QAD and CRA) and a modified branch-and-bound algorithm for global optimality. Additional contributions include a knapsack-based storage-aware pattern selection, a minimal-DFS-code indexing for fast isomorphism-based matching, and a dynamic pattern-update mechanism to adapt to workload shifts. Experimental results on WatDiv and DBpedia demonstrate superior efficiency and scalability compared with baselines, with code available on GitHub.

Abstract

With the increasing use of RDF graphs, storing and querying such data using SPARQL remains a critical problem. Current mainstream solutions rely on cloud-based data management architectures, but often suffer from performance bottlenecks in environments with limited bandwidth or high system load. To address this issue, this paper explores for the first time the integration of edge computing to move graph data storage and processing to edge environments, thereby improving query performance. This approach requires offloading query processing to edge servers, which involves addressing two challenges: data localization and network scheduling. First, the data localization challenge lies in computing the subgraphs maintained on edge servers to quickly identify the servers that can handle specific queries. To address this challenge, we introduce a new concept of pattern-induced subgraphs. Second, the network scheduling challenge involves efficiently assigning queries to edge and cloud servers to optimize overall system performance. We tackle this by constructing a overall system model that jointly captures data distribution, query characteristics, network communication, and computational resources. Accordingly, we further propose a joint formulation of query assignment and computational resource allocation, modeling it as a Mixed Integer Nonlinear Programming (MINLP) problem and solve this problem using a modified branch-and-bound algorithm. Experimental results on real datasets under a real cloud platform demonstrate that our proposed method outperforms the state-of-the-art baseline methods in terms of efficiency. The codes are available on GitHub
Paper Structure (1 section)

This paper contains 1 section.

Table of Contents

  1. Introduction