Benchmarking the Performance of Storage Systems that expose SPARQL Endpoints

Presented at: 4th International Workshop on Scalable Semantic Web Knowledge Base Systems (SSWS2008)

by Chris Bizer, Andreas Schultz

The SPARQL Query Language for RDF and the SPARQL Protocol for RDF are implemented by a growing number of storage systems and are used within enterprise and open web settings. As SPARQL is taken up by the community there is a growing need for benchmarks to compare the performance of storage systems that expose SPARQL endpoints via the SPARQL protocol. Such systems include native RDF stores, systems that map relational databases into RDF, and SPARQL wrappers around other kinds of data sources. This paper introduces the Berlin SPARQL Benchmark (BSBM) for comparing the performance of these systems across architectures. The benchmark is built around an e-commerce use case in which a set of products is offered by different vendors and consumers have posted reviews about products. The benchmark query mix illustrates the search and navigation pattern of a consumer looking for a product. After giving an overview about the design of the benchmark, the paper presents the results of an experiment comparing the performance of D2R Server, a relational database to RDF wrapper, with the performance of Sesame, Virtuoso, and Jena SDB, three popular RDF stores.

Keywords: RDF, SPARQL, benchmark, relational database to RDF mapping, scalability, semantic web


Resource URI on the dog food server: http://data.semanticweb.org/workshop/ssws/2008/paper/main/4


Explore this resource elsewhere: