LDSpider: An open-source crawling framework for the Web of Linked Data

Presented at: 9th International Semantic Web Conference (ISWC2010)

by Robert Isele, J├╝rgen Umbrich, Christian Bizer, Andreas Harth

Webpage: http://ceur-ws.org/Vol-658/paper495.pdf
Webpage: http://iswc2010.semanticweb.org/pdf/495.pdf

The Web of Linked Data is growing and currently consists of several hundred interconnected data sources altogether serving over 25 billion RDF triples to the Web. What has hampered the exploitation of this global dataspace up till now is the lack of an open-source Linked Data crawler which can be employed by Linked Data applications to localize (parts of) the dataspace for further processing. With LDSpider, we are closing this gap in the landscape of publicly available Linked Data tools. LDSpider traverses the Web of Linked Data by following RDF links between data items, it supports di?fferent crawling strategies and allows crawled data to be stored either in fi?les or in an RDF store.

Keywords: Crawler, Linked Data, Linked Data tools, Spider


Resource URI on the dog food server: http://data.semanticweb.org/conference/iswc/2010/paper/495


Explore this resource elsewhere: