Benchmarking Matching Applications on the Semantic Web

Presented at: 8th Extended Semantic Web Conference (ESWC2011)

by Alfio Ferrara, Stefano Montanelli, Jan Noessner, Heiner Stuckenschmidt

The evaluation of matching applications is becoming a major issue in the semantic web and it requires a suitable methodological approach as well as appropriate benchmarks. In particular, in order to evaluate a matching application under different experimental conditions, it is crucial to provide a test dataset characterized by a controlled variety of different heterogeneities among data that rarely occurs in real data repositories. In this paper, we propose SWING (Semantic Web INstance Generation), a disciplined approach to the semi-automatic generation of benchmarks to be used for the evaluation of matching applications. SWING is illustrated in the paper by presenting the specific benchmark we generated for the international instance matching contest at OAEI 2010 (called IIMB 2010) and by discussing the experimental results obtained on it with different matching algorithms.

Keywords: Evaluation, Semantic Matching, Semantic Web

Resource URI on the dog food server:

Explore this resource elsewhere: