QALM: a Benchmark for Question Answering over Linked Merchant Websites Data

Amine Hallili 1 Elena Cabrio 1 Catherine Faron Zucker 1
1 WIMMICS - Web-Instrumented Man-Machine Interactions, Communities and Semantics
CRISAM - Inria Sophia Antipolis - Méditerranée , Laboratoire I3S - SPARKS - Scalable and Pervasive softwARe and Knowledge Systems
Abstract : This paper presents a benchmark for training and evaluating Question Answering Systems aiming at mediating between a user, expressing his or her information needs in natural language, and semantic data in the commercial domain of the mobile phones industry. We first describe the RDF dataset we extracted through the APIs of merchant websites, and the schemas on which it relies. We then present the methodology we applied to create a set of natural language questions expressing possible user needs in the above mentioned domain. Such question set has then been further annotated both with the corresponding SPARQL queries, nd with the correct answers retrieved from the dataset
Document type :
Poster communications
Liste complète des métadonnées

Cited literature [3 references]  Display  Hide  Download

https://hal.inria.fr/hal-01086351
Contributor : Elena Cabrio <>
Submitted on : Monday, November 24, 2014 - 11:57:32 AM
Last modification on : Monday, November 5, 2018 - 3:52:09 PM
Document(s) archivé(s) le : Wednesday, February 25, 2015 - 10:41:23 AM

File

paper_113.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01086351, version 1

Collections

Citation

Amine Hallili, Elena Cabrio, Catherine Faron Zucker. QALM: a Benchmark for Question Answering over Linked Merchant Websites Data. Proceedings of the ISWC 2014 Posters & Demonstrations Track - a track within the 13th International Semantic Web Conference (ISWC 2014), Oct 2014, Riva del Garda, Italy. CEUR. ⟨hal-01086351⟩

Share

Metrics

Record views

366

Files downloads

180