Evaluating Commonsense Knowledge with a Computer Game

Abstract : Collecting commonsense knowledge from freely available text can reduce the cost and effort of creating large knowledge bases. For the acquired knowledge to be useful, we must ensure that it is correct, and that it carries information about its relevance and about the context in which it can be considered commonsense. In this paper, we design, and evaluate an online game that classifies, using the input from players, text extracted from the web as either commonsense knowledge, domain-specific knowledge, or nonsense. A continuous scale is defined to classify the knowledge as nonsense or commonsense and it is later used during the evaluation of the data to identify which knowledge is reliable and which one needs further qualification. When comparing our results to other similar knowledge acquisition systems, our game performs better with respect to coverage, redundancy, and reliability of the commonsense acquired.
Type de document :
Communication dans un congrès
Pedro Campos; Nicholas Graham; Joaquim Jorge; Nuno Nunes; Philippe Palanque; Marco Winckler. 13th International Conference on Human-Computer Interaction (INTERACT), Sep 2011, Lisbon, Portugal. Springer, Lecture Notes in Computer Science, LNCS-6946 (Part I), pp.348-355, 2011, Human-Computer Interaction – INTERACT 2011. 〈10.1007/978-3-642-23774-4_28〉
Liste complète des métadonnées

Littérature citée [13 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01590550
Contributeur : Hal Ifip <>
Soumis le : mardi 19 septembre 2017 - 16:59:06
Dernière modification le : mercredi 20 septembre 2017 - 14:50:48

Fichier

978-3-642-23774-4_28_Chapter.p...
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Juan Mancilla-Caceres, Eyal Amir. Evaluating Commonsense Knowledge with a Computer Game. Pedro Campos; Nicholas Graham; Joaquim Jorge; Nuno Nunes; Philippe Palanque; Marco Winckler. 13th International Conference on Human-Computer Interaction (INTERACT), Sep 2011, Lisbon, Portugal. Springer, Lecture Notes in Computer Science, LNCS-6946 (Part I), pp.348-355, 2011, Human-Computer Interaction – INTERACT 2011. 〈10.1007/978-3-642-23774-4_28〉. 〈hal-01590550〉

Partager

Métriques

Consultations de la notice

10