Paris and Stanford at EPE 2017: Downstream Evaluation of Graph-based Dependency Representations

Abstract : We describe the STANFORD-PARIS and PARIS-STANFORD submissions to the 2017 Extrinsic Parser Evaluation (EPE) Shared Task. The purpose of this shared task was to evaluate dependency graphs on three downstream tasks. Through our submissions, we evaluated the usability of several representations derived from English Universal Dependencies (UD), as well as the Stanford Dependencies (SD), Predicate Argument Structure (PAS), and DM representations. We further compared two parsing strategies: Directly parsing to graph-based dependency representations and a two-stage process of first parsing to surface syntax trees and then applying rule-based augmentations to obtain the final graphs. Overall, our systems performed very well and our submissions ranked first and third. In our analysis, we find that the two-stage parsing process leads to better downstream performance, and that enhanced UD, a graph-based representation, consistently outperforms basic UD, a strict surface syntax representation, suggesting an advantage of enriched representations for downstream tasks.
Type de document :
Communication dans un congrès
EPE 2017 - The First Shared Task on Extrinsic Parser Evaluation, Sep 2017, Pisa, Italy. pp.47-59, 2017, Proceedings of the 2017 Shared Task on Extrinsic Parser Evaluation. 〈http://epe.nlpl.eu〉
Liste complète des métadonnées

Littérature citée [41 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01592051
Contributeur : Benoît Sagot <>
Soumis le : dimanche 31 décembre 2017 - 16:52:00
Dernière modification le : vendredi 12 janvier 2018 - 15:34:02
Document(s) archivé(s) le : dimanche 1 avril 2018 - 12:20:23

Fichier

epe17.pdf
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

  • HAL Id : hal-01592051, version 1

Collections

Citation

Sebastian Schuster, Éric Villemonte de La Clergerie, Marie Candito, Benoît Sagot, Christopher Manning, et al.. Paris and Stanford at EPE 2017: Downstream Evaluation of Graph-based Dependency Representations. EPE 2017 - The First Shared Task on Extrinsic Parser Evaluation, Sep 2017, Pisa, Italy. pp.47-59, 2017, Proceedings of the 2017 Shared Task on Extrinsic Parser Evaluation. 〈http://epe.nlpl.eu〉. 〈hal-01592051〉

Partager

Métriques

Consultations de la notice

63

Téléchargements de fichiers

40