Comparison of the Best Parameter Settings in the Creation and Comparison of Feature Vectors in Distributional Semantic Models Across Multiple Languages - Archive ouverte HAL Access content directly
Conference Papers Year : 2019

Comparison of the Best Parameter Settings in the Creation and Comparison of Feature Vectors in Distributional Semantic Models Across Multiple Languages

(1) , (1)
1
András Dobó
  • Function : Author
  • PersonId : 1056849
János Csirik
  • Function : Author
  • PersonId : 1056850

Abstract

Measuring the semantic similarity and relatedness of words is important for many natural language processing tasks. Although distributional semantic models designed for this task have many different parameters, such as vector similarity measures, weighting schemes and dimensionality reduction techniques, there is no truly comprehensive study simultaneously evaluating these parameters while also analysing the differences in the findings for multiple languages. We would like to address this gap with our systematic study by searching for the best combination of parameter settings in the creation and comparison of feature vectors in distributional semantic models for English, Spanish and Hungarian separately, and then comparing our findings across these languages.During our extensive analysis we test a large number of possible settings for all parameters, with more than a thousand novel variants in case of some of them. As a result of this we were able to find such combinations of parameter settings that significantly outperform conventional settings combinations and achieve state-of-the-art results.
Fichier principal
Vignette du fichier
483292_1_En_41_Chapter.pdf (243.95 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02331340 , version 1 (24-10-2019)

Licence

Attribution - CC BY 4.0

Identifiers

Cite

András Dobó, János Csirik. Comparison of the Best Parameter Settings in the Creation and Comparison of Feature Vectors in Distributional Semantic Models Across Multiple Languages. 15th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2019, Hersonissos, Greece. pp.487-499, ⟨10.1007/978-3-030-19823-7_41⟩. ⟨hal-02331340⟩
29 View
7 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More