1International Hellenic University (International Hellenic University, 14th km Thessaloniki-N. Moudania, 57001 Thermi, Greece - Greece)
Abstract : Natural Language Processing (NLP) has evolved significantly over the last decade. This paper highlights the most important milestones of this period, while trying to pinpoint the contribution of each individual model and algorithm to the overall progress. Furthermore, it focuses on issues still remaining to be solved, emphasizing on the groundbreaking proposals of Transformers, BERT, and all the similar attention-based models.
https://hal.inria.fr/hal-03287671 Contributor : Hal IfipConnect in order to contact the contributor Submitted on : Thursday, July 15, 2021 - 6:10:19 PM Last modification on : Friday, August 13, 2021 - 4:27:58 PM Long-term archiving on: : Saturday, October 16, 2021 - 7:04:41 PM
File
Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed
until : 2024-01-01
Nikolaos-Ioannis Galanis, Panagiotis Vafiadis, Kostas-Gkouram Mirzaev, George A. Papakostas. Machine Learning Meets Natural Language Processing - The Story so Far. 17th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2021, Hersonissos, Crete, Greece. pp.673-686, ⟨10.1007/978-3-030-79150-6_53⟩. ⟨hal-03287671⟩