Skip to Main content Skip to Navigation
Journal articles

Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks

Abstract : One of the principal functions of human language is to allow people to coordinate joint action. This includes the description of events, requests for action, and their organization in time. A crucial component of language acquisition is learning the grammatical structures that allow the expression of such complex meaning related to physical events. The current research investigates the learning of grammatical constructions and their temporal organization in the context of human-robot physical interaction with the embodied sensorimotor humanoid platform, the iCub. We demonstrate three noteworthy phenomena. First, a recurrent network model is used in conjunction with this robotic platform to learn the mappings between grammatical forms and predicate-argument representations of meanings related to events, and the robot's execution of these events in time. Second, this learning mechanism functions in the inverse sense, i.e., in a language production mode, where rather than executing commanded actions, the robot will describe the results of human generated actions. Finally, we collect data from naïve subjects who interact with the robot via spoken language, and demonstrate significant learning and generalization results. This allows us to conclude that such a neural language learning system not only helps to characterize and understand some aspects of human language acquisition, but also that it can be useful in adaptive human-robot interaction.
Complete list of metadata

Cited literature [49 references]  Display  Hide  Download

https://hal.inria.fr/hal-02383530
Contributor : Xavier Hinaut <>
Submitted on : Monday, May 18, 2020 - 8:09:11 PM
Last modification on : Friday, December 18, 2020 - 8:36:02 PM

File

fnbot-08-00016.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Xavier Hinaut, Maxime Petit, Gregoire Pointeau, Peter Dominey. Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks. Frontiers in Neurorobotics, Frontiers, 2014, 8, ⟨10.3389/fnbot.2014.00016⟩. ⟨hal-02383530⟩

Share

Metrics

Record views

113

Files downloads

395