Speaking to See: A Feasibility Study of Voice-Assisted Visual Search

Abstract : The paper presents the concept, implementation, and a feasibility study of a user interface technique, named VAVS (“voice-assisted visual search”). VAVS employs user’s voice input for assisting the user in searching for objects of interest in complex displays. User voice input is compared with attributes of visually presented objects and, if there is a match, the matching object is highlighted to help the user visually locate the object. The paper discusses differences between, on the one hand, VAVS and, on the other hand, voice commands and multimodal input techniques. An interactive prototype implementing the VAVS concept and employing a standard voice recognition program is described. The paper reports an empirical study, in which an object location task was carried out with and without VAVS. It was found that the VAVS condition was associated with higher performance and use satisfaction. The paper concludes with a discussion of directions for future work.
Document type :
Conference papers
Complete list of metadatas

Cited literature [7 references]  Display  Hide  Download

https://hal.inria.fr/hal-01590557
Contributor : Hal Ifip <>
Submitted on : Tuesday, September 19, 2017 - 4:59:16 PM
Last modification on : Thursday, July 19, 2018 - 8:58:05 PM

File

978-3-642-23774-4_37_Chapter.p...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Victor Kaptelinin, Herje Wåhlen. Speaking to See: A Feasibility Study of Voice-Assisted Visual Search. 13th International Conference on Human-Computer Interaction (INTERACT), Sep 2011, Lisbon, Portugal. pp.444-451, ⟨10.1007/978-3-642-23774-4_37⟩. ⟨hal-01590557⟩

Share

Metrics

Record views

61

Files downloads

110