Research on a Smart Input Device Using Multimodal Bio-signal Interface

Abstract : This paper presents a smart input device based on multimodal analysis methods using human bio-signals. The core of the smart input device is software modules, which consist of an intelligent driving function and an analysis processing function for bio-signals. The smart input device utilizes a multimodal interface that analyzes and recognizes human bio-signal patterns. The multimodal analysis system can recognize a user’s emotional and stress status by analyzing an electrocardiogram (ECG), and it can determine the user’s level of concentration from electroencephalogram (EEG) patterns. To analyze the concentration, stress, and emotional status of the user, the EEG rendering system and ECG analysis system use five signal values, i.e., MID_BETA, THETA, ALPHA, DELTA, GAMMA, and the P, Q, R, S and T waves. A reformation of SVM and a clustering algorithm were applied to the user’s EEG and ECG signal patterns for body context recognition. In our experiment, the on/ off status of the user’s stress status controls the difficulties of the game, such as the selecting the type of race course or the number of obstacles. In addition, the speed of the car can be controlled depending on the concentration or non-concentration status of the user. The stress status of the user was predicted with an accuracy of 83.2% by the K-means algorithm, and the concentration status was predicted with an accuracy of 71.85% by the SVM algorithm. We showed that a bio-signal interface is quite useful and feasible for new games.
Document type :
Conference papers
Complete list of metadatas

Cited literature [8 references]  Display  Hide  Download

https://hal.inria.fr/hal-01551346
Contributor : Hal Ifip <>
Submitted on : Friday, June 30, 2017 - 10:35:57 AM
Last modification on : Friday, December 1, 2017 - 1:09:58 AM
Long-term archiving on : Monday, January 22, 2018 - 7:21:17 PM

File

978-3-642-35606-3_67_Chapter.p...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Hyunju Lee, Taehyun Kim, Dongkyoo Shin, Heewon Park, Soohan Kim, et al.. Research on a Smart Input Device Using Multimodal Bio-signal Interface. 9th International Conference on Network and Parallel Computing (NPC), Sep 2012, Gwangju, South Korea. pp.565-574, ⟨10.1007/978-3-642-35606-3_67⟩. ⟨hal-01551346⟩

Share

Metrics

Record views

93

Files downloads

104