Skip to Main content Skip to Navigation
Conference papers

Research on a Smart Input Device Using Multimodal Bio-signal Interface

Abstract : This paper presents a smart input device based on multimodal analysis methods using human bio-signals. The core of the smart input device is software modules, which consist of an intelligent driving function and an analysis processing function for bio-signals. The smart input device utilizes a multimodal interface that analyzes and recognizes human bio-signal patterns. The multimodal analysis system can recognize a user’s emotional and stress status by analyzing an electrocardiogram (ECG), and it can determine the user’s level of concentration from electroencephalogram (EEG) patterns. To analyze the concentration, stress, and emotional status of the user, the EEG rendering system and ECG analysis system use five signal values, i.e., MID_BETA, THETA, ALPHA, DELTA, GAMMA, and the P, Q, R, S and T waves. A reformation of SVM and a clustering algorithm were applied to the user’s EEG and ECG signal patterns for body context recognition. In our experiment, the on/ off status of the user’s stress status controls the difficulties of the game, such as the selecting the type of race course or the number of obstacles. In addition, the speed of the car can be controlled depending on the concentration or non-concentration status of the user. The stress status of the user was predicted with an accuracy of 83.2% by the K-means algorithm, and the concentration status was predicted with an accuracy of 71.85% by the SVM algorithm. We showed that a bio-signal interface is quite useful and feasible for new games.
Document type :
Conference papers
Complete list of metadata

Cited literature [8 references]  Display  Hide  Download
Contributor : Hal Ifip Connect in order to contact the contributor
Submitted on : Friday, June 30, 2017 - 10:35:57 AM
Last modification on : Thursday, March 5, 2020 - 5:40:38 PM
Long-term archiving on: : Monday, January 22, 2018 - 7:21:17 PM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Hyunju Lee, Taehyun Kim, Dongkyoo Shin, Heewon Park, Soohan Kim, et al.. Research on a Smart Input Device Using Multimodal Bio-signal Interface. 9th International Conference on Network and Parallel Computing (NPC), Sep 2012, Gwangju, South Korea. pp.565-574, ⟨10.1007/978-3-642-35606-3_67⟩. ⟨hal-01551346⟩



Record views


Files downloads