Monitoring User's Brain Activity for a Virtual Coach

Abstract : The system described in this paper is an attempt at developing a coach for sports using a virtual world and multimodal interaction, including brain activity. Users can ride a bicycle through a virtual world while the coach monitors the user's performance. The system incorporates the user's brain activity, heart rate and respiration rate. These data are analyzed and the features are sent through to give the virtual coach the instructions for movements and dialogues to coach the user. The Electroencephalogram (EEG) provides ample possibilities to research the brain activity of the user and to provide for an extra modality in the interaction.