Sonification of Brain and Body Signals in Collaborative Tasks Using a Tabletop Musical Interface
Author(s)
Mealla, Sebastian
Bosi, Mathieu
Jorda, Sergi
Valjamae, Aleksander
Advisor(s)
Editor(s)
Collections
Supplementary to:
Permanent Link
Abstract
Physiological Computing has been applied in different disciplines, and is becoming popular and widespread in Human-Computer In- teraction, due to device miniaturization and improvements in real- time processing. However, most of the studies on physiology- based interfaces focus on single-user systems, while their use in Computer-Supported Collaborative Work (CSCW) is still emerg- ing. The present work explores how sonification of human brain and body signals can enhance user experience in collaborative mu- sic composition. For this task, a novel multimodal interactive sys- tem is built using a musical tabletop interface (Reactable) and a hybrid Brain-Computer Interface (BCI). The described system al- lows performers to generate and control sounds using their own or their fellow team member’s physiology. Recently, we assessed this physiology-based collaboration system in a pilot experiment. Dis- cussion on the results and future work on new sonifications will be accompanied by practical demonstration during the conference.
Sponsor
Date
2011-06
Extent
Resource Type
Text
Resource Subtype
Proceedings