Real-time smile sonification using surface EMG signal and the evaluation of its usability

Nakayama, Yuki; Takano, Yuji; Matsubara, Masaki; Suzuki, Kenji; Terasawa, Hiroko

Title:

Real-time smile sonification using surface EMG signal and the evaluation of its usability

dc.contributor.author	Nakayama, Yuki
dc.contributor.author	Takano, Yuji
dc.contributor.author	Matsubara, Masaki
dc.contributor.author	Suzuki, Kenji
dc.contributor.author	Terasawa, Hiroko
dc.contributor.corporatename	International Community for Auditory Display
dc.contributor.corporatename	University of Tsukuba. Graduate School of Library, Information and Media Studies
dc.contributor.corporatename	University of Tsukuba. Graduate School of Systems and Information Engineering
dc.contributor.corporatename	JST Presto
dc.date.accessioned	2015-10-23T18:46:02Z
dc.date.available	2015-10-23T18:46:02Z
dc.date.issued	2015-07
dc.description	Presented at the 21st International Conference on Auditory Display (ICAD2015), July 6-10, 2015, Graz, Styria, Austria.	en_US
dc.description	Presented at the 21st International Conference on Auditory Display (ICAD2015), July 6-10, 2015, Graz, Styria, Austria.
dc.description.abstract	We propose a real-time, interactive system for smile recognition and sonification using surface electromyography (EMG) signals. When a user smiles, a sound is played. The surface EMG signal is mapped to pitch using a conventional scale. The timbre of the sound is a synthetic sound mimicking bubbles. In the experiment, eight participants evaluated the effects of smile-based sonification feedback. Participants expressed smiles in a condition that there was feedback or no feedback. We investigated what type of effects the feedback had on smiling by analyzing surface EMG signals and interviewing the subjects. The results suggest that the sonified feedback could facilitate the expression of spontaneous smiles. In addition, results suggested that both the attack and release of a smile were similarly perceived using visual or auditory feedback.	en_US
dc.embargo.terms	null	en_US
dc.identifier.citation	Nakayama, Y., Takano, Y., Matsubara, M., Suzuki, K., & Terasawa, H. "Real-time smile sonification using surface EMG signal and the evaluation of its usability". In K. Vogt, A. Andreopoulou, & V. Goudarzi, eds. Proceedings of the 21st International Conference on Auditory Display (ICAD 2015). July 6-10, 2015, Graz, Styria, Austria.	en_US
dc.identifier.isbn	978-3-902949-01-1
dc.identifier.uri	http://hdl.handle.net/1853/54121
dc.language.iso	en_US	en_US
dc.publisher	Georgia Institute of Technology	en_US
dc.publisher	Georgia Institute of Technology
dc.publisher.original	University of Music and Performing Arts Graz. Institute of Electronic Music and Acoustics
dc.publisher.original	International Community for Auditory Display (ICAD)
dc.relation.ispartofseries	International Conference on Auditory Display (ICAD)
dc.rights	This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License..
dc.rights.uri	http://creativecommons.org/licenses/by-nc/4.0/
dc.subject	Auditory display	en_US
dc.subject	EMG	en_US
dc.subject	Smile recognition	en_US
dc.subject	Sonification	en_US
dc.subject	Surface electromyography signals	en_US
dc.title	Real-time smile sonification using surface EMG signal and the evaluation of its usability	en_US
dc.type	Text
dc.type.genre	Proceedings
dspace.entity.type	Publication
local.contributor.corporatename	Sonification Lab
local.relation.ispartofseries	International Conference on Auditory Display (ICAD)
relation.isOrgUnitOfPublication	2727c3e6-abb7-4df0-877f-9f218987b22a
relation.isSeriesOfPublication	6cb90d00-3311-4767-954d-415c9341a358