3D sound can have a negative impact on the perception of visual content in audiovisual reproductions

Mendonça, Catarina; Rummukainen, Olli; Pulkki, Ville

Title:

3D sound can have a negative impact on the perception of visual content in audiovisual reproductions

dc.contributor.author	Mendonça, Catarina
dc.contributor.author	Rummukainen, Olli
dc.contributor.author	Pulkki, Ville
dc.contributor.corporatename	International Community for Auditory Display
dc.contributor.corporatename	Aalto University. Department Processing and Acoustics
dc.date.accessioned	2015-10-23T17:30:42Z
dc.date.available	2015-10-23T17:30:42Z
dc.date.issued	2015-07
dc.description	Presented at the 21st International Conference on Auditory Display (ICAD2015), July 6-10, 2015, Graz, Styria, Austria.	en_US
dc.description	Presented at the 21st International Conference on Auditory Display (ICAD2015), July 6-10, 2015, Graz, Styria, Austria.
dc.description.abstract	There is reason to believe that sound interacts with visual attention mechanisms. Practical implications of that interaction have never been analyzed in the context of spatial sound design for audiovisual reproduction. The study reported here aimed to test if sound spatialization could affect eye movements and the processing of visual events in audiovisual scenes. We presented participants with audiovisual scenes of a metro station. The sound was either mono, stereo, or 3D. Participants wore eye tracking glasses during the experiment and their task was to count how many people entered the metro. In the divided attention task, participants had to count people entering 3 doors of the metro. In the selective attention task, participants had to count how many people entered the middle door alone. It was found that sound spatialization did not affect the divided attention task. But in the selective attention task participants counted less visual events with 3D sound. In that condition, the number of eye fixations and time spent in the visual area of interest were smaller. It is hypothesized that, in the case of divided attention, the attention is already disengaged and fluctuating, which could explain why sound did not have any additional effect. In the selective attention task, participants must remain concentrated in only one visual area and competing well-spatialized sounds in peripheral areas might have a negative impact. These results should be taken into consideration when designing sound spatialization algorithms and soundtracks.	en_US
dc.embargo.terms	null	en_US
dc.identifier.citation	Mendonça, C., Rummukainen, O., & Pulkki, V. "3d sound can have a negative impact on the perception of visual content in audiovisual reproductions". In K. Vogt, A. Andreopoulou, & V. Goudarzi, eds. Proceedings of the 21st International Conference on Auditory Display (ICAD 2015). July 6-10, 2015, Graz, Styria, Austria.	en_US
dc.identifier.isbn	978-3-902949-01-1
dc.identifier.uri	http://hdl.handle.net/1853/54119
dc.language.iso	en_US	en_US
dc.publisher	Georgia Institute of Technology	en_US
dc.publisher	Georgia Institute of Technology
dc.publisher.original	University of Music and Performing Arts Graz. Institute of Electronic Music and Acoustics
dc.publisher.original	International Community for Auditory Display (ICAD)
dc.relation.ispartofseries	International Conference on Auditory Display (ICAD)
dc.rights	This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License..
dc.rights.uri	http://creativecommons.org/licenses/by-nc/4.0/
dc.subject	Auditory display	en_US
dc.subject	Sound spatialization	en_US
dc.subject	3D	en_US
dc.subject	Visual events	en_US
dc.title	3D sound can have a negative impact on the perception of visual content in audiovisual reproductions	en_US
dc.type	Text
dc.type.genre	Proceedings
dspace.entity.type	Publication
local.contributor.corporatename	Sonification Lab
local.relation.ispartofseries	International Conference on Auditory Display (ICAD)
relation.isOrgUnitOfPublication	2727c3e6-abb7-4df0-877f-9f218987b22a
relation.isSeriesOfPublication	6cb90d00-3311-4767-954d-415c9341a358