Title:
Multi-dimensional synchronization for rhythmic sonification
Multi-dimensional synchronization for rhythmic sonification
dc.contributor.author | Boyd, Jeffrey E. | en_US |
dc.contributor.author | Godbout, Andrew | en_US |
dc.contributor.corporatename | International Community for Auditory Display | |
dc.contributor.corporatename | University of Calgary. Department Of Computer Science | |
dc.date.accessioned | 2012-07-23T15:14:35Z | |
dc.date.available | 2012-07-23T15:14:35Z | |
dc.date.issued | 2012-06 | |
dc.description | Presented at the 18th International Conference on Auditory Display (ICAD2012) on June 18-21, 2012 in Atlanta, Georgia. | en_US |
dc.description | Reprinted by permission of the International Community for Auditory Display, http://www.icad.org. | en_US |
dc.description | Presented at the 18th International Conference on Auditory Display (ICAD2012) on June 18-21, 2012 in Atlanta, Georgia. | |
dc.description | Reprinted by permission of the International Community for Auditory Display, http://www.icad.org. | |
dc.description.abstract | Human locomotion is fundamentally periodic, so when sonifying gait, it is desirable to exploit this periodicity to produce rhythmic sonification synchronized to the motion. To achieve this rhythmic sonification, some mechanism is required to synchronize an oscillator to the period of the motion. This paper presents a method to synchronize to multidimensional signals like those produced by a motion capture system. Using a subset of the joint-angle signals produced by motion capture, the method estimates the phase of a periodic, multidimensional model to match data observed from a moving subject. It does this using an optimization algorithm applied to a suitable objective function. We demonstrate the synchronization with data from a publicly available motion capture database, producing sonifications of drum beats synchronized to footfalls of subjects. The method is robust and shares some common features of phase-locked loops used for synchronizing one-dimensional sinusoidal signals. We foresee applications to sonification for athletics and clinical treatment of gait disorders. | en_US |
dc.identifier.citation | Proceedings of the 18th International Conference on Auditory Display, Atlanta, GA, USA, 18-21 June 2012. Ed. Michael A. Nees, Bruce N. Walker, Jason Freeman. The International Community for Auditory Display, 2012. 68-74. | en_US |
dc.identifier.issn | 2168-5126 | |
dc.identifier.uri | http://hdl.handle.net/1853/44406 | |
dc.language.iso | en_US | en_US |
dc.publisher | Georgia Institute of Technology | en_US |
dc.publisher | Georgia Institute of Technology | |
dc.publisher.original | International Community for Auditory Display (ICAD) | |
dc.relation.ispartofseries | International Conference on Auditory Display (ICAD) | |
dc.relation.ispartofseries | ICAD2012. Papers III: Sound and Movement | en_US |
dc.subject | Auditory display | en_US |
dc.subject | Rhythmic sonification | en_US |
dc.subject | Gait | en_US |
dc.subject | Synchronization | en_US |
dc.subject | Motion capture data | en_US |
dc.title | Multi-dimensional synchronization for rhythmic sonification | en_US |
dc.type | Moving Image | |
dc.type | Text | |
dc.type.genre | Presentation | |
dc.type.genre | Proceedings | |
dspace.entity.type | Publication | |
local.contributor.corporatename | Sonification Lab | |
local.relation.ispartofseries | International Conference on Auditory Display (ICAD) | |
relation.isOrgUnitOfPublication | 2727c3e6-abb7-4df0-877f-9f218987b22a | |
relation.isSeriesOfPublication | 6cb90d00-3311-4767-954d-415c9341a358 |
Files
Original bundle
1 - 5 of 37
No Thumbnail Available
- Name:
- 0203.mp4
- Size:
- 385.79 KB
- Format:
- MP4 Video file
- Description:
- Download Video (Run)
No Thumbnail Available
- Name:
- 0901.mp4
- Size:
- 372.68 KB
- Format:
- MP4 Video file
- Description:
- Download Video (Run)
No Thumbnail Available
- Name:
- 0906.mp4
- Size:
- 434.71 KB
- Format:
- MP4 Video file
- Description:
- Download Video (Run)
No Thumbnail Available
- Name:
- 1608.mp4
- Size:
- 499.87 KB
- Format:
- MP4 Video file
- Description:
- Download Video (Run)
No Thumbnail Available
- Name:
- 1643.mp4
- Size:
- 623.68 KB
- Format:
- MP4 Video file
- Description:
- Download Video (Run)