Title:
The Sonification and Learning of Human Motion
The Sonification and Learning of Human Motion
Author(s)
Smith, Kevin M.
Claveau, David
Claveau, David
Advisor(s)
Editor(s)
Collections
Supplementary to
Permanent Link
Abstract
This paper examines how sonification can be used to help a
student emulate the complex motion of a teacher with
increasing spatial and temporal accuracy. The system captures a
teacher’s motion in real-time and generates a 3-D motion path,
which is recorded along with a reference sound. A student then
attempts to perform the motion and thus recreate the teacher’s
reference sound. The student’s synthesized sound will
dynamically approach the teacher’s sound as the student’s
movement becomes more accurate. Several types of sound
mappings which simultaneously represent time and space
deviations are explored. For the experimental platform, a novel
system that uses low-cost camera-based motion capture
hardware and open source software has been developed. This
work can be applied to diverse areas such as rehabilitation and
physiotherapy, performance arts and aiding the visually
impaired.
Sponsor
Date Issued
2014-06
Extent
Resource Type
Text
Resource Subtype
Proceedings
Rights Statement
This work is licensed under Creative Commons Attribution
– Non Commercial (unported, v3.0) License.