Hooking up Web Audio to WebGL Typography

Files
WAC2016-68.pdf (87.65 KB)
Lightning Talks - Day 2.mp4 (75.15 MB)
lightningtalks-day2_videostream.html (985 B)
Transcription.txt (9.79 KB)
Author(s)
Lee, Sang Won
Essl, Georg
Advisor(s)
Editor(s)
Associated Organization(s)
Organizational Unit
Organizational Unit
Series
Series
Collections
Scholarly Events
Supplementary to:
Permanent Link
http://hdl.handle.net/1853/54633
Abstract
This demo introduces programmable text rendering that enables temporal typography in web browsers. Textual interaction is seen not only as a dynamic but interactive process facilitating both scripted and live musical expression in various contexts such as audio-visual performance using keyboards and live coding visualization. We transform plain text into a highly audiovisual medium and a musical interface which is visually expressive by transforming textual properties using real-time web audio signal. Technical realization of the concept uses Web Audio API, WebGL and GLSL shaders. We show a number of examples that illustrate instances of the concept in various scenarios ranging from simple textual visualization, live coding environments and interactive writing platform.
Sponsor
Date
2016-04
Extent
Resource Type
Text
Moving Image
Resource Subtype
Abstract
Proceedings
Presentation
Rights Statement
Licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).
Rights URI
http://creativecommons.org/licenses/by/4.0/