(Georgia Institute of Technology, 2016-04)
Lee, Sang Won; Essl, Georg
This demo introduces programmable text rendering that enables temporal typography in web browsers. Textual interaction is seen not only as a dynamic but interactive process facilitating both scripted and live musical expression in various contexts such as audio-visual performance using keyboards and live coding visualization. We transform plain text into a highly audiovisual medium and a musical interface which is visually expressive by transforming textual properties using real-time web audio signal. Technical realization of the concept uses Web Audio API, WebGL and GLSL shaders. We show a number of examples that illustrate instances of the concept in various scenarios ranging from simple textual visualization, live coding environments and interactive writing platform.
(Georgia Institute of Technology, 2016-04)
Lee, Sang Won; de Carvalho, Antonio Deusany Jr.; Essl, Georg
Crowd in C[loud] is an audience participation music piece played on a distributed musical instrument. Inspired by Terry Riley's “In C”, audience members play a short tunes composed by themselves on their smartphones. The collective outcome of the ensemble creates a heterophonic texture of chance, largely in C chord. The instrument mimics an online dating website in which a user browses personal profiles, likes someone, and mingle with other online users. Participants are guided to play music together and to interact with other audience members in this temporary social network. A performer can actively progress the music by orchestrating the crowd by live coding on the console of the web browser.
(Georgia Institute of Technology, 2016-04)
Lee, Sang Won; Martinez, Mari; Essl, Georg; Pain
Live Writing: Shatter utilizes an audiovisual performance developed for a web browser. Here, every keystroke made on a laptop to write a piece of creative writing is captured and precessed to established natural links among typing gestures, text written, and audiovisual responses. The piece is built upon a poem written by Martinez about fragments of memories left by unspoken words. The performance capitalizes on temporal typography built on a web browser using Web Audio API, and Web Graphics Library, offering unique text animation sculpted with live audio to the audience.