Extended Abstract: Using Vocal-Based Sounds to Represent Sentiment in Complex Event Processing

Author(s)
Rimland, Jeff
Ballora, Mark
Advisor(s)
Editor(s)
Associated Organization(s)
Organizational Unit
Collections
Supplementary to:
Abstract
There is an intricate and evolving relationship between sonification and Complex Event Processing (CEP) for improved situational awareness. In a paper presented at ICAD 2013 [1], we introduced a series of techniques using CEP for simultaneous sonification of both quantitative “hard” data and human-derived “soft” data in the context of assistive technology. The connection of CEP and sonification was explored further in the context of a severe weather tracker that relies on fusion of quantitative (sensor-based) weather data along with human observations about storms and related conditions [2]. An area of shortcoming in both of these earlier works was the difficulty in creating sounds that represented human sentiment about observed conditions (e.g. unanticipated obstacles for a blind person crossing a busy street, or impending dangerous weather conditions) in a format that enabled intuitive listening for improved situational awareness. This extended abstract provides an update on that continuing research by representing human sentiment data, via the use of vocal synthesis that is driven by Complex Event Processing.
Sponsor
Date
2014-06
Extent
Resource Type
Text
Resource Subtype
Proceedings
Rights Statement
This work is licensed under Creative Commons Attribution – Non Commercial (unported, v3.0) License.
Rights URI