Signal and Symbol Representations in Sonification: Structuring Data-to-Display Transformations
Author(s)
Crozzoli, Miguel Angel
Muruaga, Gonzalo
Magnusson, Thor
Advisor(s)
Editor(s)
Collections
Supplementary to:
Permanent Link
Abstract
Multimodal display systems offer great potential for perceiving and understanding the increasing complexity and volume of data in our contemporary world, enabling better accessibility and interaction. However, increasing data complexity generally results in further design challenges. To address these challenges, we present a structuring method based on signals representing data structures, and symbols representing data contextual qualities. While current research mainly focuses on mapping strategies and common idioms across modalities, our method integrates mappings as part of a broader range of data transformation processes. Through this approach, we structure data transformations to facilitate multiple modalities integration, thus evidencing designers’ decisions throughout a cohesive data-to-display workflow. To evaluate our high-order structure, we developed a sonification of ocean data with complementary visualizations and conducted a formative workshop with two design practitioners (n=2) to gather feedback on its application. Initial results suggest that our structure helps organize the design process, supporting practitioners intent.
Sponsor
Date
2025-06
Extent
Resource Type
Text
Resource Subtype
Proceedings
Rights Statement
Creative Commons Attribution Non-Commercial 4.0 International (CC BY-NC 4.0)