Title:
AUDIO-VISUAL ANALYTICS OF GEOSCIENTIFIC DATA WITH TIMBRAL VARIATIONS AND IMMERSIVE INTERACTIONS
AUDIO-VISUAL ANALYTICS OF GEOSCIENTIFIC DATA WITH TIMBRAL VARIATIONS AND IMMERSIVE INTERACTIONS
Author(s)
Yasmin, Shamima
Jamal, Chowdhury Qaizar
Jamal, Chowdhury Qaizar
Advisor(s)
Editor(s)
Collections
Supplementary to
Permanent Link
Abstract
This research investigated audio-visual analytics of geoscientific
data in virtual reality (VR)-enhanced implementation, where
users interacted with the dataset with a VR controller and a haptic
device. Each interface allowed users to explore rock minerals in
unimodal and multimodal virtual environments (VE). In the unimodal
version, color variations demonstrated differences in minerals.
As users navigated the data using different interfaces, visualization
options could be switched between the original geographical
topology and its color-coded version, signifying underlying
minerals. During the multimodal navigation of the dataset, in addition
to the visual feedback, an auditory display was performed
by playing a musical tone in different timbres. For example, ten
underlying minerals in the sample were explored. Among them,
anorthite was represented by nylon guitar, the grand piano was
used for albite, and so on. Initial findings showed that users preferred
the audio-visual exploration of geoscientific data over the
visual-only version. Virtual touch enhanced the user experience
while interacting with the data.
Sponsor
Date Issued
2024-06
Extent
Resource Type
Text
Resource Subtype
Proceedings
Rights Statement
Creative Commons Attribution Non-Commercial 4.0 International (CC BY-NC 4.0)