Title:
A Novel Approach to Streaming and Client Side Rendering of Multichannel Audio with Synchronised Metadata
A Novel Approach to Streaming and Client Side Rendering of Multichannel Audio with Synchronised Metadata
Author(s)
Paradis, Matthew
Pike, Chris
Day, Richard
Melchior, Frank
Pike, Chris
Day, Richard
Melchior, Frank
Advisor(s)
Editor(s)
Collections
Supplementary to
Permanent Link
Abstract
Object based audio broadcasting is an approach which combines audio with metadata that describes how the audio should be rendered. This metadata can include spatial positioning mixing parameters and descriptors to define the type of audio represented by the object.
In this talk we show an approach to enabling the streaming of multichannel audio and synchronised metadata to the browser. Audio is rendered in the browser to multiple formats based on the information contained in the synchronised metadata channel. This allows adaptive mixing and rendering of content and user interaction.
Based on the MPEG/DASH standard this approach allows an arbitrary number of audio channels to be presented as discrete inputs to the Web Audio API (dependent on any channel limit imposed by the browser). Binaural, 5.1 and stereo renders can be generated and selected for output by the user in real time without any change to the source media stream. Channels marked as being interactive can have their properties exposed to the user to adjust based on their preferences.
The audio and metadata is originated from a single BWF file compliant with ITU-R BS 2076 (Audio Definition Model) with the audio being encoded using AAC (as per the MPEG/DASH standard) and the metadata represented in JSON format to the browser.
This approach provides a flexible framework for the prototyping and presentation of new audio experiences to online audiences and provides a platform for delivery object based audio to online users.
Sponsor
Date Issued
2016-04
Extent
Resource Type
Text
Moving Image
Moving Image
Resource Subtype
Abstract
Proceedings
Presentation
Proceedings
Presentation
Rights Statement
Licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).