Series
Web Audio Conference
Web Audio Conference
Permanent Link
Series Type
Event Series
Description
Associated Organization(s)
Associated Organization(s)
Organizational Unit
Publication Search Results
Now showing
1 - 3 of 3
-
ItemA Novel Approach to Streaming and Client Side Rendering of Multichannel Audio with Synchronised Metadata(Georgia Institute of Technology, 2016-04) Paradis, Matthew ; Pike, Chris ; Day, Richard ; Melchior, FrankObject based audio broadcasting is an approach which combines audio with metadata that describes how the audio should be rendered. This metadata can include spatial positioning mixing parameters and descriptors to define the type of audio represented by the object. In this talk we show an approach to enabling the streaming of multichannel audio and synchronised metadata to the browser. Audio is rendered in the browser to multiple formats based on the information contained in the synchronised metadata channel. This allows adaptive mixing and rendering of content and user interaction. Based on the MPEG/DASH standard this approach allows an arbitrary number of audio channels to be presented as discrete inputs to the Web Audio API (dependent on any channel limit imposed by the browser). Binaural, 5.1 and stereo renders can be generated and selected for output by the user in real time without any change to the source media stream. Channels marked as being interactive can have their properties exposed to the user to adjust based on their preferences. The audio and metadata is originated from a single BWF file compliant with ITU-R BS 2076 (Audio Definition Model) with the audio being encoded using AAC (as per the MPEG/DASH standard) and the metadata represented in JSON format to the browser. This approach provides a flexible framework for the prototyping and presentation of new audio experiences to online audiences and provides a platform for delivery object based audio to online users.
-
ItemA Novel Approach to Streaming and Client Side Rendering of Multichannel Audio with Synchronised Metadata (demonstration)(Georgia Institute of Technology, 2016-04) Paradis, Matthew ; Pike, Chris ; Day, Richard ; Melchior, FrankObject based audio broadcasting is an approach which combines audio with metadata that describes how the audio should be rendered. This metadata can include spatial positioning mixing parameters and descriptors to define the type of audio represented by the object. In this user-led interactive demo we show an approach to enabling the streaming of multichannel audio and synchronised metadata to the browser. Audio is rendered in the browser to multiple formats based on the information contained in the synchronised metadata channel. This allows adaptive mixing and rendering of content and user interaction. Based on the MPEG/DASH standard this approach allows an arbitrary number of audio channels to be presented as discrete inputs to the Web Audio API (dependent on any channel limit imposed by the browser). Binaural, 5.1 and stereo renders can be generated and selected for output by the user in real time without any change to the source media stream. Channels marked as being interactive can have their properties exposed to the user to adjust based on their preferences. The audio and metadata is originated from a single BWF file compliant with ITU-R BS 2076 (Audio Definition Model) with the audio being encoded using AAC (as per the MPEG/DASH standard) and the metadata represented in JSON format to the browser. This approach provides a flexible framework for the prototyping and presentation of new audio experiences to online audiences and provides a platform for delivery object based audio to online users.
-
ItemBrave New World – Experiences in Next Generation Audio Broadcasting(Georgia Institute of Technology, 2016-04) Melchior, FrankThe Internet has had a huge impact on the way we live our lives and the level of impact on the broadcast industry is no different. Our audiences now fully expect access to content on demand. They may browse the web while watching programmes. Smartphones and tablets are more and more often the go-to devices for all online activities. In the last decade broadcasters have made countless changes to accommodate this new environment. The introduction and success of BBC iPlayer is just one example. As the Internet continues to influence all aspects of society, its importance to the future of the BBC is paramount. BBC R&D’s vision for the future of broadcasting, content is produced and broadcast over Internet Protocol (IP). Using IP to create and deliver content, we envisage a world where we can offer media experiences that are very different to those of today. These experiences will enable increasingly immersive experiences that are more: • Personal – know and understand the requirements of individuals and change the experience accordingly. • Adaptive – recognise the device being used and adapt to give the best experience in real time, regardless of the manufacturer. • Dynamic and responsive – respond to the needs of the audience in terms of length, depth of interest, location, preferences, lifestyle and age. • Interactive - the audience can select specific areas of content to focus on and in some instances create and upload their own associated content. BBC R&D has already started to deliver this vision and the standards, capabilities and tools to enable it. Much of this work builds on the characteristics of IP that allow us to treat programmes as a set of “objects” of content. These new representations can adapt to individual audience members’ requirements using the browser as a key media consumption instrument. We refer to this work as object-based broadcasting. This talk will focus on the audio dimension. It will illustrate the vision of object-based audio in broadcasting and highlight the importance of client side audio processing to enable new audience experiences.