Salsa Sound hits world first at IBC 2022 with true object-based live audio automation with Fraunhofer IIS

Salsa Sound’s Rob Oldfield at IBC 2022

Three amazing demos were ready to wow on the Salsa Sound stand at IBC this year, including a world-first automated live MPEG-H production showcasing true object-based audio.

In partnership with The Fraunhofer Institute for Integrated Circuits (Fraunhofer IIS), Salsa Sound implemented the MPEG-H authoring tool with MixAir, its artificial intelligence (AI) driven automatic audio mixing solution for live sports, to allow automated MPEG-H production.

Rob Oldfield, co-founder, said from the show floor: “You can interact with the audio to create audio personalisation and it’s all done automatically in MixAir. We’ve been talking about personalisation for years and it’s amazing to actually be able to show this for the first time.”

Salsa Sound also showcased 360 immersive football in partnership with BT Research and Innovation and BT Sport, based on part of the 5G Edge-XR project.

Said Oldfield: “We’re doing adaptive immersive audio so the audio matches the video so you can experience sound in different parts of the stadium; as you move, the audio follows. This is important because without the audio matching the visual perspective it’s just not as compelling. If the visuals are interactive the audio needs to adapt accordingly so the viewer buys into it. This is volumetric audio.”

Finally, MixAir was also demonstrated with an as-live sport production showing AI auto mixing stems and multiple output formats.