Issues with Spatial audio viewing on Meta Quest

Bionn

Hello forum and DeoVR team

For the past couple of days i've been trying to get spatial audio to work on a test video viewed on DeoVR app within the Meta Quest HWD, however, try as I might I cannot get it to work. The outcome is always no head tracking with the spatial audio field, it's static and also has missing audio channels. It seems to me that despite what DeoVR says in the guides, that it supports spatial audio; it in fact doesn't handle the decoding of 2nd Order Ambisonics and certainly doesn't handle headlock stereo, unless the guide is wrong and I need to format the audio in a different way.

I will preface by saying i've thoroughly read and understood the spatial audio workflow guide found here https://deovr.com/blog/21-how-spatial-audio-works-in-deovr.

It is my intention with this test video to include a B-Format 2OA + Headlock Stereo audio stream 9 + 2 channels as per the guide. My understanding from the documentation that this is entirely possible using the Opus encoding contained within the experimental FB360 Matroska format. The guide recommends to use a 2nd Order stream with the optional headlock stereo signal (which i'm opting for) assuming that's on channels 10 & 11 in the stream.

Any tips for what i'm getting wrong or any help to get this working would be very much appreciated :-)

I've included some screenshots of the workflow process to make sure i'm getting everything right along the way...

FB360

2OA Wav

Headlock Stereo

MKV Toolnix

AudioJack

Hey @Bionn , I'm here to help you.

If you want to watch the video locally from your device, you need to add ''_fb360'' at the end of the file name (example_fb360.mkv).
If the video is uploaded to the website and spatial audio is not working, send me a link to the video.
If the first option works, let me know.
Thank you.

Bionn

@AudioJack

Hey. Thanks for getting back to me.

I do only want to have the video play locally at the moment. I'm the sound designer at a new VR/XR video production company and this is just a test video to make sure it's possible before I use DeoVR as a demo platform for our projects using the Quest headworn display.

With that said, your advice to add "_fb360" to the file name and watch from local storage withing DeoVR actually worked. Its definitely decoding the ambisonics and the stereo signal is audible and head-locked as well. Thank you very much for that tip!

I will test our actual short film this way; better that I don't have to upload it for now just for simplicity sake. However, I think it might be applicable to us to have the movie available online on the platform at some point when we're ready, so I'd still like to solve this problem if you can still help.

Here's the unlisted video link: https://deovr.com/vcpuun

Cheers,
Sam

AudioJack

@Bionn
Something wrong with your ambisonic audio.https://ibb.co/qF40wSQK/
It should look something like this https://ibb.co/DgDNTWcw

Bionn

How are you getting the audio into that spatial visualisation exactly? Also If i'm not mistaken It looks like you're monitoring a 3OA signal from the top left corner of the GUI. It should be 2nd order with a headlock stereo signal (11 channels total)

So I know the ambisonics audio export file is good, it works fine playing locally from the quest using DeoVR app. As shared above, the file info for "Ayutthaya 2OA.wav" has the expected 9 channels for 2nd Order (channels 0-8). If it was wrong then it wouldn't work playing locally, it's just streaming from DeoVr that it soungs wrong.

For arguments sake, I double checked by dropping the exported B-Format ambisonics file back into Nuendo and looking at the IEM Energy Visualiser plug-in similar to what you've used and it looks fine to me, expected coverage in the XYZW planes with respect to the spatial panning. I have no way to visualise to the Opus track contained in the mkv.

I'm kinda at a loss

AudioJack

I simply extracted the audio track from your video file using XRECODE and analyzed it with O3A Flare.
Could you send me the file you are viewing locally that sounds good?