Share the easy way to convert GoPro videos to VR180

philpw99

You don't need Mistika or DaVinci Resolve, you just need ffmpeg.
First you need to know the horizontal and vertical FOV. For my GoPro 11 black, the FOV specs are here. Different shooting mode has different H_FOV and V_FOV. I usually shoot with 8:7 wide 60fps mode, so the numbers are 122 and 108.

Now run the ffmpeg with the following parameter:

ffmpeg -i input.mp4 -filter_complex "v360=input=sg:ih_fov=122:iv_fov=108:output=e:h_fov=180:v_fov=180:w=3840:h=3840:alpha_mask=1[out];color=c=black:s=3840x3840:r=59.94[bg];[bg][out]overlay=shortest=1" output.mp4

The command above basically tell a "v360" filter to convert "sg" format, which is the real format of GoPro footages, into EquiRectangular format. The input resolution is 3840x3360, and output is 3840x3840 for left eye or right eye. Of course you can increase it to 7680x7680 to retain more details, but I think majority of VR headsets can only handle 7680x3840 videos, so increasing the resolution beyond 3840x3840 is not practical.

Here's an example:
Original GoPro video image
Converted video image

If you download the converted picture and view it in your player as VR180 format, you will see that all the lines are straight. It's a close-to-perfect conversion, and it doesn't require you to learn a new video editor like DaVinci Resolve.

More over, because I have Nvidia video card, I can accelerate the conversion with the following command:

ffmpeg -hwaccel cuda -i input.mp4 -filter_complex "v360=input=sg:ih_fov=122:iv_fov=108:output=e:h_fov=180:v_fov=180:w=3840:h=3840:alpha_mask=1[out];color=c=black:s=3840x3840:r=59.94[bg];[bg][out]overlay=shortest=1" -c:v hevc_nvenc -cq 16 output.mp4

The conversion speed can be up to 20fps. If you use a batch file, you can easily convert all your footage in just one command.

It took me quite some time to figure this out. I hope by sharing it other people will also find it useful, and no need to do so many trial-and-errors like I did.

terryfi3d

Hi Phil, thanks for sharing your guide. I watched the flat3D videos, how does the output look in vr180?
I do something similar with 180Kino for DJIAction2 but it is not opensource and lacks profiles for gopro.
Cheers.

philpw99

There is a "Converted video image" in the post that you can download and see the result yourself. Since the file is hosted by google, if you are from China, you'll need some extra vpn help to download the picture.

The output in VR players looks like a curve screen that has extrusions on all four corners. It's exactly how gopro videos should have mapped to a hemisphere, but of course if you don't like the four corner extrusion, you can always use a mask in your favorite video editing program to change its shape, and/or blur its edges.

The interesting thing is, though the converted video are using roughly half of the total pixels, in VR players it seems like occupying 80% of the 180 degree fov.

This video https://deovr.com/4gib86 has exactly the same result in the beginning. You can view it as an example.

180Kino2 is a very cool program for DJI Action users. It will combine left and right eye videos into a VRout.mp4.
However, I prefer using a batch file to convert all footage from a shooting, then match the left and right clips in the video editor later. 180Kino doesn't have features like batch processing, clip matching, or codec settings. So the ffmpeg route is my preferred way to do the conversion.