Beyond the capabilities of just the Vulkan Video API, the FFmpeg multimedia library has made interesting Vulkan-accelerated adaptations using compute shaders. With Vulkan compute they've implemented [1]Apple ProRes video acceleration , [2]FFV1 decode , and other features. The newest Vulkan feature now in place for FFmpeg is 360 degree video conversion.

FFmpeg developer Lynne "Cyanreg" implemented a 360 degree video conversion implementation powered by Vulkan compute for more efficient handling than just CPU-based conversion. Currently this new lavfi/v360 capability implements a "sufficient subset" of the most popular 360 degree video formats.

This filter allows applying fisheye, dual fisheye, and other 360 degree projection of video content.

More details on this Vulkan-based 360 degree video conversion support merged today to FFmpeg can be found via [3]this commit .



[1] https://www.phoronix.com/news/Vulkan-Apple-ProRes-Decode

[2] https://www.phoronix.com/news/FFmpeg-Vulkan-FFV1

[3] https://github.com/FFmpeg/FFmpeg/commit/d3d0b7a5ee3502300b26fd8d1e1e3d2fa2f8b0f7