News: 0001643084

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

AMD Contributes ONNX Runtime Backend To FFmpeg DNN Filter

([Multimedia] 6 Hours Ago FFmpeg + ONNX Runtime)


An AMD engineer has contributed to the upstream FFmpeg library an ONNX Runtime back-end for its DNN filter. The FFmpeg Deep Neural Network (DNN) filters allow for running AI models natively inside the video processing pipeline for upscaling, object detection, background segmentation, and more. This ONNX Runntime back-end support is notable in that it expands the GPU and NPU capabilities with FFmpeg.

AMD engineer Steven Xiao authored the ONNX Runtime back-end for FFmpeg's DNN processing filter. This addition opens up FFmpeg DNN to supporting inferencing on multiple GPU and NPU platforms. Beyond the CPU execution, there is NVIDIA CUDA support, Windows DirectML execution across all the major GPU vendors, and also AMD Ryzen AI NPU support across platforms using the ONNX Runtime VitisAI execution provider. The main takeaway is AMD beginning to make the Ryzen AI NPU useful for FFmpeg.

Those interested can learn more about this ONNX runtime back-end for the FFmpeg DNN filter via [1]this commit .



[1] https://git.ffmpeg.org/gitweb/ffmpeg.git/commit/a2856b3c3084ea45ca5b94a5daded25f85c41dac


The challenge of space exploration and particularly of landing men on the moon
represents the greatest challenge which has ever faced the human race. Even
if there were no clear scientific or other arguments for proceeding with this
task, the whole history of our civilization would still impel men toward the
goal. In fact, the assembly of the scientific and military with these human
arguments creates such an overwhelming case that in can be ignored only by
those who are blind to the teachings of history, or who wish to suspend the
development of civilization at its moment of greatest opportunity and drama.
-- Sir Bernard Lovell, 1962, in "The History of Manned Space Flight"