Open-source developer Tomeu Vizoso who has been working on [1]supporting Vivante NPU IP within the reverse-engineered Etnaviv driver has been much time recently focused on enabling the Vivante NPU found within the NXP i.MX 8M Plus SoC. While not yet upstreamed, he's been successful in this effort and seeing good performance for object detection with this hardware.

Tomeu Vizoso has made immense strides with the [2]Etnaviv NPU driver support this year while thanks to sponsorship from the Ideas on Board consulting firm he's been focused on extending the hardware support to [3]working with the NXP i.MX 8M Plus SoC . Ideas on Board has also been working on mainline camera support for this SoC too, making a powerful combination of open-source support around this SoC for AI object detection type workloads.

Tomeu shared this week that the support for this SoC has reached the "feature complete stage" after dealing with driver changes as a result of this NXP SoC using a newer version of the Vivante NPU IP. As to the performance and plans ahead, he wrote:

"Performance is pretty good already, allowing for detecting objects in video streams at 30 frames per second, so at a similar performance level as the NPU in the Amlogic A311D. Some performance features are left to be implemented, so I think there is still substantial room for improvement.

At current the code is at a very much proof-of-concept state. The next step is cleaning it all up and submitting for review to Mesa3D."

More details for those interested on [4]Tomeu's blog .



[1] https://www.phoronix.com/news/Etnaviv-NPU-2x-Fast

[2] https://www.phoronix.com/news/Etnaviv-NPU-Optimize-Mesa-24.1

[3] https://www.phoronix.com/news/Etnaviv-NPU-NXP-MX8M-Plus

[4] https://blog.tomeuvizoso.net/2024/07/etnaviv-npu-update-20-fast-object.html