FastFlowLM 1.0 Released Now As Part Of The AMD ROCm Umbrella
([AMD] 6 Hours Ago
FastFlowLM 1.0)
- Reference: 0001651243
- News link: https://www.phoronix.com/news/FastFlowLM-1.0
- Source link:
FastFlowLM is the open-source software for getting vision, audio, embedding, and MoE large language models up and running on AMD Ryzen AI NPUs. FastFlowLM 1.0 released today and is also now part of the AMD ROCm software umbrella.
In helping to unify the AMD software ecosystem around LLMs on Ryzen AI NPUs and Radeon GPUs, [1]FastFlowLM has been pulled into the ROCm organization. FastFlowLM is now developed under "ROCm" on GitHub. This MIT licensed software continues to support all AMD XDNA2 NPUs and later.
In addition to moving under the ROCm umbrella, FastFlowLM 1.0 adds support for the SmolVLA vision-language-action (VLA) model, flm bench benchmarking improvements, and various bug fixes.
It was only earlier this year that [2]AMD Ryzen AI NPUs became useful on Linux for running LLMs with the FastFlowLM 0.9.35 release having added Linux support. Since then with Lemonade integration and the like, Ryzen AI NPUs are becoming practical on Linux.
The FastFlowLM source code as well as pre-built Ubuntu and Debian binaries, a generic Linux x86_64 binary, and Windows binary can be downloaded from [3]GitHub for those wanting to use it for running LLMs on AMD Ryzen AI NPUs.
[1] https://www.phoronix.com/search/FastFlowLM
[2] https://www.phoronix.com/news/AMD-Ryzen-AI-NPUs-Linux-LLMs
[3] https://github.com/ROCm/FastFlowLM/releases/tag/v1.0.0
In helping to unify the AMD software ecosystem around LLMs on Ryzen AI NPUs and Radeon GPUs, [1]FastFlowLM has been pulled into the ROCm organization. FastFlowLM is now developed under "ROCm" on GitHub. This MIT licensed software continues to support all AMD XDNA2 NPUs and later.
In addition to moving under the ROCm umbrella, FastFlowLM 1.0 adds support for the SmolVLA vision-language-action (VLA) model, flm bench benchmarking improvements, and various bug fixes.
It was only earlier this year that [2]AMD Ryzen AI NPUs became useful on Linux for running LLMs with the FastFlowLM 0.9.35 release having added Linux support. Since then with Lemonade integration and the like, Ryzen AI NPUs are becoming practical on Linux.
The FastFlowLM source code as well as pre-built Ubuntu and Debian binaries, a generic Linux x86_64 binary, and Windows binary can be downloaded from [3]GitHub for those wanting to use it for running LLMs on AMD Ryzen AI NPUs.
[1] https://www.phoronix.com/search/FastFlowLM
[2] https://www.phoronix.com/news/AMD-Ryzen-AI-NPUs-Linux-LLMs
[3] https://github.com/ROCm/FastFlowLM/releases/tag/v1.0.0