Lemonade 11.5 Local AI Server Released With Completed Lemonade Router
([AMD] 5 Hours Ago
Lemonade 11.5)
- Reference: 0001647850
- News link: https://www.phoronix.com/news/AMD-Lemonade-11.5
- Source link:
Just one week after releasing [1]Lemonade 11.0 , the Lemonade 11.5 local AI server was released today for this open-source AMD backed project during their AMD Advancing AI event.
The Lemonade local AI server allows easily deploying LLM workloads across Ryzen AI NPUs, Radeon GPUs, and CPUs with ease under both Windows and Linux. The most significant change with Lemonade 11.5 is the completion of the Lemonade Router that can be used for automatically routing queries to relevant models based on defined policies -- or even LLM-as-a-router for using a small LLM to in turn determine which model to route a particular request.
The Lemonade Router allows steering requests based on rule, classifier, semantic similarity, or LLM-as-router policies. The policies are defined in JSON files or can also be authored via the Lemonade GUI. More details on these router capabilities can be found via [2]this commit .
Lemonade 11.5 also introduces a server-side job engine to let clients post multi-step recipes and managing them via /jobs endpoints. From these endpoints the muilti-step recipes can be paused / interrupted / resumed / deleted. And another one is that the lemond daemon can now act as an MCP client host to connect external stdio MCP servers.
Those wanting to learn more about today's Lemonade 11.5 release can do so at [3]GitHub .
[1] https://www.phoronix.com/news/AMD-Lemonade-11.0
[2] https://github.com/lemonade-sdk/lemonade/pull/2732/changes
[3] https://github.com/lemonade-sdk/lemonade/releases/tag/v11.5.0
The Lemonade local AI server allows easily deploying LLM workloads across Ryzen AI NPUs, Radeon GPUs, and CPUs with ease under both Windows and Linux. The most significant change with Lemonade 11.5 is the completion of the Lemonade Router that can be used for automatically routing queries to relevant models based on defined policies -- or even LLM-as-a-router for using a small LLM to in turn determine which model to route a particular request.
The Lemonade Router allows steering requests based on rule, classifier, semantic similarity, or LLM-as-router policies. The policies are defined in JSON files or can also be authored via the Lemonade GUI. More details on these router capabilities can be found via [2]this commit .
Lemonade 11.5 also introduces a server-side job engine to let clients post multi-step recipes and managing them via /jobs endpoints. From these endpoints the muilti-step recipes can be paused / interrupted / resumed / deleted. And another one is that the lemond daemon can now act as an MCP client host to connect external stdio MCP servers.
Those wanting to learn more about today's Lemonade 11.5 release can do so at [3]GitHub .
[1] https://www.phoronix.com/news/AMD-Lemonade-11.0
[2] https://github.com/lemonade-sdk/lemonade/pull/2732/changes
[3] https://github.com/lemonade-sdk/lemonade/releases/tag/v11.5.0