Intel LLM Scaler vLLM Update Supports More Models
([Intel] 25 November 06:13 AM EST
llm-scaler-vllm beta 0.10.2-b6)
Intel software engineers continue to be hard at work on LLM-Scaler as their solution for running vLLM on Intel GPUs in a Docker containerized environment. A new beta release of LLM-Scaler built around vLLM was released overnight with support for running more large language models.