Intel llm-scaler-vllm PV 1.4 Released With Updated Components, Arc Pro B70 Support
([Intel] 6 Hours Ago
llm-scaler-vllm PV 1.4)
- Reference: 0001634749
- News link: https://www.phoronix.com/news/Intel-LLM-Scaler-vLLM-PV-1.4
- Source link:
Intel software engineers today rolled out the llm-scaler-vllm PV v1.4 as the Docker build of their latest software stack for those wishing to run vLLM in a pre-configured, performant setup on their Arc (Pro) Graphics hardware.
The llm-scaler-vllm PV 1.4 release pulls in their latest platform code as well as a newer Linux 6.17-based kernel build, updated Compute Runtime and oneAPI components, and other leading-edge updates. On the vLLM side the vLLM 0.14 release is being used and there is also PyTorch 2.10.
In addition to the many typical software updates in their Docker container, the 1.4 release adds offline installer support for Ubuntu 24.04 (yes, 24.04 and not the newer 26.04) and also now advertises official support for the already-launched Intel [1]Arc Pro B70 graphics cards.
Downloads and all the details on the new Intel LLM-Scaler-vLLM PV update via [2]GitHub .
[1] https://www.phoronix.com/search/Arc+Pro+B70
[2] https://github.com/intel/llm-scaler/releases/tag/vllm-1.4
The llm-scaler-vllm PV 1.4 release pulls in their latest platform code as well as a newer Linux 6.17-based kernel build, updated Compute Runtime and oneAPI components, and other leading-edge updates. On the vLLM side the vLLM 0.14 release is being used and there is also PyTorch 2.10.
In addition to the many typical software updates in their Docker container, the 1.4 release adds offline installer support for Ubuntu 24.04 (yes, 24.04 and not the newer 26.04) and also now advertises official support for the already-launched Intel [1]Arc Pro B70 graphics cards.
Downloads and all the details on the new Intel LLM-Scaler-vLLM PV update via [2]GitHub .
[1] https://www.phoronix.com/search/Arc+Pro+B70
[2] https://github.com/intel/llm-scaler/releases/tag/vllm-1.4