Dell Pro Max GB10 vs. AMD Ryzen AI Max+ Framework Desktop For Llama.cpp, OpenCL & Vulkan Compute
([Computers] 18 Minutes Ago
Add A Comment)
- Reference: 0001604664
- News link: https://www.phoronix.com/review/dell-pro-max-gb10-llama-cpp
- Source link:
[1]
Over the past number of weeks the [2]Dell Pro Max with GB10 has been undergoing a lot of testing at Phoronix. This NVIDIA GB10 powered mini PC with its 20 Arm cores (10 x Cortex-X925, 10 x Cortex-A725) and Blackwell GPU offers a lot of combined compute potential for AI and other workloads. In this article is a look at how the Dell Pro Max with GB10 competes with AMD's Ryzen AI Max+ 395 "Strix Halo" within the Framework Desktop SFF PC.
[3]
In this part of several NVIDIA GB10 benchmarks I have been working on in recent weeks with the Dell Pro Max is focusing primarily on the Llama.cpp performance as well as some other OpenCL and Vulkan GPU compute benchmarks for reference. Other articles will compare the CPU-side performance and other additional AI benchmarks still being worked on at Phoronix.
[4]
The Dell Pro Max with GB10 is using the NVIDIA GB10 superchip with 128GB of LPDDR5-8533 memory and a 4TB ESL04TBTLCZ-27J4-TYN NVMe SSD. This ships with the NVIDIA DGX OS 7 that is based on Ubuntu 24.04 LTS. Current pricing from Dell as of writing is $4600 USD for the Dell Pro Max with GB10 system.
[5]
The Framework Desktop with AMD Ryzen AI Max+ 395 "Strix Halo" was the competitive comparison point for this article. The Framework Desktop review unit features the Ryzen AI Max+ 395 with Radeon 8050S Graphics and 64GB of LPDDR5-8000 memory and 2TB Western Digital WD_BLACK SN7100 NVMe SSD. The Framework Desktop was loaded with Ubuntu 24.04.3 LTS + Linux 6.14 to provide a similar software stack to NVIDIA DGX OS 7 found on the Dell Pro Max with GB10. As of writing when ordering a similarly configured unit to this review sample on the Framework Computer website, the pricing comes down to $1829 USD.
In addition to looking at the raw performance in Llama.cpp and other workloads, the total system power consumption of each device was also monitored using a WattsUp Pro for generating the performance-per-Watt on each workload. The performance-per-dollar was also generated for current pricing on these competing devices.
[1] https://www.phoronix.com/image-viewer.php?id=dell-pro-max-gb10-llama-cpp&image=dell_pro_max_gb10_1_lrg
[2] https://www.phoronix.com/review/dell-pro-max-gb10-preview
[3] https://www.phoronix.com/image-viewer.php?id=dell-pro-max-gb10-llama-cpp&image=dell_pro_max_gb10_2_lrg
[4] https://www.phoronix.com/image-viewer.php?id=dell-pro-max-gb10-llama-cpp&image=dell_pro_max_gb10_3_lrg
[5] https://www.phoronix.com/image-viewer.php?id=dell-pro-max-gb10-llama-cpp&image=dell_pro_max_gb10_4_lrg
Over the past number of weeks the [2]Dell Pro Max with GB10 has been undergoing a lot of testing at Phoronix. This NVIDIA GB10 powered mini PC with its 20 Arm cores (10 x Cortex-X925, 10 x Cortex-A725) and Blackwell GPU offers a lot of combined compute potential for AI and other workloads. In this article is a look at how the Dell Pro Max with GB10 competes with AMD's Ryzen AI Max+ 395 "Strix Halo" within the Framework Desktop SFF PC.
[3]
In this part of several NVIDIA GB10 benchmarks I have been working on in recent weeks with the Dell Pro Max is focusing primarily on the Llama.cpp performance as well as some other OpenCL and Vulkan GPU compute benchmarks for reference. Other articles will compare the CPU-side performance and other additional AI benchmarks still being worked on at Phoronix.
[4]
The Dell Pro Max with GB10 is using the NVIDIA GB10 superchip with 128GB of LPDDR5-8533 memory and a 4TB ESL04TBTLCZ-27J4-TYN NVMe SSD. This ships with the NVIDIA DGX OS 7 that is based on Ubuntu 24.04 LTS. Current pricing from Dell as of writing is $4600 USD for the Dell Pro Max with GB10 system.
[5]
The Framework Desktop with AMD Ryzen AI Max+ 395 "Strix Halo" was the competitive comparison point for this article. The Framework Desktop review unit features the Ryzen AI Max+ 395 with Radeon 8050S Graphics and 64GB of LPDDR5-8000 memory and 2TB Western Digital WD_BLACK SN7100 NVMe SSD. The Framework Desktop was loaded with Ubuntu 24.04.3 LTS + Linux 6.14 to provide a similar software stack to NVIDIA DGX OS 7 found on the Dell Pro Max with GB10. As of writing when ordering a similarly configured unit to this review sample on the Framework Computer website, the pricing comes down to $1829 USD.
In addition to looking at the raw performance in Llama.cpp and other workloads, the total system power consumption of each device was also monitored using a WattsUp Pro for generating the performance-per-Watt on each workload. The performance-per-dollar was also generated for current pricing on these competing devices.
[1] https://www.phoronix.com/image-viewer.php?id=dell-pro-max-gb10-llama-cpp&image=dell_pro_max_gb10_1_lrg
[2] https://www.phoronix.com/review/dell-pro-max-gb10-preview
[3] https://www.phoronix.com/image-viewer.php?id=dell-pro-max-gb10-llama-cpp&image=dell_pro_max_gb10_2_lrg
[4] https://www.phoronix.com/image-viewer.php?id=dell-pro-max-gb10-llama-cpp&image=dell_pro_max_gb10_3_lrg
[5] https://www.phoronix.com/image-viewer.php?id=dell-pro-max-gb10-llama-cpp&image=dell_pro_max_gb10_4_lrg