To encourage techies and engineers to try out its AI acceleration hardware, Intel has put together a bunch of software reference kits it claims will reduce the time and resources required to deploy machine learning systems on its silicon.

As you'd expect, the [1]34 open source reference kits address a variety of common AI/ML workloads – ranging from large language models used to power chatbots and other generative AI, to more mundane tasks like object detection, voice generation, and financial risk prediction.

Intel says each kit, developed in collaboration with Accenture, contains all the necessary model code, training data, libraries, openAPI components, and instructions necessary to implement them on Intel hardware. We're told the reference kits will be updated periodically based on community feedback.

[2]

To be clear, these kits appear to be purely software: you provide the (Intel inside) hardware, and then use the given kits to build applications on them.

[3]

[4]

Intel has quite a few accelerators and GPUs capable of running these sorts of AI apps – including its Habana Gaudi2 training processors, Ponte Vecchio GPUs, and the Advanced Matrix Extensions baked into Intel's Sapphire Rapids Xeon Scalable processors.

Despite all the hype surrounding generative AI, though, Intel's accelerators haven't enjoyed the public attention and widespread adoption that Nvidia's GPUs have. But, due to the large clusters of GPU nodes required to train the largest and most impressive models – the major cloud providers are deploying tens of thousands of GPUs and accelerators for this very reason – Intel may end up scoring wins simply because customers can't get their hands on Nvidia's cards in adequate volumes or reasonable prices.

[5]Meta can call Llama 2 open source as much as it likes, but that doesn't mean it is

[6]Nvidia outlines subscription-fueled journey to $1tr revenue

[7]AMD's latest Epycs are bristling with cores, stacked to the gills with cache

[8]Intel woos China with nerfed Habana Gaudi2 AI chips

As reported by our sibling site The Next Platform , Nvidia's H100 PCIe cards – not even the most powerful version of the GPU – have been [9]spotted selling for as much as $40,000 a pop on eBay.

So if Intel can lower the barrier to deploying AI workloads on its accelerators, it stands to reason the x86 titan should have an easier time convincing customers to buy its parts – particularly the more expensive ones.

[10]

Of course, Intel isn't alone in this strategy. Nvidia has already found great success in developing and commercializing software accelerated by its GPUs. Last year CFO Colette Kress highlighted the importance of such subscription software to driving the acceleration champ's revenues to a lofty [11]$1 trillion .

AMD has also got more aggressive about pushing its own GPUs and accelerators for AI. In June it [12]detailed its Instinct MI300 APUs and GPUs, which are designed to compete head on with Nvidia in both the HPC and AI/ML arenas. Alongside the new silicon, the chipmaker also [13]announced a strategic partnership with Hugging Face, which develops tools for building ML apps, to optimize popular AI models for AMD's Instinct GPUs, Alveo FPGAs, and Epyc and Ryzen CPUs. ®

Get our [14]Tech Resources



[1] https://www.intel.com/content/www/us/en/newsroom/news/intel-accelerates-ai-development-reference-kits.html

[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZL-xpa6409qwZ1iR@LWNgQAAAZU&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZL-xpa6409qwZ1iR@LWNgQAAAZU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZL-xpa6409qwZ1iR@LWNgQAAAZU&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[5] https://www.theregister.com/2023/07/21/llama_is_not_open_source/

[6] https://www.theregister.com/2022/03/25/nvidia_trillion_dollar_revenue/

[7] https://www.theregister.com/2023/06/13/amd_epyc_announcement/

[8] https://www.theregister.com/2023/07/13/intel_guadi_china/

[9] https://www.nextplatform.com/2023/05/08/ai-hype-will-drive-datacenter-gpu-prices-sky-high/

[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZL-xpa6409qwZ1iR@LWNgQAAAZU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[11] https://www.theregister.com/2022/03/25/nvidia_trillion_dollar_revenue/

[12] https://www.theregister.com/2023/06/13/amd_epyc_announcement/

[13] https://huggingface.co/blog/huggingface-and-amd

[14] https://whitepapers.theregister.com/