Raspberry Pi AI HAT+ 2 Released & Designed For Running GenAI Models
([Raspberry Pi] 13 Hours Ago
Raspberry Pi AI HAT+ 2)
- Reference: 0001606292
- News link: https://www.phoronix.com/news/Raspberry-Pi-AI-HAT-2
- Source link:
In late 2024 the folks at Raspberry Pi announced the [1]Raspberry Pi AI HAT+ as an AI accelerator capable of 26 TOPS and costing $110 for pairing with Raspberry Pi single board computers. Today they announced the much more capable Raspberry Pi AI HAT+ 2 that can begin to take on some generative AI "GenAI" models.
The Raspberry Pi AI HAT+ 2 employs the Hailo-10H neural network accelerator that is now rated for 40 TOPS of INT4. There is also now 8GB of dedicated onboard RAM for being able to handle larger (GenAI) models that couldn't run with the original AI HAT+.
The Raspberry Pi AI HAT+ 2 can handle LLama 3.2 1B, DeepSeek R1-Distill 1.5B, Qwen2 1.5B, and various other LLMs in the 1.5B range.
The Raspberry Pi AI HAT+ 2 is available to order beginning today for $130 USD. More details for those interested at [2]RaspberryPi.com .
[1] https://www.phoronix.com/news/Raspberry-Pi-AI-HAT-Plus
[2] https://www.raspberrypi.com/news/introducing-the-raspberry-pi-ai-hat-plus-2-generative-ai-on-raspberry-pi-5/
The Raspberry Pi AI HAT+ 2 employs the Hailo-10H neural network accelerator that is now rated for 40 TOPS of INT4. There is also now 8GB of dedicated onboard RAM for being able to handle larger (GenAI) models that couldn't run with the original AI HAT+.
The Raspberry Pi AI HAT+ 2 can handle LLama 3.2 1B, DeepSeek R1-Distill 1.5B, Qwen2 1.5B, and various other LLMs in the 1.5B range.
The Raspberry Pi AI HAT+ 2 is available to order beginning today for $130 USD. More details for those interested at [2]RaspberryPi.com .
[1] https://www.phoronix.com/news/Raspberry-Pi-AI-HAT-Plus
[2] https://www.raspberrypi.com/news/introducing-the-raspberry-pi-ai-hat-plus-2-generative-ai-on-raspberry-pi-5/