After a weeks-long struggle to get its AMD RX 7900XTX-based TinyBox working on open source firmware, Tiny Corp says it will be launching an Nvidia RTX 4090 version for users who want something that "just works."

The AI startup founded by security hacker George Hotz originally selected AMD's flagship gaming GPU for its TinyBox, a computer equipped with six graphics cards to tackle AI workloads. Initially, [1]Tiny Corp was happy to use AMD GPUs as it felt customers were "overpaying for petaflops" with Nvidia hardware, and criticized the CUDA software stack for being closed source.

Earlier in the month, however, the Tiny Corp X account (likely piloted by Hotz) began complaining about driver and firmware issues that caused crashes and hangups, threatening to undermine the Radeon GPU-powered computer. Several times Tiny Corp publicly asked AMD to make the Micro Engine Scheduler (MES) firmware open source so that it could fix the bugs in question rather than waiting for AMD's in-house patch. This put the launch of the TinyBox on hold.

[2]

Meanwhile, Tiny Corp suggested it might use Intel's Arc Alchemist GPUs instead since Intel also has a large open source presence, though its graphics cards don't reach into the top end. Even a GeForce RTX 4090-powered TinyBox was being considered reluctantly since "at least we know the software is good there."

[3]

[4]

Eventually, Hotz says he was able to chat with AMD about the issues, and although he was "70 percent confident" AMD would make the MES open source, he confirmed on March 23 that CEO Lisa Su herself had turned Hotz down. Since making the firmware open source to debug it was a key priority of Tiny Corp, it seemed to signal the end of the AMD model of the TinyBox.

[5]How to run an LLM on your PC, not in the cloud, in less than 10 minutes

[6]Desktop GPU shipments jumped by a third – no thanks to AI PCs

[7]BEAST AI needs just a minute of GPU time to make an LLM fly off the rails

[8]Nvidia talks up local AI with RTX 500, 1000 Ada mobile GPUs

However, earlier today [9]the startup announced it would be going through with the RX 7900XTX TinyBox after all thanks to a "umr" repository it found. "If you like to tinker and feel pain, buy red. The driver still crashes the GPU and hangs sometimes, but we can work together to improve it," says Tiny Corp. The AMD TinyBox will sell for $15,000 and will arrive in June.

Additionally, Tiny Corp says "expect an announcement from AMD, it's not everything we asked for, but it's a start." This may mean AMD has partially addressed Tiny Corp's stability issues with the RX 7900XTX, though it's not clear whether this solution is at least in part open source.

As for the RTX 4090 TinyBox, it's still coming as well despite the company being conspicuously unenthusiastic about it. "If you want 'it just works' buy green," said Tiny Corp on X. "You pay the tax, but it's rock solid. Not too much more to say about it." The Nvidia TinyBox will demand a much higher price at $25,000 and also launches in June.

[10]

Tiny Corp may also ship an Arc A770 TinyBox in the future, though it says there's only a prototype and that there are no plans to launch it at the moment. A tentative price of $10,000 was suggested in an X poll by Tiny Corp earlier this month. ®

Get our [11]Tech Resources



[1] https://twitter.com/__tinygrad__

[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZgICB5yLxse7bUXo0PYUzQAAAI8&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZgICB5yLxse7bUXo0PYUzQAAAI8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZgICB5yLxse7bUXo0PYUzQAAAI8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[5] https://www.theregister.com/2024/03/17/ai_pc_local_llm/

[6] https://www.theregister.com/2024/03/06/desktop_gpu_shipments/

[7] https://www.theregister.com/2024/02/28/beast_llm_adversarial_prompt_injection_attack/

[8] https://www.theregister.com/2024/02/26/nvidia_ai_pc_gpus/

[9] https://twitter.com/__tinygrad__/status/1772139983731831051

[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZgICB5yLxse7bUXo0PYUzQAAAI8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[11] https://whitepapers.theregister.com/