Biden administration bars China from buying HBM chips critical for AI accelerators
- Reference: 1733186709
- News link: https://www.theregister.co.uk/2024/12/03/biden_hbm_china_export_ban/
- Source link:
The trade restrictions, [1]updated [PDF] by the Bureau of Industry and Security (BIS) on Monday, place limits on the sale of high-bandwidth memory (HBM) to countries of concern without a license. In this case, the country in question is the People's Republic of China.
The most sophisticated HBM modules are produced by a handful of vendors – including Korea's Samsung and SK hynix, and US-based Micron. Critically, HBM is an essential component in the high-end GPUs and accelerators used in AI training, inferencing, and scientific computing.
[2]
HBM's role in those workloads is spelled out in its name: it offers substantially higher bandwidth compared to conventional DDR or GDDR memory, albeit at higher cost and power consumption.
[3]
[4]
Memory bandwidth remains one of the biggest bottlenecks for AI and supercomputing performance, so many chip houses have begun prioritizing it over floating point performance in the latest [5]generations of their hardware. Nvidia's H200 and AMD's MI325X are both bandwidth-boosted versions of their predecessors that replace HBM3 with faster HBM3e memory.
The result is particularly noticeable when running the large language models (LLMs) that power popular chatbots like ChatGPT or Baidu's Ernie. The greater the bandwidth, the faster a chatbot can produce out a response – and by extension the more users it can serve.
[6]
Under the new rules, HBM producers will need to obtain special export licenses to sell the parts to Chinese firms. Along with the restrictions on HBM, the Biden administration is adding 140 Chinese firms to the US Entities blacklist.
Note that HBM typically makes use of advanced packaging technologies like TSMC's [7]CoWoS – access to which is already restricted for many prominent Chinese chipmakers and tech giants, including Huawei.
China's semiconductor industry is striving to develop products comparable to those the US has effectively banned. As we've [8]previously reported , Semiconductor Manufacturing International Corporation (SMIC) is already working to ramp production of a 7nm process node which has seen use in some Huawei handsets.
[9]
Meanwhile, Chinese memory vendors are working on their own HBM. Earlier this year, ChangXin Memory Technologies, aka CXMT, reportedly began setting up testing and manufacturing equipment capable of producing the chips in volume. When the first HBM modules will come off CXMT's assembly line – and what kind of performance they can achieve – remains to be seen.
HBM isn't strictly necessary to support AI applications. Many Nvidia and AMD GPUs still use GDDR memory and can achieve adequate memory bandwidth of 800-960GB/sec. That's far slower than modern HBM, but more than serviceable for inferencing on smaller LLMs like Meta's Llama 8B or Alibaba's Qwen 2.5 7B.
If that won't work, SRAM and scale have also proven effective alternatives to HBM, as [10]demonstrated by the likes of Cerebras and Groq. By allocating large quantities of SRAM to each chip and using high speed interconnects or wafer scale packing to connect them, both developers have been able to achieve extremely high speed throughput for AI inference – even compared to rigs that use standalone HBM. Whether or not SMIC possesses the technology or expertise to replicate these products domestically is another matter entirely.
So, while restrictions to HBM exports to China may be a setback, it won't mean China's AI and semiconductor ambitions become unachievable.
[11]Submarine cable resilience board announced on same day maybe-cut-by-China Baltic cable repaired
[12]China launches first next-gen Long March 12 rocket, christens private spaceport
[13]China has utterly pwned 'thousands and thousands' of devices at US telcos
[14]China sends cloud powered by homebrew Loongson CPUs into space
The Biden administration has enacted many technology export restrictions to deprive China of technologies related to semiconductor manufacturing and AI accelerators. These efforts have included limiting the export of high-performance chips, and a ban on the sale of extreme ultraviolet and deep ultraviolet lithography equipment required to produce them.
However, recent developments have cast [15]doubt on the effectiveness of these controls. ®
Get our [16]Tech Resources
[1] https://public-inspection.federalregister.gov/2024-28270.pdf
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/storage&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Z06Qe-8-7pcEO11KTVWSwgAAAIQ&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/storage&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Z06Qe-8-7pcEO11KTVWSwgAAAIQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/storage&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Z06Qe-8-7pcEO11KTVWSwgAAAIQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://www.theregister.com/2024/10/10/amd_mi325x_ai_gpu/
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/storage&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Z06Qe-8-7pcEO11KTVWSwgAAAIQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://www.theregister.com/2024/10/04/tsmc_amkor_arizona/
[8] https://www.theregister.com/2024/04/29/teardown_confirms_huaweis_pura_70/
[9] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/storage&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Z06Qe-8-7pcEO11KTVWSwgAAAIQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[10] https://www.theregister.com/2024/08/27/cerebras_ai_inference/
[11] https://www.theregister.com/2024/12/02/cable_advisory_board/
[12] https://www.theregister.com/2024/12/02/china_long_march_12_launch/
[13] https://www.theregister.com/2024/11/25/salt_typhoon_mark_warner_warning/
[14] https://www.theregister.com/2024/11/24/asia_tech_news_in_brief/
[15] https://www.theregister.com/2024/10/28/tsmc_sophgo_huawei/
[16] https://whitepapers.theregister.com/
Re: Well... if anything...
... This will just encourage China even more to design and build its own stuff and use designs that don't rely on US IP. Of course, it also means that industrial espionage will also increase (it's inevitable).
If the US thinks that this will harm China, they'll be in for a surprise. It'll *delay* China, sure, but harm? No. .... anothercynic
Quite so, anothercynic, there is nothing universally available that will stop or impede the rapid advance and deployment, employment and enjoyment of AWEsome China type operations, but such wild wacky western US imperialist type pronouncements will definitely harm and bankrupt treasured established capitalist federalists and allied supportive entities captured and captive in a toxic special relationship that grows ever weaker and more foul/unstable and more than just likely to both implode and explode in a spectacular self-destructive fashion .... akin to a non-fictional [1]China Syndrome Meltdown /thermal runaway event.
Deny it and join the Army of Destructive Fools with Armouries and Arsenals of Useless Blunt Creative Tools. Uncle Sam and Allies Need You.
Everybody else? Stock up on the popcorn and ice-cream and get ready for the show. AI and IT ensure and assure you it is destined to be an Epic Doozy.
[1] https://en.wikipedia.org/wiki/The_China_Syndrome
Re: Well... if anything...
Yes eventually they will catch up. It is a lot easier to do an HBM chip than an EUV scanner. But it isn't super-easy - Samsung has been consistently behind in HBM and can't seem to manage to keep up. So I think China's memory companies will be behind for a while.
Blocking China from accessing HBM probably wasn't intended as something that would be a roadblock forever. But it will mean all the leading edge HBM is available for western companies like Nvidia. Since it has been in shortage (allocations are typically sold out over a year in advance) it will stop becoming a limiting factor on the shipment of western AI boards.
Well... if anything...
... This will just encourage China even more to design and build its own stuff and use designs that don't rely on US IP. Of course, it also means that industrial espionage will also increase (it's inevitable).
If the US thinks that this will harm China, they'll be in for a surprise. It'll *delay* China, sure, but harm? No.