Taking notes from AWS, Google prepares custom Arm server chips of its own
(2023/02/14)
- Reference: 1676381412
- News link: https://www.theregister.co.uk/2023/02/14/google_prepares_its_own_custom/
- Source link:
Google is understood to be developing its own custom Arm server processors, following in the footsteps of cloud rival AWS.
The search giant [1]already supports virtual machines powered by Ampere Computing's Arm-based Altra processors, but in the wake of Amazon's in-house designed Graviton silicon, Google is said to be working on a pair of its own Arm-based server CPUs.
According to [2]The Information , Google is preparing one processor codenamed Maple which is based on an existing design from Marvell Technology, and a second codenamed Cypress that is said to be a custom design being developed by a team based in Israel.
[3]
Both are said to be designed for 5nm production processes, and as Marvell is a fabless semiconductor company that uses Taiwan-based TSMC to produce its chips, it is possible that this is what Google also has planned.
[4]
[5]
Mountain View's Google Cloud is aiming for performance from its new Arm server chips that will be comparable with that of server processors from Intel and AMD, according to the report.
But how do you measure this?
It isn't clear whether this means each individual core will be a match for an x86 core, which might be a tall order, or that the entire chip could best the performance of an Intel or AMD part by cramming in more cores.
This was the approach taken by [6]Ampere , which fits 128 cores onto its Altra Max processor, each one focused on maximum single-thread performance to meet the requirements of cloud-native workloads.
However they shape up, producing its own tailor-made chips could be a more cost-effective strategy for Google in the long run than buying in x86 chips, which can cost thousands of dollars apiece, especially at the kind of scale cloud companies operate.
[7]
According to the report, Google is looking to have its custom server chips in production sometime in the second half of 2024, with actual deployment in its datacenters by 2025.
[8]Uber strikes deals with Google and Oracle to cut datacenter dependence
[9]5% of the cloud now runs on Arm as chip designer plans 2023 IPO
[10]Arm still strong despite SoftBank loss as shipments pass a quarter of a trillion
[11]Fortinet's latest ASIC promises 2.5Gbps of SSL inspection at the edge
Meanwhile, AWS has just introduced [12]more instances powered by its own Graviton3 Arm-based processors. The M7g instances are aimed at general-purpose workloads, while the R7g are memory-optimized, making them a better fit for workloads such as databases, in-memory caches, and data analytics.
These 7th generation instances were designed to deliver up to 25 percent greater performance than the equivalent 6th gen instances making them "the best performers" in its EC2 service, AWS claimed.
The M7g instances can be specified with up to 64 vCPUs and from 4GB to 256GB of memory, while the R7g instances can also have up to 64 vCPUs but 8GB to 512GB of memory. These are currently available in the AWS US East, US West and Europe (Ireland) regions.
Microsoft also has workloads running on Arm servers on Azure. It [13]announced instances last year based on Ampere Altra processors, claiming that these would be able to deliver up to 50 percent better price-performance than comparable instances operating on x86 hardware.
[14]
Last week, it was claimed by Arm's parent company SoftBank that as much as [15]5 percent of the cloud services operated by AWS, Microsoft Azure and Google Cloud are already delivered by Arm chips.
According to a prediction by Steve Brazier, CEO at channel analyst Canalys, by 2026 some 50 pecent fo CPUs sold to the public clouds will be Arm-based, not x86-based. "That is a massive industry shift".
Indeed it is. If correct. ®
Get our [16]Tech Resources
[1] https://www.theregister.com/2022/07/14/arm_cloud_trend/
[2] https://www.theinformation.com/articles/playing-catch-up-with-aws-google-makes-progress-with-data-center-chips
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Y@u@MvglO2SXLhuhI@eRqwAAAE0&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Y@u@MvglO2SXLhuhI@eRqwAAAE0&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Y@u@MvglO2SXLhuhI@eRqwAAAE0&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.theregister.com/2022/06/04/ampere_arm_cloud/
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Y@u@MvglO2SXLhuhI@eRqwAAAE0&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[8] https://www.theregister.com/2023/02/14/uber_google_oracle_deals/
[9] https://www.theregister.com/2023/02/08/5_percent_cloud_arm/
[10] https://www.theregister.com/2023/02/07/arm_revenue_up_28_percent/
[11] https://www.theregister.com/2023/02/07/fortinet_sp5_asic/
[12] https://aws.amazon.com/blogs/aws/new-graviton3-based-general-purpose-m7g-and-memory-optimized-r7g-amazon-ec2-instances/
[13] https://www.theregister.com/2022/08/30/microsoft_armbased_vms_azure/
[14] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Y@u@MvglO2SXLhuhI@eRqwAAAE0&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[15] https://www.theregister.com/2023/02/08/5_percent_cloud_arm/
[16] https://whitepapers.theregister.com/
The search giant [1]already supports virtual machines powered by Ampere Computing's Arm-based Altra processors, but in the wake of Amazon's in-house designed Graviton silicon, Google is said to be working on a pair of its own Arm-based server CPUs.
According to [2]The Information , Google is preparing one processor codenamed Maple which is based on an existing design from Marvell Technology, and a second codenamed Cypress that is said to be a custom design being developed by a team based in Israel.
[3]
Both are said to be designed for 5nm production processes, and as Marvell is a fabless semiconductor company that uses Taiwan-based TSMC to produce its chips, it is possible that this is what Google also has planned.
[4]
[5]
Mountain View's Google Cloud is aiming for performance from its new Arm server chips that will be comparable with that of server processors from Intel and AMD, according to the report.
But how do you measure this?
It isn't clear whether this means each individual core will be a match for an x86 core, which might be a tall order, or that the entire chip could best the performance of an Intel or AMD part by cramming in more cores.
This was the approach taken by [6]Ampere , which fits 128 cores onto its Altra Max processor, each one focused on maximum single-thread performance to meet the requirements of cloud-native workloads.
However they shape up, producing its own tailor-made chips could be a more cost-effective strategy for Google in the long run than buying in x86 chips, which can cost thousands of dollars apiece, especially at the kind of scale cloud companies operate.
[7]
According to the report, Google is looking to have its custom server chips in production sometime in the second half of 2024, with actual deployment in its datacenters by 2025.
[8]Uber strikes deals with Google and Oracle to cut datacenter dependence
[9]5% of the cloud now runs on Arm as chip designer plans 2023 IPO
[10]Arm still strong despite SoftBank loss as shipments pass a quarter of a trillion
[11]Fortinet's latest ASIC promises 2.5Gbps of SSL inspection at the edge
Meanwhile, AWS has just introduced [12]more instances powered by its own Graviton3 Arm-based processors. The M7g instances are aimed at general-purpose workloads, while the R7g are memory-optimized, making them a better fit for workloads such as databases, in-memory caches, and data analytics.
These 7th generation instances were designed to deliver up to 25 percent greater performance than the equivalent 6th gen instances making them "the best performers" in its EC2 service, AWS claimed.
The M7g instances can be specified with up to 64 vCPUs and from 4GB to 256GB of memory, while the R7g instances can also have up to 64 vCPUs but 8GB to 512GB of memory. These are currently available in the AWS US East, US West and Europe (Ireland) regions.
Microsoft also has workloads running on Arm servers on Azure. It [13]announced instances last year based on Ampere Altra processors, claiming that these would be able to deliver up to 50 percent better price-performance than comparable instances operating on x86 hardware.
[14]
Last week, it was claimed by Arm's parent company SoftBank that as much as [15]5 percent of the cloud services operated by AWS, Microsoft Azure and Google Cloud are already delivered by Arm chips.
According to a prediction by Steve Brazier, CEO at channel analyst Canalys, by 2026 some 50 pecent fo CPUs sold to the public clouds will be Arm-based, not x86-based. "That is a massive industry shift".
Indeed it is. If correct. ®
Get our [16]Tech Resources
[1] https://www.theregister.com/2022/07/14/arm_cloud_trend/
[2] https://www.theinformation.com/articles/playing-catch-up-with-aws-google-makes-progress-with-data-center-chips
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Y@u@MvglO2SXLhuhI@eRqwAAAE0&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Y@u@MvglO2SXLhuhI@eRqwAAAE0&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Y@u@MvglO2SXLhuhI@eRqwAAAE0&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.theregister.com/2022/06/04/ampere_arm_cloud/
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Y@u@MvglO2SXLhuhI@eRqwAAAE0&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[8] https://www.theregister.com/2023/02/14/uber_google_oracle_deals/
[9] https://www.theregister.com/2023/02/08/5_percent_cloud_arm/
[10] https://www.theregister.com/2023/02/07/arm_revenue_up_28_percent/
[11] https://www.theregister.com/2023/02/07/fortinet_sp5_asic/
[12] https://aws.amazon.com/blogs/aws/new-graviton3-based-general-purpose-m7g-and-memory-optimized-r7g-amazon-ec2-instances/
[13] https://www.theregister.com/2022/08/30/microsoft_armbased_vms_azure/
[14] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/systems&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Y@u@MvglO2SXLhuhI@eRqwAAAE0&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[15] https://www.theregister.com/2023/02/08/5_percent_cloud_arm/
[16] https://whitepapers.theregister.com/
Re: BYO
katrinab
Because with the possible exception of Samsung, nobody else, not even Intel, has the ability to do it?
Re: BYO
elsergiovolador
Nonsense, it's all politics and laziness.
JohnSheeran
Is nobody worried about the lock-in this stuff creates? What is keeping these cloud providers from implementing proprietary code to keep you locked into their service?
I honestly don't get it. While we can all complain about the Intel cost model, the truth is that cloud providers charge significantly more than any server vendor charges for Intel-based (AMD too of course) solutions. Even when you wrap all of the "capability" of automation and APIs around their services it's still really difficult to justify the expense.
I personally find ARM very interesting but there seems to be very little Of the Shelf software that is common in the marketplace so it means that a lot of people are going to do a lot of custom development to work in those environments to support it. (I'm sure I'll get downvoted by everyone that loves ARM and believes that the software is everywhere)
Anyway, this is definitely interesting but it feels like it's a big risk for large companies to take.
re: mplementing proprietary code to keep you locked into their service?
Anonymous Coward
Don't the likes of AWS already do this with their vastly inflated charges to download YOUR data from their cloud?
Cloud Computing.... Trusting someone else with your company crown jewels. Ok until something goes wrong as it invariable does.
BYO
Why Google won't build their own fab?
It seems like these big corporations are clogging TSMC and other fabs used by smaller businesses, because there is no regulation.
Corporations beyond certain size should be forced to build their own manufacturing rather than using up capacity that businesses that can't do it yet use.
Regulators should really slap Google hard for that.