News: 1633935937

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

VMware imagines 'memory servers' – a new source of shared software-defined RAM

(2021/10/11)


VMware is working on a software-defined memory effort and thinks it could lead to the creation of "memory servers" – boxes full of memory that can be shared across a cluster.

DRAM can account for 40 per cent or more of a server's cost, but remains expensive. Memory is also in demand, as more workloads require in-memory processing. VMware's customers tell the company that access to memory is a bottleneck more often than access to I/O or storage.

VMware has also noticed that memory seems to be the last item of hardware that hasn't been virtualised. The company considers forms of memory other than DRAM to be under-utilised by applications. In Virtzilla's view that's because today, software vendors need to write their own code to take advantage of different memory tiers.

[1]

The company therefore sees an opportunity to create an integrated memory service for applications and bake it into its flagship vSphere product.

[2]

[3]

Virtzilla's worked on this under the code name "Project Capitola" for over two years, and in a VMworld [4]session explained that its aim is to let applications access DRAM, CXL-attached memory or CXL-over-Ethernet, persistent memory like Optane, local NVMe and pooled NVMe as a pool of storage. vSphere will watch to detect the most active memory pages and place them on the tier of physical memory with the appropriate qualities.

Containers or VMs will be able to get just the memory they need. Software vendors won't need to write their own tiering code – they'll just need to make sure their apps are happy running as VMs or containers under vSphere. Most software vendors are there already.

[5]

Sudhanshu Jain, director of product management at VMware's cloud product business unit, said Virtzilla's already seeing interest from small cloud operators, who see the potential to offer a cheaper and slightly slower tier of services. Other buyers like the idea because it will let them decouple server and memory purchases – some are buying more DRAM than they need in anticipation of their databases growing.

Jain also suggested software-defined memory could even lead to the advent of "memory servers" – boxes filled with memory that is shared among the hosts in a cluster.

[6]Epic trolling: Microsoft allows third-party storefronts into its app store

[7]EU readies 'antitrust charges' against Apple Pay for locking rivals out of iPhone NFC chip

[8]Revealed: How to steal money from victims' contactless Apple Pay wallets

VMware admits that shunting work off into a memory tier other than DRAM will reduce performance, but by a manageable amount. It will also consume some more bandwidth within the datacentre.

If that gives you pause, VMware said its tests indicate total cost of ownership savings for hardware of between 30 and 50 per cent can be achieved. So perhaps that reduced performance will pay for itself because you won't have had to pay for extra DRAM.

VMware hasn't put a date on when this tech will debut, but is talking to the likes of Samsung, Intel, Micron, and top software vendors to make it a reality.

[9]

If this all seems fanciful, remember that it's just seven years since VMware [10]got serious about virtual storage in dedicated storage servers . In those far-off days, the idea of servers crammed with direct-attached storage as a replacement for SANs seemed odd. Yet virtual storage is now ubiquitous in the form of hyperconverged infrastructure.

VMware's Jain said Dell and Cisco are also interested in Project Capitola, so bring on those storage servers. ®

Get our [11]Tech Resources



[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/servers&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YWQLaawzp1X36N9xA5FiiAAAAIQ&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/servers&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YWQLaawzp1X36N9xA5FiiAAAAIQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/servers&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YWQLaawzp1X36N9xA5FiiAAAAIQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[4] https://myevents.vmware.com/widget/vmware/vmworld2021/catalog/session/16208383900260013daz

[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/servers&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YWQLaawzp1X36N9xA5FiiAAAAIQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[6] https://www.theregister.com/2021/09/29/microsoft_store_allows_third_party_storefronts/

[7] https://www.theregister.com/2021/10/06/eu_apple_nfc/

[8] https://www.theregister.com/2021/09/30/apple_pay_contactless_visa_fraud/

[9] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/servers&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YWQLaawzp1X36N9xA5FiiAAAAIQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[10] https://www.theregister.com/2014/03/12/vsan_software_and_hardware_price_revealed_as/

[11] https://whitepapers.theregister.com/



Need to see the Numbers

tip pc

With non volatile storage having quicker access and transfer rates than RAM of a few generations ago I’d need to see the numbers to understand the benefit of accessing off system RAM across some interconnection vs local sad. If it’s quick enough to not be noticeable then it’s a great idea.

An extension could be to pool all the ram under management (imagine 12 esxi hosts each with 200 GB ram with some hosts needing more than others) so existing hardware can be used to prove the concept with an eye for dedicated vsphere ram server later.

Would be a winner for bladed systems.

Bullshit ...

da39a3ee5e6b4b0d3255bfef95601890afd80709

Quoting, "memory seems to be the last item of hardware that hasn't been virtualised" ... I refer VMware to the Burroughs Corporation B5000 from 1961. The first computer with virtualised memory.

Next.

Couldnt bork enough flash

man_iii

Vmware has been punting its terrible readwrite IO problems on its latest vsphere7.x series that seem to enjoy excessively killing lowend sdcards and ssds by simply claiming not to support them anymore. I wonder if the issue is going to come back to bite vmware in the rearend sooner than later.

They don't know how the world is shaped. And so they give it a shape, and
try to make everything fit it. They separate the right from the left, the
man from the woman, the plant from the animal, the sun from the moon. They
only want to count to two.
-- Emma Bull, "Bone Dance"