Computational storage specs hit v1.0 after 4 years of work
(2022/09/07)
- Reference: 1662542892
- News link: https://www.theregister.co.uk/2022/09/07/snia_computational_storage_specifications/
- Source link:
The Storage Networking Industry Association (SNIA) has at last published version 1.0 of its Computational Storage Architecture and Programming Model, the specs meant to help develop the new performance-boosting tech by providing interoperability between different vendors.
A new direction in computing
Computational storage covers hardware and software architectures in which compute is more tightly coupled with storage at the system and drive level, partly driven by trends such as the growing volumes of data that organizations find themselves dealing with.
A typical implementation might be an SSD with some embedded compute capability, which might vary from an FGPA designed to offload compression, encryption, and erasure coding from the host CPU, to an Arm CPU capable of running Linux and custom code. However, there are other architectures that count as computational storage.
Some recently announced computational storage products covered by our sister site Blocks & Files include SSDs from [1]ScaleFlux and [2]Samsung .
The specs
These specifications have been a long time coming, with SNIA forming the Computational Storage Technical Work Group ( [3]TWG ) in 2018 to look at establishing some common standards for the emerging computational storage field.
Availability of the new specifications was announced on SNIA's Compute, Memory, and Storage Initiative (CMSI) blog, and these can be [4]downloaded as a PDF from the SNIA website.
According to SNIA, the 1.0 designation indicates that the trade association's membership has voted to approve the Computational Storage Architecture and Programming Model as an official SNIA specification that vendors can now work with.
[5]
The specs are expected to be useful for hardware developers building their own computational storage systems, as well as software architects, programmers, and other users to understand the definitions and common framework that the architecture describes for computational storage.
[6]AI chip adds artificial neurons to resistive RAM for use in wearables, drones
[7]Flash memory vendors unveil PCIe 5.0 SSDs, latest spec for CXL interconnect tech
[8]SK hynix and Los Alamos Labs to demo key-value store accelerating SSD
[9]BAE scores $699 million contract to support US Army supercomputers
One of the reasons for SNIA drawing up the specifications was to define common terminology across the ecosystem, and to define a discovery process flow for systems to find and interface with any computational storage resources they might have connected. In the SNIA blog, Computational Storage Special Interest Group chair David McIntyre said that it is an "interesting time" for compute, storage, and networking as the three are beginning to merge and support each other.
"The 1.0 Model has a nice baseline on definitions – before this there were none, but now we have Computational Storage Devices (CSxes), Computational Storage Processors (CSPs), Computational Storage Drives (CSDs), and Computational Storage Arrays (CSAs), and more," he said.
[10]
Definitions also help to educate and ground the ecosystems and the engineering community, he added, and how to characterize vendor solutions into the separate categories.
According to Computational Storage Architecture and Programming Model editor Bill Martin, the TWG is developing a Computational Storage API that will utilize the Model. This will provide an API through which vendors will be able to provide a library that maps to their particular protocol, which would include the NVMe protocol layer.
[11]
The [12]NVM Express consortium is also continuing development efforts on computational storage programs that will provide a mechanism to implement the SNIA Architecture and Programming Model.
Looking beyond NVMe, SNIA said that [13]CXL will be the next generation transport for both storage and memory devices, and a key feature of the SNIA Architecture and Programming Model is that it can apply to CXL, Ethernet, or other transports as it does not dictate the transport layer used to talk to the Computational Storage Devices (CSxes). ®
Get our [14]Tech Resources
[1] https://blocksandfiles.com/2022/08/09/scaleflux-csd-3000/
[2] https://blocksandfiles.com/2022/07/21/gen-2-samsung-smartssd-gets-smarter/
[3] https://www.snia.org/computationaltwg
[4] https://www.snia.org/standards/technology-standards-software/standards-portfolio/computational-storage-architecture-and
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/storage&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YxhruAXtlgD7TZvklq9-gQAAAMU&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[6] https://www.theregister.com/2022/08/18/ai_cim_chip_for_edge_paper/
[7] https://www.theregister.com/2022/08/05/pcie_50_ssds_cxl_30/
[8] https://www.theregister.com/2022/08/01/sk_hynix_lanl_kv_csd/
[9] https://www.theregister.com/2022/07/18/bae_dod_supercomputers/
[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/storage&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YxhruAXtlgD7TZvklq9-gQAAAMU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/storage&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YxhruAXtlgD7TZvklq9-gQAAAMU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[12] https://nvmexpress.org/
[13] https://www.theregister.com/2022/08/04/cxl_time_now/
[14] https://whitepapers.theregister.com/
A new direction in computing
Computational storage covers hardware and software architectures in which compute is more tightly coupled with storage at the system and drive level, partly driven by trends such as the growing volumes of data that organizations find themselves dealing with.
A typical implementation might be an SSD with some embedded compute capability, which might vary from an FGPA designed to offload compression, encryption, and erasure coding from the host CPU, to an Arm CPU capable of running Linux and custom code. However, there are other architectures that count as computational storage.
Some recently announced computational storage products covered by our sister site Blocks & Files include SSDs from [1]ScaleFlux and [2]Samsung .
The specs
These specifications have been a long time coming, with SNIA forming the Computational Storage Technical Work Group ( [3]TWG ) in 2018 to look at establishing some common standards for the emerging computational storage field.
Availability of the new specifications was announced on SNIA's Compute, Memory, and Storage Initiative (CMSI) blog, and these can be [4]downloaded as a PDF from the SNIA website.
According to SNIA, the 1.0 designation indicates that the trade association's membership has voted to approve the Computational Storage Architecture and Programming Model as an official SNIA specification that vendors can now work with.
[5]
The specs are expected to be useful for hardware developers building their own computational storage systems, as well as software architects, programmers, and other users to understand the definitions and common framework that the architecture describes for computational storage.
[6]AI chip adds artificial neurons to resistive RAM for use in wearables, drones
[7]Flash memory vendors unveil PCIe 5.0 SSDs, latest spec for CXL interconnect tech
[8]SK hynix and Los Alamos Labs to demo key-value store accelerating SSD
[9]BAE scores $699 million contract to support US Army supercomputers
One of the reasons for SNIA drawing up the specifications was to define common terminology across the ecosystem, and to define a discovery process flow for systems to find and interface with any computational storage resources they might have connected. In the SNIA blog, Computational Storage Special Interest Group chair David McIntyre said that it is an "interesting time" for compute, storage, and networking as the three are beginning to merge and support each other.
"The 1.0 Model has a nice baseline on definitions – before this there were none, but now we have Computational Storage Devices (CSxes), Computational Storage Processors (CSPs), Computational Storage Drives (CSDs), and Computational Storage Arrays (CSAs), and more," he said.
[10]
Definitions also help to educate and ground the ecosystems and the engineering community, he added, and how to characterize vendor solutions into the separate categories.
According to Computational Storage Architecture and Programming Model editor Bill Martin, the TWG is developing a Computational Storage API that will utilize the Model. This will provide an API through which vendors will be able to provide a library that maps to their particular protocol, which would include the NVMe protocol layer.
[11]
The [12]NVM Express consortium is also continuing development efforts on computational storage programs that will provide a mechanism to implement the SNIA Architecture and Programming Model.
Looking beyond NVMe, SNIA said that [13]CXL will be the next generation transport for both storage and memory devices, and a key feature of the SNIA Architecture and Programming Model is that it can apply to CXL, Ethernet, or other transports as it does not dictate the transport layer used to talk to the Computational Storage Devices (CSxes). ®
Get our [14]Tech Resources
[1] https://blocksandfiles.com/2022/08/09/scaleflux-csd-3000/
[2] https://blocksandfiles.com/2022/07/21/gen-2-samsung-smartssd-gets-smarter/
[3] https://www.snia.org/computationaltwg
[4] https://www.snia.org/standards/technology-standards-software/standards-portfolio/computational-storage-architecture-and
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/storage&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YxhruAXtlgD7TZvklq9-gQAAAMU&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[6] https://www.theregister.com/2022/08/18/ai_cim_chip_for_edge_paper/
[7] https://www.theregister.com/2022/08/05/pcie_50_ssds_cxl_30/
[8] https://www.theregister.com/2022/08/01/sk_hynix_lanl_kv_csd/
[9] https://www.theregister.com/2022/07/18/bae_dod_supercomputers/
[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/storage&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YxhruAXtlgD7TZvklq9-gQAAAMU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/storage&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YxhruAXtlgD7TZvklq9-gQAAAMU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[12] https://nvmexpress.org/
[13] https://www.theregister.com/2022/08/04/cxl_time_now/
[14] https://whitepapers.theregister.com/
Very Interesting
I can imagine a rack of storage devices, not unlike the racks of SCSI drives we used to install in the 90's, with 8 racks, front and back, each with 8 disks in them, giving 128 spinning platters.
Replace these with computational storage devices, each with a high number of GB (if not TB) of storage and their own processor. Now imaging a parallel database that can send a query off to run in all of these simultaneously. Hadoop on steroids with go-faster stripes. Of DB2 (who remembers that) which parallelises easily.
Or more exotic stuff, such as facial recognition, or AI/NLP/Pattern Matching.
Am I alone in thinking that this could be the next game changer in the big iron arena?