In-memory database Redis wants to dabble in disk
(2023/10/19)
- Reference: 1697704215
- News link: https://www.theregister.co.uk/2023/10/19/redis_disk_support/
- Source link:
Redis, the go-to in-memory database used as a cache and system broker, is looking to include disk as part of a tiered storage architecture to reduce costs and broaden the system's appeal.
Speaking to The Register , CEO Rowan Trollope said he hoped the move would help customers lower costs and simplify their architecture. Redis counts Twitter X, Snapchat, and Craigslist among its customers, and it's popular among developers of modern internet-scale applications owing to its ability to create a cache to prevent the main database from overloading.
Trollope said the sub-millisecond distributed system gives devs the performance they need, but admitted other systems built for internet scale, such as MongoDB, might offer price advantages. To address this, the company has already created a tiered approach to memory by offering flash support behind its in-memory system.
[1]
"We have a half-step between disk and memory. For some specific use cases, in gaming for example, a company might use us for leaderboards and other in-game stats, which they need in real time," he said.
[2]
[3]
However, after an initial flush of the game launch, a large chunk of users would finish the game and their accounts would go dormant until the release of a new episode or some new content, when they might return. Trollope said using flash allowed users to dynamically tier memory. "We can take the lesser-used data that hasn't been touched in a while and shuttle it off to flash where it can sit for a while. When the user comes back eventually, it's very easy for us to seamlessly move it from flash back into memory. And that allows the company to save costs," he said.
Redis is now planning to extend the concept to disk-based memory to offer support for a three-tiered architecture.
[4]
The business started life in 2009 as the brainchild of developer Salvatore Sanfilippo, who [5]stepped back from the project in 2020 . In the 2023 Stack Overflow Survey, Redis was named the sixth most popular database among professional developers and the second most popular NoSQL database. Around 23 percent of pro devs use the system. In November last year, Redis [6]acquired RESP.app , a popular developer tool used to ease developer experience on the key-value database.
In 2020, Redis [7]became the most popular database on AWS , according to research from systems monitoring firm Sumo Logic.
Trollope argues the popularity of the database in part owes much to the lack of competition. "We don't really compete with anyone else," he said, before admitting that other global in-memory systems such as Aerospike were, in fact, competition.
[8]HeadCrab bots pinch 1,000+ Redis servers to mine coins
[9]Redis swallows RESP.app biz that made its database easier on developers
[10]'Worst' AWS service ever? Cloud giant introduces Redis-compatible MemoryDB – to mixed response
[11]You only love me for my cache: New modules try to make NoSQL Redis more of a general-purpose database
In August, Aerospike Graph announced support for graph queries at extreme throughput across billions of vertices and trillions of connections. The company said benchmarks show a throughput of more than 100,000 queries per second with sub-5 ms latency. Aerospike customers include Sony Entertainment, PayPal, and Airtel.
"What I was trying to say is, you know, take the most popular databases in the world, and we're the leading in-memory database and nobody else is like that. Mongo doesn't do that. And none of cloud providers do that, like [Azure] Cosmos DB, or Oracle or any of the Amazon technologies like DynamoDB: they're not in-memory databases. We are used alongside all the other top ten databases, but we don't really compete with them," Trollope said.
[12]
Aerospike is not listed by Stack Overflow among the top 30 databases used by professional developers. Database ranking service DB-Engines puts it at 65, while Redis sits at number six.
One main [13]criticism of Redis had been its lack of support for SQL, the ubiquitous query language. Trollope said that was fixed now. A module RediSQL is available on [14]GitHub .
It is part of the drive to make Redis "more like your classic database," he said. In the future, support for natural language queries and enhanced vector and feature store capabilities will be added. This initiative aligns with Redis's ambition to be seen as more than just a fast, albeit expensive, cache. ®
Get our [15]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/databases&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZTD@SmXCU3dcIjFXxRPEaAAAAMc&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/databases&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZTD@SmXCU3dcIjFXxRPEaAAAAMc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/databases&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZTD@SmXCU3dcIjFXxRPEaAAAAMc&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/databases&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZTD@SmXCU3dcIjFXxRPEaAAAAMc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://www.theregister.com/2020/06/30/redis_creator_antirez_quits/
[6] https://www.theregister.com/2022/11/03/redis_resp_app/
[7] https://www.theregister.com/2020/11/23/redis_the_most_popular_db_on_aws/
[8] https://www.theregister.com/2023/02/04/headcrab_botnet_aqua/
[9] https://www.theregister.com/2022/11/03/redis_resp_app/
[10] https://www.theregister.com/2021/08/23/aws_memorydb_reaction/
[11] https://www.theregister.com/2021/04/21/redis_7/
[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/databases&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZTD@SmXCU3dcIjFXxRPEaAAAAMc&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[13] https://www.theregister.com/2021/04/21/redis_7/
[14] https://github.com/RedBeardLab/rediSQL
[15] https://whitepapers.theregister.com/
Speaking to The Register , CEO Rowan Trollope said he hoped the move would help customers lower costs and simplify their architecture. Redis counts Twitter X, Snapchat, and Craigslist among its customers, and it's popular among developers of modern internet-scale applications owing to its ability to create a cache to prevent the main database from overloading.
Trollope said the sub-millisecond distributed system gives devs the performance they need, but admitted other systems built for internet scale, such as MongoDB, might offer price advantages. To address this, the company has already created a tiered approach to memory by offering flash support behind its in-memory system.
[1]
"We have a half-step between disk and memory. For some specific use cases, in gaming for example, a company might use us for leaderboards and other in-game stats, which they need in real time," he said.
[2]
[3]
However, after an initial flush of the game launch, a large chunk of users would finish the game and their accounts would go dormant until the release of a new episode or some new content, when they might return. Trollope said using flash allowed users to dynamically tier memory. "We can take the lesser-used data that hasn't been touched in a while and shuttle it off to flash where it can sit for a while. When the user comes back eventually, it's very easy for us to seamlessly move it from flash back into memory. And that allows the company to save costs," he said.
Redis is now planning to extend the concept to disk-based memory to offer support for a three-tiered architecture.
[4]
The business started life in 2009 as the brainchild of developer Salvatore Sanfilippo, who [5]stepped back from the project in 2020 . In the 2023 Stack Overflow Survey, Redis was named the sixth most popular database among professional developers and the second most popular NoSQL database. Around 23 percent of pro devs use the system. In November last year, Redis [6]acquired RESP.app , a popular developer tool used to ease developer experience on the key-value database.
In 2020, Redis [7]became the most popular database on AWS , according to research from systems monitoring firm Sumo Logic.
Trollope argues the popularity of the database in part owes much to the lack of competition. "We don't really compete with anyone else," he said, before admitting that other global in-memory systems such as Aerospike were, in fact, competition.
[8]HeadCrab bots pinch 1,000+ Redis servers to mine coins
[9]Redis swallows RESP.app biz that made its database easier on developers
[10]'Worst' AWS service ever? Cloud giant introduces Redis-compatible MemoryDB – to mixed response
[11]You only love me for my cache: New modules try to make NoSQL Redis more of a general-purpose database
In August, Aerospike Graph announced support for graph queries at extreme throughput across billions of vertices and trillions of connections. The company said benchmarks show a throughput of more than 100,000 queries per second with sub-5 ms latency. Aerospike customers include Sony Entertainment, PayPal, and Airtel.
"What I was trying to say is, you know, take the most popular databases in the world, and we're the leading in-memory database and nobody else is like that. Mongo doesn't do that. And none of cloud providers do that, like [Azure] Cosmos DB, or Oracle or any of the Amazon technologies like DynamoDB: they're not in-memory databases. We are used alongside all the other top ten databases, but we don't really compete with them," Trollope said.
[12]
Aerospike is not listed by Stack Overflow among the top 30 databases used by professional developers. Database ranking service DB-Engines puts it at 65, while Redis sits at number six.
One main [13]criticism of Redis had been its lack of support for SQL, the ubiquitous query language. Trollope said that was fixed now. A module RediSQL is available on [14]GitHub .
It is part of the drive to make Redis "more like your classic database," he said. In the future, support for natural language queries and enhanced vector and feature store capabilities will be added. This initiative aligns with Redis's ambition to be seen as more than just a fast, albeit expensive, cache. ®
Get our [15]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/databases&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZTD@SmXCU3dcIjFXxRPEaAAAAMc&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/databases&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZTD@SmXCU3dcIjFXxRPEaAAAAMc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/databases&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZTD@SmXCU3dcIjFXxRPEaAAAAMc&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/databases&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZTD@SmXCU3dcIjFXxRPEaAAAAMc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://www.theregister.com/2020/06/30/redis_creator_antirez_quits/
[6] https://www.theregister.com/2022/11/03/redis_resp_app/
[7] https://www.theregister.com/2020/11/23/redis_the_most_popular_db_on_aws/
[8] https://www.theregister.com/2023/02/04/headcrab_botnet_aqua/
[9] https://www.theregister.com/2022/11/03/redis_resp_app/
[10] https://www.theregister.com/2021/08/23/aws_memorydb_reaction/
[11] https://www.theregister.com/2021/04/21/redis_7/
[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/databases&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZTD@SmXCU3dcIjFXxRPEaAAAAMc&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[13] https://www.theregister.com/2021/04/21/redis_7/
[14] https://github.com/RedBeardLab/rediSQL
[15] https://whitepapers.theregister.com/
to make Redis "more like your classic database,"
No no no! Don't do this.
One of the great things about Redis is that it doesn't have the overhead of SQL databases.
I use Redis alongside MySQL to build web applications. Redis is brilliant when you need to store temporary or arbitrary data, serverside, without the overhead of something like MySQL. For us we create Redis keys for users in our applications and then write serialized data into that key. Getting data in and out of that structure is trivial not to mention fast. It's generally always data that doesn't need to be persisted although I believe you can also write to disk if necessary anyhow. I don't want to write an SQL-style query to either read or write data like that. I definitely don't want or need transactions or any of the "safety" features afforded by MySQL for the type of data I'm describing.
Redis is good in its current form and has many, many different use cases. There isn't a right or wrong way to use it except for the fact it's absolutely not a replacement for something like MySQL. Different tools for different jobs.