Compressing Large Data Sets in Redis With Gzip
程序员文章站
2022-06-13 17:51:10
...
Compressing Large Data Sets in Redis With Gzip: When publishing it, the post dropped the quote and my comments. A long post analyzing different scenarios of compressing data stored in Redis using Gzip: Year and a half ago, I was working wi
Compressing Large Data Sets in Redis With Gzip:When publishing it, the post dropped the quote and my comments.
A long post analyzing different scenarios of compressing data stored in Redis using Gzip:
Year and a half ago, I was working with a software that used Redis as a buffer to store large sets of text data. We had some bottlenecks there. One of them was related to Redis and the large amount of data, that we had there (large comparing to RAM amount). Since then, I’ve wanted to check if using Gzip would be a big improvement or would it be just a next bottleneck (CPU). Unfortunately I don’t have access to this software any more, that’s why I’ve decided to create a simple test case just to check this matter.
If what’s important is the speed, I think algorithms like snappy and lzo are a better fit. If data density is important, then Zopfli is probably a better fit.
Original title and link: Compressing Large Data Sets in Redis With Gzip (NoSQL database?myNoSQL)
原文地址:Compressing Large Data Sets in Redis With Gzip, 感谢原作者分享。