RedisLabs / spark-redis

A connector for Spark that allows reading and writing to/from Redis cluster

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Do you consider supporting Spark to directly read and parse Redis RDB files as key value pairs?

youngxinler opened this issue · comments

Direct reading of online databases for full database analysis may have an impact on online services, but direct reading of RDB files will not.

It can even further support Spark to produce RDB files. Writing KV files to Redis through RDB files is faster and more efficient.

Directly reading/parsing Redis RDB files are not going to be suppoted, at least in recent future.