Netflix / dynomite

A generic dynamo implementation for different k-v storage engines

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ERR Storage: Datastore refused connection

venkatchinmay opened this issue · comments

Hi @ipapapa @smukil
we created dynomite cluster with 6 nodes , each rack contains 3 nodes. we observed dynomite connections on 8102 and redis connections on 6379 of each node is working fine.
we received ERR Storage: Datastore refused connection randomly for valid commands. if we used same command every time we received data and some times it is giving ERR Storage: Datastore refused connection in random nodes
we observed this error with dyno client and the same time we observed same error through terminal also.
could you please help what are the reasons that cause these kind of errors as early as possible

Hi @ipapapa @smukil
we identified it is causing due to EVENTUAL CONSISTENCY between the two racks, we already know that dynomite is having high AVAILABILITY AND PARTITION TOLERANT.
did we have repairs mechanism like cassandra to achieve immediate consistency, if it have please share the doc.
we observed dynomite manager is with AWS configuration, if there is flexibilty with LOCAL ENVIRONMENTS please share the required document