killme2008 / xmemcached

High performance, easy to use multithreaded memcached client in java.

Home Page:http://fnil.net/xmemcached

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

XMemcached pooled client Recv Q size is very high

auror opened this issue · comments

Hi,

We've been using XMemcachedClient connected to twemproxy which sits behind set of memcached servers. We've kept a OpTimeout of 30 ms.

Over the time, the Recv Q(from netstat) size of the tcp socket grows really high and prompting timeouts from XMemcached. Twemproxy as a result is also getting killed by going OOM gradually

Is XMemcached client slow in receiving data? Should TCP_RECV_BUFF_SIZE be increased?

Few more details:

  1. XMemcached version: 2.4.0
  2. Protocol: Text Protocol
  3. Session Idle Timeout: 60 secs
  4. timeoutExceptionThreshold: 250000
  5. healSessionInterval: 1 sec
  6. Pool Size: 20
  7. Throughput: ~ 2.2K QPS

2.2 K QPS is not heavy load, is your data too large?

But you may try to disable the connection pool,it's not recommended.

@killme2008 I'm facing the same issue, our data is too large. Can you please help?