optiopay / kafka

Go driver for Kafka

Home Page:https://godoc.org/github.com/optiopay/kafka

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

err: gzip: invalid header

butnet opened this issue · comments

kafka/broker.go

Line 1218 in 1ad0bf3

c.msgbuf, err = c.consume()

the same message can be receive by client in java.

Hello @butnet,

Could you provide more context?

@dgellow :
it can't repet in my local environmental, it happen in prod environmental.
I just get the error message, no more.

Hi,
I got the same issue after a module upgrade. I narrowed it down to the consumer's MaxFetchSize param. I had to set it explicitely to 0 to solve the issue as setting it to any number up to INT32_MAX didn't help.

As for the context, I am consuming big gziped json messages. Once unzipped, they can expand to 3 or 4MB but stay below 2MB when zipped.