Error in consumer: Snappy compression not implemented

[tejasvichudasma-zefr]

Getting this error when trying read from topic

[2021-12-27 14:16:04.802] [renderer9] [error] [Extension Host] {"level":"ERROR","timestamp":"2021-12-27T22:16:05.020Z","logger":"kafkajs","message":"[Consumer] Crash: KafkaJSNotImplemented: Snappy compression not implemented","groupId":"vscode-dmds-inventory-search_definition","stack":"KafkaJSNotImplemented: Snappy compression not implemented\n\tat 2 (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1914612)\n\tat lookupCodecByAttributes (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1914894)\n\tat e.exports (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1922596)\n\tat e.exports (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1960314)\n\tat s (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1965003)\n\tat e.readArrayAsync (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1897261)\n\tat l (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1965067)\n\tat e.readArrayAsync (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1897261)\n\tat Object.decode (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1965257)\n\tat e.exports.send (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1868930)\n\tat processTicksAndRejections (internal/process/task_queues.js:93:5)\n\tat async e.exports.[private:Broker:sendRequest] (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1799844)\n\tat async e.exports.fetch (/home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1794638)\n\tat async /home/ec2-user/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.14.0/dist/extension.js:2:1830184"}

[Angelo]

By searching quickly it seems we should do (where?) https://github.com/tulios/kafkajs-snappy#configuration to support snappy.

[Tomas Ekeli]

i am getting a very similar error with lz4 compression defined by the producer

KafkaJSNotImplemented: LZ4 compression not implemented
        at 3 (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1923520)
        at lookupCodecByAttributes (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1923738)
        at e.exports (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1931557)
        at e.exports (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1969586)
        at s (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1968253)
        at e.readArrayAsync (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1904983)
        at l (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1968317)
        at e.readArrayAsync (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1904983)
        at Object.decode (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1968507)
        at e.exports.send (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1874541)
        at runMicrotasks (<anonymous>)
        at processTicksAndRejections (node:internal/process/task_queues:96:5)
        at e.exports.[private:Broker:sendRequest] (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1800982)
        at e.exports.fetch (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1796062)
        at e.exports.fetch (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1831225)
        at e.exports.fetch (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1854597)
        at Object.start (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1837029)
        at async Promise.all (index 0)
        at Object.start (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1836325)
        at e.exports.scheduleFetchManager (/root/.vscode-server/extensions/jeppeandersen.vscode-kafka-0.15.0/dist/extension.js:2:1851568)

i think the compression should be part of the message (according to tulios/kafkajs#1141 (comment)) - maybe that's not working in this extension?