nodefluent / kafka-streams

equivalent to kafka-streams :octopus: for nodejs :sparkles::turtle::rocket::sparkles:

Home Page:https://nodefluent.github.io/kafka-streams/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

JS client configuration broken?

unfrgivn opened this issue · comments

I see this library uses node-sinek which allows for running native or JS consumer/producers, but I don't see any way to force this library to use the new JS client? Both the native and JS clients use the same config with the noptions key in the newer versions of node-sinek and you only differentiate by loading different modules from the package. When I try to run kafka-streams though I get Error: You have to install node-rdkafka to use NConsumer. Looks like you are only able to use the older node-sinek JS client set with the options key?

Based on the KafkaFactory.js

if (this.config.noptions && typeof this.config.noptions === "object") {
    debug("creating new native kafka client");
    return new NativeKafkaClient(topic, this.config, this.batchOptions);
}
.
.
.
debug("creating new js kafka client");
return new JSKafkaClient(topic, this.config);

This seems incorrect based on the fact that the node-sinek JSConsumer/Producer also use config.noptions now https://github.com/nodefluent/node-sinek/blob/master/lib/kafkajs/JSConsumer.js