Unable to build fluentbit from source with kafka input plugin

[sisteinmetz]

Hello,

I try to build fluent bit from source with kafka input plugin.
I have to build from master because i build on macos arch arm64 M1 (cf fluent/fluent-bit#5300)
I followed this doc: https://docs.fluentbit.io/manual/installation/macos

I realise the cmake:
sudo cmake -DFLB_IN_KAFKA=Yes -DCMAKE_INSTALL_PREFIX=/opt/fluent-bit ../
I also tried:
sudo arch -arm64 cmake -DFLB_OUT_KAFKA=Yes -DFLB_IN_KAFKA=Yes -DCMAKE_INSTALL_PREFIX=/opt/fluent-bit ../

Everything is ok.

I then do :
sudo make -j 16

and i got this error:
[ 89%] Building C object plugins/in_kafka/CMakeFiles/flb-plugin-in_kafka.dir///lib/lwrb/lwrb/src/lwrb/lwrb.c.o
/Users/ssteinmetz/Documents/workspace/fluent-bit/plugins/in_kafka/in_kafka.c:115:13: error: implicit declaration of function 'flb_input_thread_exited' is invalid in C99 [-Werror,-Wimplicit-function-declaration]
while (!flb_input_thread_exited(it)) {
^
/Users/ssteinmetz/Documents/workspace/fluent-bit/plugins/in_kafka/in_kafka.c:115:13: note: did you mean 'flb_input_thread_is_ready'?
/Users/ssteinmetz/Documents/workspace/fluent-bit/include/fluent-bit/flb_input_thread.h:103:5: note: 'flb_input_thread_is_ready' declared here
int flb_input_thread_is_ready(struct flb_input_instance *ins);
^
/Users/ssteinmetz/Documents/workspace/fluent-bit/plugins/in_kafka/in_kafka.c:180:11: error: implicit declaration of function 'flb_input_thread_init' is invalid in C99 [-Werror,-Wimplicit-function-declaration]
ret = flb_input_thread_init(&ctx->it, in_kafka_callback, &ctx->it);
^
/Users/ssteinmetz/Documents/workspace/fluent-bit/plugins/in_kafka/in_kafka.c:192:41: error: use of undeclared identifier 'flb_input_thread_collect'; did you mean 'flb_input_coro_collect'?
flb_input_thread_collect,
^~~~~~~~~~~~~~~~~~~~~~~~
flb_input_coro_collect
/Users/ssteinmetz/Documents/workspace/fluent-bit/include/fluent-bit/flb_input.h:485:24: note: 'flb_input_coro_collect' declared here
struct flb_input_coro *flb_input_coro_collect(struct flb_input_collector *coll,
^
/Users/ssteinmetz/Documents/workspace/fluent-bit/plugins/in_kafka/in_kafka.c:230:5: error: implicit declaration of function 'flb_input_thread_destroy' is invalid in C99 [-Werror,-Wimplicit-function-declaration]
flb_input_thread_destroy(it, ctx->ins);
^
/Users/ssteinmetz/Documents/workspace/fluent-bit/plugins/in_kafka/in_kafka.c:230:5: note: did you mean 'flb_tp_thread_destroy'?
/Users/ssteinmetz/Documents/workspace/fluent-bit/include/fluent-bit/flb_thread_pool.h:69:5: note: 'flb_tp_thread_destroy' declared here
int flb_tp_thread_destroy();
^
/Users/ssteinmetz/Documents/workspace/fluent-bit/plugins/in_kafka/in_kafka.c:244:21: error: use of undeclared identifier 'flb_input_thread_collect'; did you mean 'flb_input_coro_collect'?
.cb_collect = flb_input_thread_collect,
^~~~~~~~~~~~~~~~~~~~~~~~
flb_input_coro_collect
/Users/ssteinmetz/Documents/workspace/fluent-bit/include/fluent-bit/flb_input.h:485:24: note: 'flb_input_coro_collect' declared here
struct flb_input_coro *flb_input_coro_collect(struct flb_input_collector coll,
^
/Users/ssteinmetz/Documents/workspace/fluent-bit/plugins/in_kafka/in_kafka.c:244:21: warning: incompatible function pointer types initializing 'int ()(struct flb_input_instance *, struct flb_config *, void *)' with an expression of type 'struct flb_input_coro *(struct flb_input_collector *, struct flb_config *)' [-Wincompatible-function-pointer-types]
.cb_collect = flb_input_thread_collect,
^~~~~~~~~~~~~~~~~~~~~~~~
1 warning and 5 errors generated.
make[2]: *** [plugins/in_kafka/CMakeFiles/flb-plugin-in_kafka.dir/in_kafka.c.o] Error 1
make[1]: *** [plugins/in_kafka/CMakeFiles/flb-plugin-in_kafka.dir/all] Error 2
make: *** [all] Error 2

Regards

[sisteinmetz]

I closed this issue toi re-open it in fluent-bit repo