confluentinc / librdkafka

The Apache Kafka C/C++ library

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Unable to create broker thread error

adawaefve opened this issue · comments

Description

I am trying to build a project with librdkafka library in docker. Docker image builds succesfully and all dependencies are linked correctly, but when I build app, where I use the librdkafka library, I keep receiving different kinds of errors. Most common of them is :
, level: 2, log message: 'KafkaConsumer[c0f24ff0-be1be3a6] THREAD | [thrd:app]: Unable to create broker thread', (LIBRDKAFKA:0)
project: rdkafka_broker.c:5003: rd_kafka_broker_add_logical: Assertion `rkb && *"failed to create broker thread"' failed.
I am using exactly 1 producer and 2 consumers and all memory limits are set to unlimited in my docker container. Sometimes, when I comment out some of them I receive new error, that is connectted to modern cpp kafka library:
2024-05-07 10:01:45.345234: Local: Critical system resource failure [-194] (/usr/local/include/modern-cpp-kafka/kafka/KafkaClient.h:429)

How to reproduce

build a C++ project where is linked librdkafka ,modern cpp Kafka, pthread.

Checklist

Please provide the following information:

  • librdkafka version (release number or git tag): 2.4.0
  • librdkafka client configuration: message.timeout.ms=123, auto.reset.offset=earliest,
  • Operating system: docker- ubuntu 22.04

@adawaefve giving that you're working with Docker could you provide a Dockerfile to reproduce it