Invoice and Shipment services don't start due to missing topic ?
jmdev68 opened this issue · comments
tried to run the application and i am able to create / submit an order - however the invoice and shipment services are not running. when checking the docker log files for those services i get the following hint :
2020-07-04 15:22:34.933 INFO 6 --- [ main] o.a.kafka.common.utils.AppInfoParser : Kafka startTimeMs: 1593876154931
2020-07-04 15:22:35.134 WARN 6 --- [ main] ConfigServletWebServerApplicationContext : Exception encountered during context initialization - cancelling refresh attempt: org.springframework.context.ApplicationContextException: Failed to start bean 'org.springframework.kafka.config.internalKafkaListenerEndpointRegistry'; nested exception is java.lang.IllegalStateException: Topic(s) [order] is/are not present and missingTopicsFatal is true
2020-07-04 15:22:35.135 WARN 6 --- [ main] o.s.b.f.support.DisposableBeanAdapter : Invocation of destroy method failed on bean with name 'tomcatMetricsBinder': java.lang.NullPointerException
2020-07-04 15:22:35.136 INFO 6 --- [ main] o.s.s.concurrent.ThreadPoolTaskExecutor : Shutting down ExecutorService 'applicationTaskExecutor'
2020-07-04 15:22:35.136 INFO 6 --- [ main] j.LocalContainerEntityManagerFactoryBean : Closing JPA EntityManagerFactory for persistence unit 'default'
2020-07-04 15:22:35.137 INFO 6 --- [ main] com.zaxxer.hikari.HikariDataSource : HikariPool-1 - Shutdown initiated...
2020-07-04 15:22:35.144 INFO 6 --- [ main] com.zaxxer.hikari.HikariDataSource : HikariPool-1 - Shutdown completed.
2020-07-04 15:22:35.146 INFO 6 --- [ main] o.apache.catalina.core.StandardService : Stopping service [Tomcat]
2020-07-04 15:22:35.157 INFO 6 --- [ main] ConditionEvaluationReportLoggingListener :
Interesting, thanks for submitting! Kafka itself creates the topics so it should always be there. I guess there is a racing condition when shipping / order contacts the Kafka server and the Kafka server starts up but hasn't yet created the topic. I could reproduce the problem and it should be fixed. Please reopen if it was not fixed. Thanks!
Thanks a lot Eberhard. It DOES work now (I pulled the latest code, rebuild the java code and rebuild the docker images.
During the java build process i was a little bit skeptic as the test failed (see below) but building without test and starting via docker compose worked.
thanks Jörg
020-07-06 21:38:23.910 WARN 9928 --- [ntainer#0-0-C-1] org.apache.kafka.clients.NetworkClient : [Consumer clientId=consumer-2, groupId=shipping] Connection to node 0 (localhost/127.0.0.1:35705) could not be established. Broker may not be available.
2020-07-06 21:38:24.238 WARN 9928 --- [ad | producer-1] org.apache.kafka.clients.NetworkClient : [Producer clientId=producer-1] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available.
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.038 s - in com.ewolff.microservice.shipping.ShippingWebIntegrationTest
[INFO]
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ShipmentKafkaTest.orderAreReceived:46
Expected: is a value greater than <1L>
but: <1L> was equal to <1L>
[INFO]
[ERROR] Tests run: 3, Failures: 1, Errors: 0, Skipped: 0
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] microservice-kafka ................................. SUCCESS [ 0.539 s]
[INFO] microservice-kafka-order ........................... SUCCESS [ 14.576 s]
[INFO] microservice-kafka-shipping ........................ FAILURE [01:20 min]
[INFO] microservice-kafka-invoicing ....................... SKIPPED
Thanks. The tests do fail, I believe this is a problem with the ports for the embedded Kafka. On WSL2 on my machine they fail, on Windows Powershell they work. Not sure how to fix that. 😟