Task Installing Remote Plugins is using confluent-hub in community version
rathberm opened this issue · comments
Describe the issue
Up until cp-ansible version 7.3.0, the tasks Installing Remote Plugins and Installing Local Plugins were using the ansible module unarchive to copy and extract Connect Plugins. Since Version 7.4.0 confluent-hub at {{ binary_base_path }}/bin/confluent-hub is used to install the plugins. The confluent-hub binary is not included in the community version of the confluent platform, which leads to the task failing and the plugins are not installed/copied.
We were able to work around this issue by using kafka_connect_copy_files to copy the plugins to the hosts but this does not offer the same functionality and ease of use, since it does not unpack the plugin archives and they have to be locally available on the ansible controller, since remote_src is not set.
For me it looks like that the new 7.4.0 version simply does not work with the community variant of the Confluent distribution.
Maybe it's possible to differentiate between the community and EE versions and skip the confluent-hub tasks accordingly.
To Reproduce
Steps to reproduce the behaviour:
Install a cluster using the community version of the confluent platform archive and set kafka_connect_plugins_remote or kafka_connect_plugins_local
Expected behaviour
I expected the plugins to be copied to the connect hosts and unarchived like in the previous versions.
Environment (please complete the following information):
- OS: SUSE Linux Enterprise Server 12 SP5
- CP-Ansible Branch: 7.4.0-post
- Ansible Version: 2.13.5