kauppie / zeebe-test-bench

zeebe-test-bench

Description

This repository provides a test bench for building a monitoring workflow application. It includes:

• A development environment deployed to Docker with different services (Zeebe, Kafka, Postgres...)
• Process files (in .bpmn format, located under ./zeebe-workflow-manager/src/main/resources/bpmn) to be deployed to Zeebe.
• Deploying processes and running job workers within a single command.
• Predefined instances to be created using zbctl.

Installation

The following application should be installed:

Required

• WSL2 (for Windows). Use WSL instead of Command Prompt / PowerShell from now on.
• Ubuntu (for Windows). Download this in the Microsoft Store after installing WSL2. Restarting your machine after installation.
• SDKMAN
• Git
• Docker Desktop
• Java JDK v17: sdk install java 17
• Gradle v8.1.1: sdk install gradle 8.1.1
• Kotlin: sdk install kotlin
• Camunda Modeler
• zbctl

Recommended

• jq: sudo apt-get install jq
• IntelliJ IDEA Community Edition

Setup

• Start Docker Desktop
• Start the development environment: ./start.sh
  • Check the logs of the container in Docker Desktop. If the error java.lang.ClassNotFoundException: io.zeebe.exporters.kafka.KafkaExporter exists (and potentially you are using an ARM Mac), do the following steps:
    • Create an exporters folder at the root of this repository.
    • Download zeebe-kafka-exporter.jar file through this [link](https://repo1.maven.org/maven2/io/zeebe/zeebe-kafka-exporter/3.1.1/zeebe-kafka-exporter-3.1.1-jar-with-dependencies.jar -O /exporters/zeebe-kafka-exporter.jar) and move this jar inside the exporters folder created above
    • Open docker-compose-arm.yml (or docker-compose.yml if you are using Intel Mac) and comment out the get-kafka-exporter service.
    • Run ./start.sh again.
• Open Zeebe Simple Monitor at localhost:8083. No process should be visible yet, but the UI should be.
  • If not, restart zeebe-simple-monitor container in Docker Desktop until its log displays something like "Started ZeebeSimpleMonitorApp in x seconds".

Interaction with Zeebe broker using zbctl

zbctl is a command-line tool to interact with Zeebe. The following examples illustrate how to use it.

• Deploy a process: zbctl --insecure deploy /path/to/bpmn/<process-name.bpmn>
• Create an instance for a process: zbctl --insecure create instance <process-id> --variables <necessary variables>. The process ID can be checked by either on the command line after deploying the process, or when opening the process' file in Camunda Modeler. Some variables are pre-defined under ./variables.
• Create a job worker: zbctl --insecure create worker <task-definition-type> --handler <command>. Task definition's type is set in Modeler.
• Publish a message: zbctl --insecure publish message <message-name> --correlationKey=<key>. The correlation key is set in Modeler as a variable (e.g., "orderId"), and "orderId" must be included when creating the process instance.

Deploy workflows, start job workers, create instances without zbctl

zeebe-workflow-manager is a Gradle project which includes pre-defined job workers and process definitions. To start:

• Build the project: gradle build.
• Deploy all processes, start all job workers: gradle bootrun.
• Create instances using ready-made script (run at zeebe-test-bench directory): ./create-instance-scripts/<path-to-.sh-file>
  • If the terminal says "Permission denied...", you need to give executing permission to all scripts files: chmod +x ./create-instance-scripts/*/*.sh
  • Note that zbctl has to be installed

Each job worker used and process instance created can print one or more output lines to the command line.