TouK / nussknacker-flink-compatibility

Additional code needed for using Nussknacker with different Flink versions

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Running Nussknacker with older Flink versions

Standard Nussknacker distribution works for (more or less) latest Flink version. However, Flink upgrade can be fairly complex process for large deployments. Most of Nussknacker code is based on stable Flink API, so changes required to run against older Flink version are usually relatively small.

This repository contains code that can be used to prepare custom model and process engine and run older Flink cluster (e.g. 1.14) with newest Nussknacker.

Each supported Flink version (e.g. 1.14) comes with two modules:

  • model - additional classes/changes that need to be put into model
  • manager - changes which have to be made in ProcessManager

Following tests will be provided to check if all needed changes are found:

  • GenericItSpec based on generic model test
  • TODO: integration test to check ProcessManager implementation

Additionally, in this repo you can find out classes that can help in running our testing framework with lower Flink's version - see flink16/test-util module.

About

Additional code needed for using Nussknacker with different Flink versions

License:Apache License 2.0


Languages

Language:Scala 66.2%Language:Shell 29.9%Language:Java 3.5%Language:Dockerfile 0.4%