lyft / flinkk8soperator

Kubernetes operator that provides control plane for managing Apache Flink applications

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Scale Up Integration Test Fix

sethsaperstein-lyft opened this issue · comments

overview

Scale up test is being commented out to get integration tests working on github actions. The issue is that github hosted runners only allow 8gb memory and 2 cpu by default. The scale up test requires 2 flink clusters to run simultaneously, one with 2 tm's with 2 task slots each and one with 1 tm with 2 task slots. Other tests only require 1 tm per flink cluster and have been squeezed into the github hosted runner by decreasing parallelism during testing.

To get this test to run, we'll need to use larger github runners which is currently in beta.