haoch / flink-siddhi

A CEP library to run Siddhi within Apache Flink™ Streaming Application

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Dynamically creating Siddhi Streams

aagupta1 opened this issue · comments

Hi Haoch,

We are using Flink and Siddhi to build an alerting framework for the security domain.

One thing that we'd like to be able to do is create ad-hoc Siddhi streams based on the rule that a user defines - I want to be able to pull in fields from multiple input streams / schemas and create a new Siddhi stream on the fly which consists of the field names mentioned in the rule that the user created.

We've researched both Apache Eagle and the Flink-Siddhi project and from what we can tell, this is not supported functionality.

Any idea how we could achieve this ?

--Aarti

@aagupta1 I am not sure that if I got the point: you would like to have multiple existing streams with some fields, and would like to define another stream to extract fields from existing streams? Could you please share some use cases?