Extended NexMark Query 13 from Beam

[Gang Liao]

-- -------------------------------------------------------------------------------------------------
-- Query 13: Bounded Side Input Join (Not in original suite)
-- -------------------------------------------------------------------------------------------------
-- Joins a stream to a bounded side input, modeling basic stream enrichment.
-- -------------------------------------------------------------------------------------------------

I like this query. And I will implement this query to join a stream with a bounded side input in S3. It's an important feature that is also highlighted in Kinesis Data Streams.

[Gang Liao]

For this query, I think we can use the recent S3 feature --- S3 Object Lambda.
https://aws.amazon.com/cn/blogs/aws/introducing-amazon-s3-object-lambda-use-your-code-to-process-data-as-it-is-being-retrieved-from-s3/

[Gang Liao]

Generate side input files

https://github.com/nexmark/nexmark/blob/5c3248c15daa61639d3e83450bd5447dddb4523a/nexmark-flink/src/main/resources/bin/side_input_gen.sh

[Gang Liao]

Q13 is actually equivalent to the YSB benchmark since they both need to read a side input (lookup table) from external storage.

[Gang Liao]

https://gist.githubusercontent.com/gangliao/de6f544b8a93f26081036e0a7f8c1715/raw/69a0d87b9af54c20291d699ba1560d87566c550e/nexmark_q13_side_input.csv

[Gang Liao]

• Replace YSB Redis with AWS S3
• Replace NEXMark local file with AWS S3
• Support side-input query in benchmark