Giters

jhuangtw / xg2xg

by ex-googlers, for ex-googlers - a lookup table of similar tech & services

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Spark and Flink are comparable to Flume

grigjd3 opened this issue · comments

commented

I joined Google in the last year and have been working with big data tools for a while. Spark should be considered comparable to Flume. Also, Apache Flink should be on the same level, comparable to Flume. Both Spark and Flink are relatively high-level interfaces that will build DAGs from what are effectively macros. They provide db-like operations like joins, filters, etc.