confluentinc / kafka-connect-hdfs

Kafka Connect HDFS connector

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Hive Merge Feature

FreCap opened this issue · comments

Hive few years back added a ACID incremental rollup Merge and I was wondering if it was ever considered to add it to to kafka-connect-hdfs on top of the APPEND ONLY feature.

The rollup update seems a pretty common problem and it would be great if product of the Kafka Connect family addressed it.

Do you think it is feasible or it goes against the philosophy/principle/scope of kafka-connect-hdfs connector?