confluentinc / kafka-connect-hdfs

Kafka Connect HDFS connector

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Original file names instead of offset

AbdullahAlhulwah opened this issue · comments

Is there a way to keep the original file name when storing in HDFS ? We are using kafka to move json files to HDFS, we want the names of the files stored in HDFS to be the same as the json files names, not the offset number.

Currently, saving offset in the file name helps to create the exactly once semantics logic implementation