confluentinc / kafka-connect-hdfs

Kafka Connect HDFS connector

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Maybe we can enhance StringFormat

RuiFG opened this issue · comments

kafka-connect-hdfs has some Formater like:Parquet,AVRO,String,but for StringFormat,we cannot use compression,maybe we can enhance StringFormat,use snappy or gzip compression

My suggestion is to add an configuration, such as avro.codec, maybe string.codec,
have some options: null ,gzip,snappy,
and EXTENSION will not be constant: txt gz snappy?