MSurendra / kafka-connect-solr

Kafka connector for Solr Sink

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

kafka-connect-solr

Kafka Connect Solr for writing data to Solr. The SolrSinkTask can be configured with the following configuration.


solr.cluster.url=http://localhost:8983/solr/kafka-solr/update/json?commit=true
solr.cluster.name=kafka-solr-sink-sample
bulk.size=500
action.type=insert
solr.doc.converter=com.apache.kafka.connect.solr.converter.SolrJsonDocConverter

solr.doc.converter is a com.apache.kafka.connect.solr.converter.Converter that needs to be configured. This will take a SinkRecord object and serialize it in to JSON bytes that can be written to Solr.

If the data in Kafka is already in JSON format then you can use the com.apache.kafka.connect.solr.converter.SolrJsonDocConverter that is available with this library.

If the data in Kafka is in Avro format then you can use the com.apache.kafka.connect.solr.converter.SolrAvroJsonDocConverter that is available with this library.

About

Kafka connector for Solr Sink

License:Apache License 2.0


Languages

Language:Java 100.0%