Read data from kafka and sink data to postgres. It has already include unit test. You can read kafka2postgresSuite.scala for more detail.
mvn clean test
mvn clean package
File: conf/spark.conf This is use for config the informations includes:
- topic of kafka
- brokers address of kafka
- Spark streaming checkpoint directory
- batch time of spark streaming
- jdbc of postgres