HeartSaVioR / spark-sql-kafka-offset-committer

Kafka offset committer for structured streaming query

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

NullPointerException is thrown in KafkaOffsetCommitterListener

szvasas opened this issue · comments

When StreamingQuery is started but there are no new messages to process, this line throws a NullpointerException.

The reason is that lastExecution is null so exec will be Some(null).

The exception is thrown continuously until at least one message is processed.

Nice finding! Would you mind submitting the fix? Otherwise I'll go fixing it. Thanks for reporting!

Sure, I will submit a PR soon.