qubole / kinesis-sql

Kinesis Connector for Structured Streaming

http://www.qubole.com

qubole/kinesis-sql Issues

could create Kinesis Connector for Spark structured streaming for 3.2.0
Updated 5 months ago
AWS creds provider while running spark app on Kubernetes
Updated a year ago
Data Loss when extracting data from Kinesis
Updated a year ago3
Data not receiving from Kinesis
Updated a year ago8
Consumer requiring re-sharding of stream before starts consuming data
Updated 2 years ago1
Can't get newer records
Updated 2 years ago3
Issue with Stream containing a lot of NO PUT ACTIVITY
Updated 2 years ago3
Cannot restart the streaming job from where it stopped previously in the kinesis stream
Updated 2 years ago1
startingPosition AT_TIMESTAMP iteratorOption NumberFormatException
Updated 2 years ago9
The library does not work with EMR on EKS Fargate | Infinite Loop
Updated 2 years ago
Kinesis encrypted stream
Closed 2 years ago1
What may be causing and how to work around StreamingQueryException: Gave up after 3 retries while fetching MetaData ?
Updated 3 years ago2
java.lang.IllegalStateException: /checkpoint/round/sources/0/shard-commit/1 does not exist
Updated 3 years ago27
Does this support kinesis fanout consumer ?
Updated 3 years ago
Kinesis Enhanced fan-out consumer ( using consumer ARN)
Updated 3 years ago3
How do I ensure checkpointing for kafka streams?
Updated 3 years ago2
Does Kinesis connector support reading compressed payloads on stream?
Updated 3 years ago1
Continuous trigger fails on Spark 3, but works on Spark 2.4.5
Updated 4 years ago1
ProvisionedThroughputExceededException and new batches are triggered even if avoidEmptyBatches=true
Updated 4 years ago6
Error in the Kinesis connector for reading data on AWS
Updated 4 years ago
TimeOut errors are not retried at KinesisReader
Closed 4 years ago5
LimitExceededException with multiple running queries per application
Closed 4 years ago3
Support scala 2.12?
Closed 4 years ago4
Error On EMR 6.1 Spark 3.0
Closed 4 years ago2
StreamingQueryException: 'Error while Describe Stream
Closed 4 years ago1
Not honoring maxFetchTimeInMs on empty streams
Closed 4 years ago4
Missing org/apache/spark/internal/Logging$class
Closed 4 years ago3
sink low write throughput
Closed 4 years ago7
Loading credentials using Default Credential Provider Chain
Closed 4 years ago1
pyspark foreach/foreachPartition send http request failed
Closed 4 years ago
Null pointer exception when trying to read stream in cluster mode
Closed 4 years ago2
Spark job is failing because of AmazonKinesisException: null (Service: AmazonKinesis; Status Code: 503
Closed 4 years ago5
Authentication with session token not working in PySpark
Closed 4 years ago5
Kinesis sink bug: child process has been shutdown (including fix)
Closed 5 years ago5
intergation with localstack
Updated 5 years ago1
Issue with connector when there is resharding and the streaming job is not running
Closed 5 years ago
Kinesis Consumer lag behavior in multiple regions
Closed 5 years ago11
passing aws_iam_role instead of awsSecretKey/awsAccessKeyId
Closed 5 years ago1
Maven build error
Closed 5 years ago5
Not supporting sessionToken/securityToken?
Closed 5 years ago2
publish to maven central
Closed 5 years ago5
reprocessing of already processed records after scaling the shards.
Closed 5 years ago1
Do we have support foreachbatch sinks
Closed 5 years ago1
mvn install -DskipTests fails
Closed 5 years ago1
source startingposition doesn't work for LATEST
Closed 5 years ago9
Like awsAccessKeyId option its good to have proxy and port option
Closed 5 years ago1
Multiple Sinks
Updated 6 years ago1
Proxy support
Updated 6 years ago1
Spark 2.4 support
Closed 6 years ago1
When running <mvn install -DskipTests> on branch 2.3.2 mvn fails
Closed 6 years ago3