spark-cassandra-connector can't connect from spark docker cluster
jeremycod opened this issue · comments
Hi,
I'm trying to run spark job from my scala application in this cluster initialized by docker-compose and it immediately disconnects from Cassandra cluster. It works fine if I run spark in local mode. My cassandra is on the Amazon EC2 instance and it's available from my local machine where this cluster is also running.
Could this be related to the network configuration of the cluster? Logs I get in my applicaiton looks like this:
INFO [2017-02-14 20:33:32,529] [DatabaseScheduler_Worker-1] connector.cql.CassandraConnector (Logging.scala:35) Connected to Cassandra cluster: Test Cluster
INFO [2017-02-14 20:33:40,607] [pool-79-thread-1] connector.cql.CassandraConnector (Logging.scala:35) Disconnected from Cassandra cluster: Test Cluster
Same constellation and the same issue here. Anyone had success with this issue?
Please show your cassandra configs and compose file.
Or try seeing if you can add Cassandra to your compose file for local debugging without relying on AWS networking