Big query connector for spark
Setup instructions:
- Install docker
- Run setup.sh
Manual Setup:
- Run below commands in order:
- eval $(docker-machine env default)
- docker pull aniryou/spark_bigquery
- docker run -ti -p 8888:8888 -v <path_to_repo>:/mnt --name spark_bq aniryou/spark_bigquery
Playing with code: 4. docker-machine env default + use DOCKER_HOST ip address to access jupyter notebook on http://DOCKER_HOST:8888 5. upload Iris and Wordcount notebooks and run same