unchartedsoftware / sparklet

A small Spark "cluster", running in standalone mode. Suitable for testing and development.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Update README to indicate that --packages can be passed to spark-shell

mlaccetti opened this issue · comments

The command needs to fire up spark-shell with some --packages

Such as? Wouldn't this be too opinionated, since we don't know what folks are going to be using spark for?

How about: add the ability to add them on the docker run command?

That makes more sense to me, but it's already possible:

$ docker run -it uncharted/sparklet:1.6.1 spark-shell --packages software.uncharted.sparkpipe:sparkpipe-core:0.9.7

Fiiiiiiine – update the README, then?!

From: Sean McIntyre <notifications@github.commailto:notifications@github.com>
Reply-To: unchartedsoftware/sparklet <reply@reply.github.commailto:reply@reply.github.com>
Date: Thursday, March 31, 2016 at 11:09 AM
To: unchartedsoftware/sparklet <sparklet@noreply.github.commailto:sparklet@noreply.github.com>
Cc: Michael Laccetti <michael@laccetti.commailto:michael@laccetti.com>
Subject: Re: [unchartedsoftware/sparklet] Pass in commonly used packages (#5)

That makes more sense to me, but it's already possible:

$ docker run -it uncharted/sparklet:1.6.1 spark-shell --packages software.uncharted.sparkpipe:sparkpipe-core:0.9.7


You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHubhttps://github.com//issues/5#issuecomment-203979699