Vegas
Vegas aims to be the missing MatPlotLib for the Scala and Spark world. Vegas wraps around Vega-Lite but provides syntax more familiar (and type checked) for use within Scala.
Quick start
Add the following jar as an SBT dependency
libraryDependencies += "org.vegas-viz" %% "vegas" % {vegas-version}
And then use the following code to render a plot into a pop-up window (see below for more details on controlling how and where Vegas renders).
import vegas._
import vegas.render.WindowRenderer._
val plot = Vegas("Country Pop").
withData(
Seq(
Map("country" -> "USA", "population" -> 314),
Map("country" -> "UK", "population" -> 64),
Map("country" -> "DK", "population" -> 80)
)
).
encodeX("country", Nom).
encodeY("population", Quant).
mark(Bar)
plot.show
See further examples here
Rendering
Vegas provides a number of options for rendering plots out to. The primary focus is using Vegas within interactive notebook environments, such as Jupyter and Zeppelin.
Notebooks
Jupyter - Scala
If you're using jupyter-scala, then you must incldue the following in your notebook before using Vegas.
import $ivy.`org.vegas-viz::vegas:{vegas-version}`
import vegas._
import vegas.render.HTMLRenderer._
implicit val displayer: String => Unit = publish.html(_)
Jupyter - Apache Toree
And if you're using Apache Toree, then this:
%AddDeps com.github.vegas-viz vegas_2.11 {vegas-version} --transitive
import vegas._
import vegas.render.HTMLRenderer._
implicit val displayer: String => Unit = { s => kernel.display.content("text/html", s) }
Zeppelin
And lastly if you're using Apache Zeppelin then use the following to initialize the notebook.
%dep
z.load("org.vegas-viz:vegas_2.11:{vegas-version}")
import vegas._
import vegas.render.HTMLRenderer._
implicit val displayer: String => Unit = { s => print("%html " + s) }
The last line in each of the above is required to connect Vegas to the notebook's HTML renderer (so that the returned HTML is rendered instead of displayed as a string).
See a comprehensive list example notebook of plots here
Standalone
Vegas can also be used to produce standalone HTML or even render plots within a built-in display app (useful if you wanted to display plots for a command-line-app).
The construction of the plot is independent from the rendering strategy: the same plot can be rendered as HTML or in a Window simply by importing a different renderer in the scope.
Note that the renderering examples below are wrapped in separate functions to avoid ambiguous implicit conversions if they were imported in the same scope.
A plot is defined as:
import vegas._
val plot = Vegas("Country Pop").
withData(
Seq(
Map("country" -> "USA", "population" -> 314),
Map("country" -> "UK", "population" -> 64),
Map("country" -> "DK", "population" -> 80)
)
).
encodeX("country", Nom).
encodeY("population", Quant).
mark(Bar)
HTML
The following renders the plot as HTML (which is printed to the console).
def renderHTML = {
import vegas.render.HTMLRenderer._
println(plot.pageHTML())
}
Window
Vegas also contains a self-contained display app for displaying plots (internally JavaFX's HTML renderer is used). The following demonstrates this and can be used from the command line.
def renderWindow = {
import vegas.render.WindowRenderer._
plot.show
}
Make sure JavaFX is installed on your system along or ships with your JDK distribution.
JSON
You can print the JSON containing the Vega-lite spec, without importing any renderer in the scope.
println(plot.toJson)
The output JSON can be copy-pasted into the Vega-lite editor.
Spark integration
Vegas comes with an optional extension package that makes it easier to work with Spark DataFrames. First you'll need an extra import
libraryDependencies += "org.vegas-viz" %% "vegas-spark" % "{vegas-version}"
import vegas.sparkExt._
This adds the following new method:
withDataFrame(df: DataFrame)
Each DataFrame column is exposed as a field keyed using the column's name.
Flink integration
Vegas also comes with an optional extension package that makes it easier to work with Flink DataSets. You'll also need to import:
libraryDependencies += "org.vegas-viz" %% "vegas-flink" % "{vegas-version}"
To use:
import vegas.flink.Flink._
This adds the following method:
withData[T <: Product](ds: DataSet[T])
Similarly, to the RDD concept in Spark, a DataSet of case classes or tuples is expected and reflection is used to map the case class' fields to fields within Vegas. In the case of tuples you can encode the fields using "_1", "_2"
and so on.
Plot Options
TODO
Contributing
See here for more information on contributing bug fixes and features.