dataiku / dss-plugin-warp10

Dataiku DSS plugin to connect to Warp10 and use WarpScript

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Warp10 Plugin

This plugin adds a Warp10 connector, two WarpScript recipes, and a WarpScript macro.

Build

Make sure you have a DKUINSTALLDIR environment variable set.

make all

This will build a zip file in the dist directory that can then be installed in DSS.

Parameter Set

  • Warp10 hostname
  • Warp10 port
  • Warp10 read token
  • Warp10 write token

The Warp10 connector

Explore Warp10 data as a DSS dataset

The WarpScript recipe (on Warp10)

Execute WarpScript on Warp10 to create and write a new GTS on Warp10.

The WarpScript recipe (on DSS)

Execute WarpScript directly on DSS on a DSS dataset. This has no dependency on Warp10.

Notes

Additional runtime dependencies are needed for WarpScript to be executed in DSS. These are placed in java-lib by the gradle build file, and included in the zip distribution. DSS will then look inside this directory for JARs to add to the classpath when executing a WarpScript recipe.

The WarpScript macro

Execute arbitrary WarpScript on Warp10.

Unit tests

To run the unit tests in python-test, from the root directory of the plugin, run (requires pytest to be installed):

pytest

About

Dataiku DSS plugin to connect to Warp10 and use WarpScript

License:Apache License 2.0


Languages

Language:Python 43.8%Language:Java 33.0%Language:HTML 16.9%Language:JavaScript 4.6%Language:Makefile 1.6%