dataiku / dss-plugin-dkulib

Reusable Python code for Dataiku DSS plugins

Dataiku DSS Plugin Library

This repo contains reusable code to help develop Dataiku DSS plugins.

Usage

Never copy individual files from this repo to your code, only copy the containing folders (nlp, parallelization, ...) as they contains the versions and instructions. Copy these dir under your python-lib

You can then import modules in the plugins recipe.py file via e.g.:

from parallelizer import DataFrameParallelizer

Included libs

• dku_config (Last update: 2021-07): Gives the ability to check form parameters in the backend and display understandable messages if it fails.
• nlp (Last update: 2021-01): Detects languages, tokenize, correct misspellings and clean text data.
• io_utils (Last update: 2021-01): Input / output utility functions which do not need the Dataiku API.
• dku_io_utils (Last update: 2021-07): Input / output utility functions to read/write from and to Dataiku objects e.g., chunked read/transform/write of dataiku Datasets.
• parallelizer (Last update: 2021-07): Applies a function to a pandas DataFrame with parallelization, error logging and progress tracking.

License

This library is distributed under the Apache License version 2.0.