rahulgautam / kubernetes-r-playground

Experimenting with parallelizing R code through Kubernetes on GCP.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Parallelizing R code on Kubernetes

This repository contains all the code described in my blog post about parallelizing R scripts on kubernetes. The idea is to demonstrate different approaches available in kubernetes for parallelization.

The three methods are:

  • single job with static parameters
  • common template and multiple parameters using expansion
  • fine parallel processing using a work queue

About

Experimenting with parallelizing R code through Kubernetes on GCP.


Languages

Language:R 80.1%Language:Dockerfile 17.8%Language:Shell 2.1%