calebchoban / tscc_dask

Example of running dask on a jupyter notebook on TSCC.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

tscc_dask

Example of running dask on a jupyter notebook on TSCC.

Usage

Log in your TSCC account and clone the repo:

$ git clone https://github.com/calebchoban/tscc_dask.git

Make a conda environment from the provided yml file (this will take a while):

$ conda env create -f py3.yml

Submit the Jupyter notebook job to TSCC:

$ qsub jupyter_job.pbs

Copy and run the bash script on your local computer (make sure username is replaced with your username):

$ source ./tunnel_notebook.sh

Open up your favorite web browser and type 'localhost:8181' in the address.

Go analyze data.

About

Example of running dask on a jupyter notebook on TSCC.


Languages

Language:Jupyter Notebook 97.9%Language:Shell 2.1%