MeteoSwiss-APN / finch

distributed data processing for ICON data

Home Page:https://meteoswiss-apn.github.io/finch/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

finch [distributed data processing for ICON data]

https://github.com/MeteoSwiss-APN/finch/blob/main/images/201903_Zebra_finch_lo.png?raw=true

Image distributed through Creative Commons License from https://commons.wikimedia.org/wiki/File:201903_Zebra_finch.svg

Finch is a Python library for setting up, running and analyzing runtime experiments for data processing operators with dask.

Warning

Finch is currently in development. The documentation might at some places be outdated or incomplete.

Overview

Finch provides parallelized prototypes for ICON data processing operators for a distributed infrastructure with SLURM. It is designed as a library for setting up experiments plus a run script, which runs configurable experiments. The documentation of finch is available on github pages.


About

distributed data processing for ICON data

https://meteoswiss-apn.github.io/finch/

License:MIT License


Languages

Language:Python 88.2%Language:C++ 9.7%Language:CMake 1.4%Language:C 0.6%Language:Shell 0.0%