cmclean / gridmap

Easily map Python functions onto a cluster using a DRMAA-compatible grid engine like Sun Grid Engine (SGE).

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

GridMap

Travis build status Test coverage PyPI downloads Latest version on PyPI Bitdeli badge

A package to allow you to easily create jobs on the cluster directly from Python. You can directly map Python functions onto the cluster without needing to write any wrapper code yourself.

This is the ETS fork of an older project called Python Grid. Unlike the older version, it is Python 2/3 compatible. Another major difference is that you can change the configuration via environment variables instead of having to modify a Python file in your site-packages directory. We've also removed some cruft and improved the reliability of some of the features.

For some examples of how to use it, check out map_reduce.py (for a simple example of how you can map a function onto the cluster) and manual.py (for an example of how you can create list of jobs yourself) in the examples folder.

For complete documentation read the docs.

NOTE: You cannot use GridMap on a machine that is not allowed to submit jobs (e.g., slave nodes).

Requirements

License

  • GPLv3

Changelog

See GitHub releases.

About

Easily map Python functions onto a cluster using a DRMAA-compatible grid engine like Sun Grid Engine (SGE).

License:GNU General Public License v3.0