mchlzhao / pymr

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

PyMR

A MapReduce framework implemented in Python 3, leveraging the multiprocessing library to run map and reduce tasks in parallel on multiple CPU cores. Users can learn about and experiment with the framework by defining their own map and reduce functions.

There are currently two sample programs demonstrating how to use the PyMR framework:

The design of the system was inspired by Google's MapReduce research paper (Dean & Ghemawat, 2004).

License

PyMR is distributed under the terms of the MIT license. See LICENSE for details.

About

License:MIT License


Languages

Language:Python 100.0%