uab-projects / map-reduce

Big Data project for ATS subject, basic parallel implementation of map-reduce paradigm with a test to count words in text files

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

MapReduce

This program with a MapReduce core is ready to deploy any application using this paradigm. The current implementation allows the user to count the words of file/s at once or by separated.

The program is written in Python 3.4 and uses multiprocessing.

Running the application

python mapreduce file_1 [file_n] [-h] [--merge]

<> with ♥ in ETSE, UAB by ccebrecos & davidlj.

About

Big Data project for ATS subject, basic parallel implementation of map-reduce paradigm with a test to count words in text files


Languages

Language:Python 99.9%Language:Shell 0.1%