dumavit / docker-map-reduce

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Map reduce implementation (docker+python/asyncio)

This project is an example implementation of Google MapReduce concept

It calculates words count in 510000 lyrics from Kaggle dataset

To start this project (for example with 3 workers), run:

docker-compose up --build --scale worker=3

About


Languages

Language:Python 94.6%Language:Dockerfile 5.4%