crypdick / ray-data-map-reduce

Example using Ray Data to perform a map-reduce job with AggregateFn.

Repository from Github https://github.comcrypdick/ray-data-map-reduceRepository from Github https://github.comcrypdick/ray-data-map-reduce

ray-data-map-reduce

Overview

This project demonstrates how to use Ray Data to perform a map-reduce job with AggregateFn.

Accompanying blog post: Guide to Map-Reduce Jobs in Ray Data

Dependencies

pip install -r requirements.txt

Usage

python map_reduce_bigrams.py

About

Example using Ray Data to perform a map-reduce job with AggregateFn.


Languages

Language:Python 100.0%