mmahmad / Crane

A distributed computation system, similar to Apache Storm (CS 425 semester project)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Distributed stream processing system

We need to run the failure detector in the protocol, hence we need to run the introducer from MP2 in the background.

Introducer

  • On VM1, run python introducer.py &> introducer.log & . The introducer listens for machines to connect to it.

Nimbus

  • On VM1 and VM2, run python nimbus.py to run the master and backup master

Crane-Client

  • On VM3, run the crane client (used to submit jobs) as python crane-client.py.
  • At the prompt, use start config_file_name to submit a Crane job

Workers

  • On the remaining VMs, run python worker.py. The workers then listen for jobs from the Nimbus

About

A distributed computation system, similar to Apache Storm (CS 425 semester project)


Languages

Language:Python 99.3%Language:Shell 0.7%