calo81 / vagrant-hadoop-cluster

Deploying hadoop in a virtualized cluster in simple steps

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

vagrant-hadoop-cluster

Deploying hadoop in a virtualized cluster in simple steps

These are the files that support the blogpost http://cscarioni.blogspot.co.uk/2012/09/setting-up-hadoop-virtual-cluster-with.html

For using them.

Simply clone the repository, then

gem install vagrant

vagrant box add base-hadoop http://files.vagrantup.com/lucid64.box

Maybe generate your own ssh-keygen pair of keys.. and replace them in the files id_rsa and id_rsa.pub in the modules/hadoop/files directory. Or for testing copy the provided id_rsa and id_rsa.pub into your .ssh directory.

vagrant up

then

vagrant ssh master

cd /opt/hadoop-xxx/bin

./hadoop namenode -format

./start-all

About

Deploying hadoop in a virtualized cluster in simple steps


Languages

Language:Puppet 40.5%Language:Ruby 37.7%Language:Shell 21.8%