kyleiwaniec / w205Project

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

#Please see the wiki for full project details and documentation

##QUICK SETUP INSTRUCTIONS##

###With a brand new instance and volume: ### follow these steps in order:

use this AMI:
w205Project_V2.0

create a new m3.large instance with security group containing:

Ports	Protocol	Source	tableau
4040	tcp	0.0.0.0/0	✔
50070	tcp	0.0.0.0/0	✔
8080	tcp	0.0.0.0/0	✔
22		tcp	0.0.0.0/0	✔
10000	tcp	0.0.0.0/0	✔
8020	tcp	0.0.0.0/0	✔
8088	tcp	0.0.0.0/0	✔

Attach a 100GB Volume in the same region
ssh into your instance

ssh -i "xxx.pem" root@ec2-xx-x-xxx-xx.compute-1.amazonaws.com
fdisk -l
wget https://s3-us-west-2.amazonaws.com/w205twitterproject/provision.sh
. provision.sh <DEVICE PATH> # run once - this may take several mintes...

then run your personal git-keys script, or however you want to authorize git.
here is a template, if you know what yer keys are: git-keys-template.sh

vi git-keys.sh # copypasta from the template
. git-keys.sh
cd /data
git clone git@github.com:kyleiwaniec/w205Project.git

pull the repo, then run:

cd /data/w205Project
. provision/bootstrap.sh # this may take several minutes...

You will be prompted to add your Twitter keys and AWS keys in the bootstrap script.

Run the scheduler:

crontab cron/simple_sched_cron.txt

Watch it here: tail -f /data/cronlog.log


GO TO YOUR INSTANCE's DASHBOARD:
http://ec2-xx-x-xxx-xx.compute-1.amazonaws.com:10000/dashboard/


INSTALL PLUGIN:
Drag and drop the chromeExtension.crx file into your chrome browser, and follow the prompts.

About


Languages

Language:Scala 33.3%Language:Shell 24.8%Language:Python 16.9%Language:R 14.8%Language:SQLPL 5.1%Language:JavaScript 2.2%Language:CSS 2.0%Language:PLpgSQL 0.5%Language:HTML 0.3%