External Services Required
GitHub DockerHub, CircleCI
Dev Project
install rails, git, docker build the rails app test building and running it with a Dockerfile push changes to GitHub
Add confd
Ship App
wget https://github.com/kelseyhightower/confd/releases/download/v0.6.3/confd-0.6.3-linux-amd64
sudo mv confd-0.6.3-linux-amd64 /usr/local/bin/confd sudo chmod +x /usr/local/bin/confd
/etc/confd/conf.d/myconfig.toml
[template] src = "myconfig.conf.tmpl" dest = "/tmp/application.conf" keys = [ "/myapp/database/url", "/myapp/database/user", ]
epxort APPLICATION=bandj epxort DEPLOY_TYPE=staging confd -prefix=/$APPLICATION -onetime -backend etcd -node $COREOS_PRIVATE_IPV4:4001
CircleCI
create a circle.yml file in the project root add credentials to CircleCI account configure circle to push to Docker Hub on successful test of code
Ansible
Cluster Management
https://ivan-site.com/2014/10/auto-scaling-on-amazon-ec2-with-ansible/
Application Management
to manage CoreOS with fleetctl requires an external host that has the fleet binary installed binaries can be found here: https://github.com/coreos/fleet/releases
See: http://2mohitarora.blogspot.sg/2014/05/manage-docker-containers-using-coreos.html
CoreOS
Service files
See: https://coreos.com/docs/launching-containers/launching/getting-started-with-systemd/
/etc/systemd/system/ship.service
[Unit]
Description=Ship
After=docker.service
Requires=docker.service
[Service]
TimeoutStartSec=0
ExecStartPre=-/usr/bin/docker kill ship
ExecStartPre=-/usr/bin/docker rm ship
ExecStartPre=/usr/bin/docker pull rjayroach/ship
# Note: Remove the -d flag to docker run when running container from fleetctl
ExecStart=/usr/bin/docker run --name ship -d -p 3000:3000 rjayroach/ship
ExecStartPost=/usr/bin/etcdctl set /apps/ship/staging running
ExecStop=/usr/bin/docker stop ship
ExecStopPost=/usr/bin/etcdctl rm /apps/ship/staging
[Install]
WantedBy=multi-user.target
#Note: Replace the[Install] secition with [X-Fleet]
[X-Fleet]
X-Conflicts=ship@*.service
sudo systemctl enable /etc/systemd/system/ship.service
sudo systemctl start ship.service
sudo systemctl daemon-reload
journalctl -f -u ship
docker logs -f ship
Discovery URL
as per: https://coreos.com/docs/cluster-management/setup/cluster-discovery/
curl -w "\n" https://discovery.etcd.io/new
Fleet
core@ip-172-31-11-196 / $ cat /run/systemd/system/etcd.service.d/20-cloudinit.conf [Service] Environment="ETCD_ADDR=54.169.55.192:4001" Environment="ETCD_DISCOVERY=https://discovery.etcd.io/18513c6d0434eae1f0d5e5ba693a0fd7" Environment="ETCD_PEER_ADDR=54.169.55.192:7001"
cat /etc/machine-id
fleetctl
ssh-add ~/.ssh/test-ansible-keypair.pem fleetctl list-machines fleetctl ssh 79ed
fleetctl submit hello.service fleetctl list-unit-files fleetctl cat hello.service fleetctl load hello.service fleetctl list-unit-files fleetctl list-units
fleetctl start hello docker logs -f hello
fleetctl stop hello.service fleetctl unload hello.service fleetctl destroy hello.service
etcdctl
etcdctl ls /_etcd/machines --recursive
etcdctl ls / etcdctl ls /coreos.com --recursive etcdctl get /coreos.com/updateengine/rebootlock/semaphore
etcdctl mkdir /example
To make a key, you can use the mk command:
etcdctl mk /example/key data etcdctl ls /example etcdctl update /example/key turtles
OR use curl
curl -L http://127.0.0.1:4001/v2/keys/
curl -L http://127.0.0.1:4001/v2/stats/leader curl -L http://127.0.0.1:4001/v2/stats/self
Ansible
http://stackoverflow.com/questions/23945201/how-to-run-only-one-task-in-ansible-playbook
Dynamic Inventory
First, download the ec2.py script and ec2.ini file to your Ansible directory /etc/ansible: