stefanprodan / swarmprom

Docker Swarm instrumentation with Prometheus, Grafana, cAdvisor, Node Exporter and Alert Manager

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Disk space

ruudboon opened this issue · comments

Thank you for this awesome project. It runs smooth on my swarm. Only one thing doesn't work for me. The disk space always show N/A. Is there a way to debug this?

I think the mapping in the default dashboard is wrong.

sum(node_filesystem_size_bytes{mountpoint="/"} * on(instance) group_left(node_name) node_meta{node_id=~"$node_id"})

must be sum(node_filesystem_size_bytes{mountpoint="/rootfs"} * on(instance) group_left(node_name) node_meta{node_id=~"$node_id"})

because the mapping in the docker file is:
- /proc:/host/proc:ro - /sys:/host/sys:ro - /:/rootfs:ro

when I changed this I get useful data

I have two nodes currently and I experience the same problem with one of my nodes. For the other one both "/" and "/rootfs" show the same size:

Element Value
node_filesystem_size_bytes{device="/dev/mapper/iot--02--vg-root",fstype="ext4",instance="10.0.7.140:9100",job="node-exporter",mountpoint="/rootfs"} 16586760192
node_filesystem_size_bytes{device="/dev/sda1",fstype="ext2",instance="10.0.7.140:9100",job="node-exporter",mountpoint="/rootfs/boot"} 246755328
node_filesystem_size_bytes{device="/dev/sda1",fstype="ext4",instance="10.0.7.147:9100",job="node-exporter",mountpoint="/rootfs"} 18888736768
node_filesystem_size_bytes{device="none",fstype="aufs",instance="10.0.7.147:9100",job="node-exporter",mountpoint="/"} 18888736768

It seems to be correct to switch the queries to mountpoint="/rootfs" as @mwolf1989 stated.