justinledwards / vmware-filesd

Prometheus file service discovery for vsphere VMs

This is a file discovery implementation utilizing VMware tags for Prometheus discovery

This repository utilizes code from Ansible VMware inventory and has been modified to work for Prometheus. It can be slow in large vmware environments.

An example of how to use it for Promethues operator:

kind: Prometheus
metadata:
  labels:
    prometheus: monitoring-prometheus-filesd
  name: monitoring-prometheus-filesd
spec:
  containers:
    - name: file-sd
      image: vmware-filesd
      env:
        - name: HOSTNAME
          value: ""
        - name: USERNAME
          value: ""
        - name: PASSWORD
          value: ""
        - name: FILENAME
          value: "/opt/config/output.json"
      volumeMounts:
      - name: config-out
        mountPath: /opt/config
        readOnly: false
  securityContext:
    fsGroup: 2000
    runAsNonRoot: true
    runAsUser: 1000
  serviceAccountName: monitoring-prometheus-oper-prometheus
  serviceMonitorNamespaceSelector: {}
  serviceMonitorSelector:
    matchLabels:
      release: filesd-test
  replicas: 1
  alerting:
    alertmanagers:
    - namespace: default
      name: monitoring-prometheus-oper-alertmanager
      port: web
  additionalScrapeConfigs:
    name: monitoring-prometheus-oper-prometheus-scrape-confg
    key: additional-scrape-configs.yaml

Example output

[
    {
        "targets": [
            "example_host_2"
        ],
        "labels": [
            {
                "tag": "QA"
            },
            {
                "tag": "Linux"
            },
            {
                "tag": "Tomcat"
            },
            {
                "tag": "NFS"
            },
            {
                "address": "192.168.1.245"
            }
        ]
    }
]

Prometheus will read this output as a file discovery. It can be imported and relabled like the following:

- job_name: 'vmware_filesd'
  scrape_interval: 30s
  file_sd_configs:
    - files:
        - /etc/prometheus/config_out/output.json
  relabel_configs:
  - source_labels: [__address__]
    target_label: instance
  - source_labels: [address]
    target_label:  __address__
    replacement:   '${1}:9100'

It can also be called from the commandline directly: python3 dynamic.py --hostname $HOSTNAME --username $USERNAME --password $PASSWORD --file $FILENAME --loop