Giters

Coutj / Flume-Kafka-Teste

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Criar topico

    docker exec -it kafka /opt/bitnami/kafka/bin/kafka-topics.sh \
        --create \
        --bootstrap-server localhost:9092 \
        --replication-factor 1 \
        --partitions 1 \
        --topic test

Listar topicos

    docker exec -it kafka /opt/bitnami/kafka/bin/kafka-topics.sh \
        --list \
        --bootstrap-server localhost:9092

Producer

    docker exec -it kafka /opt/bitnami/kafka/bin/kafka-console-producer.sh \
        --broker-list localhost:9092 \
        --topic test

Consumer

    docker exec -it kafka /opt/bitnami/kafka/bin/kafka-console-consumer.sh \
        --bootstrap-server localhost:9092 \
        --topic test \
        --from-beginning

Gerando arquivos

    for i in 1 2 3 ; do curl http://metaphorpsum.com/sentences/3 >> file$i;done

Executando

    docker exec -it flume /bin/bash

O parametro name deve ser alterado de acordo com o arquivo .properties

    flume-ng agent --conf-file /opt/flume-config/flume.conf/spool-to-kafka.properties --name agent3 -Dflume.root.logger=WARN,console

About