beckbikang / ho

i need a server to write mc into kafka in an easy way

ho

features

• ✅ a simple mc server use this library
• ✅ write data into kafka which use mc protocol.
• ✅ write data into kafka which use redis protocol.
• ✅ trans data from kafka to kafka
• trans kafka to elasticsearch

a simple mc server

run server like this

• ./ho mc-server -p /you config file path/golang/ho/configs -f config-mc-server.toml

connect server

• telnet 127.0.0.1 9190

set data

• set tom 0 1200 3

get data

• get tom

mc send to kafka

run server ./ho mc kafka -p /xxx/golang/ho/configs -f config-dev.toml

connect server

• telnet 127.0.0.1 9191

set data

• set topic_name 0 1200 3

kafka config

title="mc-to-kafka"
[main]
serverIp="127.0.0.1"
serverPort=9191
mainLogPath="/tmp/ho_mc_2_kafka"
mainLogModel=3 

[kafkas]
    [kafkas.test_mc]
    brokers=["tt.com:18888"]
    topic="test_mc"
    group=""
    sslEnable=false
    user=""
    password=""
    producerOn=true
    [kafkas.test_mc2]
    brokers=["tt.com:18888"]
    topic="test_mc2"
    group=""
    sslEnable=false
    user=""
    password=""
    producerOn=true

kafka consume result:

redis send to kafka

run server

./ho redis kafka -p /xxxx/golang/ho/configs -f config-dev-redis.toml

connect server

• telnet 127.0.0.1 9192

set data

• set test_mc 123456

kafka config

title="redis-to-kafka"
[main]
serverIp="127.0.0.1"
serverPort=9192
mainLogPath="/tmp/ho_redis_2_kafka"
mainLogModel=3 

[kafkas]
    [kafkas.test_mc]
    brokers=["tt.com:18888"]
    topic="test_mc"
    group=""
    sslEnable=false
    user=""
    password=""
    producerOn=true
    [kafkas.test_mc2]
    brokers=["tt.com:18888"]
    topic="test_mc2"
    group=""
    sslEnable=false
    user=""
    password=""
    producerOn=true

kafka consume result:

kafka to kafka

1. simple config

title="kafka-to-kafka"
[main]
serverIp="127.0.0.1"
serverPort=9193
mainLogPath="/tmp/ho_kafka_2_kafka"
mainLogModel=3
showSaramaDebug=true
[kafkas]
    [kafkas.test_mc]
    brokers=["tt.com:18888"]
    topic="test_mc"
    group="test"
    sslEnable=false
    user=""
    password=""
    producerOn=false
    [kafkas.test_mc2]
    brokers=["tt.com:18888"]
    topic="test_mc2"
    group=""
    sslEnable=false
    user=""
    password=""
    producerOn=true

2. run server

./ho kafka -p /you config file path/golang/ho/configs -f config-dev-kafka-2kafka.toml -r test_mc -t test_mc2

3. push data into kafka

dependent on

a memmcache server: go-memcache

a common framework: ngo

a redis server:redcon