danmeiyihen / maxwell

Maxwell's daemon, a mysql-to-json kafka producer

Home Page:http://maxwells-daemon.io/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

This is Maxwell's daemon, an application that reads MySQL binlogs and writes row updates as JSON to Kafka, Kinesis, or other streaming platforms. Maxwell has low operational overhead, requiring nothing but mysql and a place to write to. Its common use cases include ETL, cache building/expiring, metrics collection, search indexing and inter-service communication. Maxwell gives you some of the benefits of event sourcing without having to re-architect your entire platform.

Download:
https://github.com/zendesk/maxwell/releases/download/v1.22.4/maxwell-1.22.4.tar.gz
Source:
https://github.com/zendesk/maxwell

  mysql> insert into `test`.`maxwell` set id = 1, daemon = 'Stanislaw Lem';
  maxwell: {
    "database": "test",
    "table": "maxwell",
    "type": "insert",
    "ts": 1449786310,
    "xid": 940752,
    "commit": true,
    "data": { "id":1, "daemon": "Stanislaw Lem" }
  }
  mysql> update test.maxwell set daemon = 'firebus!  firebus!' where id = 1;
  maxwell: {
    "database": "test",
    "table": "maxwell",
    "type": "update",
    "ts": 1449786341,
    "xid": 940786,
    "commit": true,
    "data": {"id":1, "daemon": "Firebus!  Firebus!"},
    "old":  {"daemon": "Stanislaw Lem"}
  }

About

Maxwell's daemon, a mysql-to-json kafka producer

http://maxwells-daemon.io/

License:Other


Languages

Language:Java 78.9%Language:TSQL 15.7%Language:ANTLR 3.0%Language:Shell 1.1%Language:Ruby 0.9%Language:JavaScript 0.3%Language:Dockerfile 0.1%Language:Makefile 0.1%