datax

There are 8 repositories under datax topic.

brokercap / Bifrost
Bifrost ---- 面向生产环境的 MySQL,MariaDB,kafka 同步到Redis,MongoDB,ClickHouse,StarRocks,Doris,Kafka等服务的异构中间件
mysqlbinlog mysql-redis mysql-mongodb go go-mysql go-mysqlbinlog mysql-kafka go-otter rabbitmq mongodb mysql gobinlog go-canal clickhouse datax dts datalink cdc-go
Language:Go 1897
birdLark / LarkMidTable
LarkMidTable 是一站式开源的数据中台，实现中台的基础建设，数据治理，数据开发，监控告警，数据服务，数据的可视化，实现高效赋能数据前台并提供数据服务的产品。
datax flink flink-cdc flink-sql flinkx seatunnel
Language:Java 1729
Addax
wgzhao / Addax
Addax is a versatile open-source ETL tool that can seamlessly transfer data between various RDBMS and NoSQL databases, making it an ideal solution for data migration.
hadoop hive database data-integrity clickhouse influxdb kudu mysql sqlserver trino excel impala oracle postgresql etl hdfs datax
Language:Java 1125
tis
datavane / tis
Support agile DataOps Based on Flink, DataX and Flink-CDC, Chunjun with Web-UI
java datax etl flink flink-streaming cdc dataops chunjun
Language:Java 941
WeBankFinTech / Exchangis
Exchangis is a lightweight,highly extensible data exchange platform that supports data transmission between structured and unstructured heterogeneous data sources
exchangis datax transmission-engine sqoop wedatasphere dataspherestudio linkis etl flink
Language:Java 442
TianLangStudio / DataXServer
为DataX(https://github.com/alibaba/DataX) 提供远程多语言调用（ThriftServer，HttpServer）分布式运行（DataX on YARN）功能
datax dataxserver thrift yarn dataxonyarn server thrift-server datax-server etl hamal data-hamal http http-server
Language:Scala 144
shardingsphere-jdbc-demo
makemyownlife / shardingsphere-jdbc-demo
shardingsphere jdbc 分库分表的实战例子，体系化实现分片 + 扩缩容 , 涉及到 shardingsphere、canal、datax、id生成器等知识点。您的 ⭐️ ⭐️⭐️Star⭐️⭐️ ⭐️，是我的动力！如果您觉得还不错，请点上一颗小星星
shardingsphere sharding-jdbc canal datax shardingsphere-jdbc shardingspheredemo
Language:Java 128
Kestrong / datax-elasticsearch
datax数据同步elasticsearch的reader和writer插件，支持一对多的扁平数据转换成es的嵌套对象，也支持嵌套对象的读取和ognl表达式过滤，理论上可以无限嵌套。
datax elasticsearch writer nested join reader ognl
Language:Java 85
thestyleofme / common-datax
基于DataX的通用数据同步微服务，一个Restful接口搞定所有通用数据同步
datax springboot2 mybatis hive freemarker azkaban redis dynamic-datasource mybatis-plus
Language:Java 53
thestyleofme / datax-admin
DataX分布式集群与负载均衡、任务执行/统计，基于DataX的通用数据同步微服务，一个Restful接口搞定所有通用数据同步
datax datax-server springboot2 mybatis-plus ribbon-client zookeeper
Language:Java 38
metaphysical-road / spring-cloud-alibaba-practice
Spring Cloud Alibaba微服务架构实战派，微服务架构最强实战案例分析
datax discovery elk nacos rocketmq seata sentinel skywalking spring springboot springcloudalibaba springcloudgateway elasticjob elasticsearch sharding-jdbc shardingsphere
Language:Java 34
Mrkuhuo / bigdata_learning
大数据组件学习代码
flink hadoop java python spark clickhouse datax dolphinscheduler doris elasticsearch hbase hive hudi iceberg cdh5 sqoop
Language:Java 30
peiliping / meepo
异构存储数据迁移
datax sqoop mysql parquet roaringbitmap
Language:Java 30
thestyleofme / DataX
DataX分布式集群化、自定义DataX插件、源码修改任务监控以及脏数据存表Hook
datax datax-hook
Language:Java 24
Arvin-Mark / DataX-src
DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。
datax mysql sqlserver postgre hdfs hive ads hbase ots odps etl oracle
Language:Java 23
wzqwtt / BigData
小白大数据学习笔记 :star:
bigdata hadoop hive hiveql zookeeper flume kafka spark datax flink hbase hdfs maxwell hbase-cluster java jvm scala big-data juc netty
Language:Java 22
duhanmin / datax-on-yarn
实现yarn客户端,datax-on-yarn可以让datax在yarn master上运行
yarn datax
Language:Java 16
codingmiao / datax-simple
一个datax的简化工具，帮助您轻量级的完成datax的二次开发和同步任务
datax
Language:Java 15
jiang3ye / hdfsreader
parquet for DataX - hdfsreader
parquet datax
Language:Java 13
TwoThreeWang / DataX_Python3
DataX 修改为 Python3
datax python3
Language:Python 13
VincentSleepless / datax_rediswriter
dataX redis writer plugin
datax redis codis
Language:Java 11
dodoyuan / docker-airflow-datax
airflow docker datax grpc
Language:Python 10
duhanmin / bigdata-sql-parser
数据血缘，支持spark sql,hive sql,pg sql,presto sql,mysql sql,tidb sql, flink sql, datax血缘,spark/flink jar 运行命令的血缘解析；支持with语法
spark presto tidb datax hive mysql postgresql flink trino
Language:Java 9
gindowcloud / datax
DataX Web 可视化任务管理
datax datax-web
Language:Vue 7
yasyx / datax-job-runner
Generate and run jobs of alibaba DataX3.0
datax
Language:Shell 6
Arvin-Mark / datax-bin
DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、OTS、ODPS 等各种异构数据源之间高效的数据同步功能。
datax mysql sqlserver postgre hdfs hive ads hbase ots odps etl oracle
Language:Python 5
wangshu-zhouyunfan / apsara
Open source bigdata platform solutions
bigdatacloud hadoop cdh datax griffin atlas scheduler incubator-dolphinscheduler ide dataservices cboard
5
fx67ll / fx67llBigData
Everything About BigData
hadoop hdfs yarn hive hbase spark bigdata zookeeper datax kafaka flink
Language:Java 4
AZHELLRGX / Big_Data_Study_Notes
大数据学习笔记(:zap:不断完善中:zap:)
scala spark flink hive hadoop hbase kafka datax
Language:Java 2
crabo / datax-incremental-load
Improve datax 3.0 for "continurous" running in a incremental mode
datax kafkawriter
Language:Java 2
xuanbo / DataX
DataX自定义插件
datax datax-plugin hive-reader
Language:Java 2
ah-hui / project-dev
spring-boot
spring-boot datax shiro resteasy
Language:Java 1
HanseyLee / DataX
Add mongodbreader mongodbwriter ssl supports to alibaba Datax
datax mongodb mongodbreader mongodbwriter ssl mongoclient
Language:Java 1
hexnn / balm
基于Spring Boot全家桶打造，大数据PAAS组件适配器，一键适配DolphinScheduler、Hadoop、Spark、Hive、Impala、HBase、Kafka、Doris、StarRocks、ClickHouse、Neo4j、Redis、ElasticSearch，通过标准REST接口和SQL语句操作，简单易用，方便二次开发和快速集成
clickhouse datax dolphinscheduler elasticsearch hadoop hbase hive impala kafka maxcompute neo4j presto spark starrocks phoenix doris sparksql sql
1
duanshuaimin / datax-web
datax web
datax
Language:Java
uptonking / datapoppin
data etl tool based on datax. forked from alibaba/DataX.
datax etl
Language:Java

datax

brokercap / Bifrost

birdLark / LarkMidTable

wgzhao / Addax

datavane / tis

WeBankFinTech / Exchangis

TianLangStudio / DataXServer

makemyownlife / shardingsphere-jdbc-demo

Kestrong / datax-elasticsearch

thestyleofme / common-datax

thestyleofme / datax-admin

metaphysical-road / spring-cloud-alibaba-practice

Mrkuhuo / bigdata_learning

peiliping / meepo

thestyleofme / DataX

Arvin-Mark / DataX-src

wzqwtt / BigData

duhanmin / datax-on-yarn

codingmiao / datax-simple

jiang3ye / hdfsreader

TwoThreeWang / DataX_Python3

VincentSleepless / datax_rediswriter

dodoyuan / docker-airflow-datax

duhanmin / bigdata-sql-parser

gindowcloud / datax

yasyx / datax-job-runner

Arvin-Mark / datax-bin

wangshu-zhouyunfan / apsara

fx67ll / fx67llBigData

AZHELLRGX / Big_Data_Study_Notes

crabo / datax-incremental-load

xuanbo / DataX

ah-hui / project-dev

HanseyLee / DataX

hexnn / balm

duanshuaimin / datax-web

uptonking / datapoppin