charry (caosuwenwu)

caosuwenwu

Geek Repo

Location:hangzhou

Github PK Tool:Github PK Tool

charry's repositories

hera

hera 分布式任务调度系统(数据部门专用)

Language:JavaLicense:GPL-2.0Stargazers:2Issues:0Issues:0

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Language:PythonLicense:Apache-2.0Stargazers:1Issues:0Issues:0

DataX

DataX是阿里云DataWorks数据集成的开源版本。

Language:JavaLicense:NOASSERTIONStargazers:1Issues:0Issues:0

datax-service

针对datax进行2次开发,实现data 以rpc的方式传递json配置调用推数服务,同时修复datax多处bug。项目中也引入nacos作为服务的配置中心和注册中心; 同时项目内扩展了kafkawriter,rabbitmqwriter,esreader,hivereader。增强了hdfs插件,支持分区表推送,支持动态参数传递(例如时间实现自增式抽取)。具体使用方式可以参照example模块。目前该服务已经稳定服务某上市公司半年,累计总任务数100+ ,日推送数据过10亿。具体如何使用,如何做插件开发以及datax底层原理,请关注https://blog.csdn.net/xiaoyao1999hn

Language:JavaLicense:NOASSERTIONStargazers:1Issues:0Issues:0

dubbo-rest-example

dubbo rest filter

Language:JavaScriptLicense:MITStargazers:1Issues:0Issues:0

flink

Apache Flink

Language:JavaLicense:Apache-2.0Stargazers:1Issues:0Issues:0

hugegraph

HugeGraph Database core component, including graph engine, API, and built-in backends

Language:JavaLicense:Apache-2.0Stargazers:1Issues:0Issues:0

incubator-dolphinscheduler

Dolphin Scheduler is a distributed and easy-to-expand visual DAG workflow scheduling system, dedicated to solving the complex dependencies in data processing, making the scheduling system out of the box for data processing.(分布式易扩展的可视化工作流任务调度)

Language:JavaLicense:Apache-2.0Stargazers:1Issues:0Issues:0

mybatis-3

MyBatis SQL mapper framework for Java

Language:JavaLicense:Apache-2.0Stargazers:1Issues:1Issues:0

netty

Netty project - an event-driven asynchronous network application framework

Language:JavaLicense:Apache-2.0Stargazers:1Issues:0Issues:0

SpringBoot-Simple-Demo

开发模板:开发环境 IntelliJ IDEA JDK8 Maven 3.5.x lombok 1.16.18 使用框架 Spring Boot Swagger2 Druid Log4j2 MyBatis MyBatis Plus MySQL H2 Thymeleaf

Language:JavaStargazers:1Issues:1Issues:0

tunnel

PG数据同步工具(Java实现),支持hive

Language:JavaLicense:Apache-2.0Stargazers:1Issues:1Issues:0

xxl-rpc

源码解析(重点解析netty实战),A high performance, distributed RPC framework.(分布式服务框架XXL-RPC)

Language:JavaLicense:GPL-3.0Stargazers:1Issues:0Issues:0

zeus

taobao zeus 支持 Hadoop mr, hive, shel,前端界面用java(google富客户端gwt)写的,现在二次开发之后hera(https://github.com/scxwhite/hera)

Language:JavaStargazers:1Issues:0Issues:0

datax-distribute

datax 分布式服务:主要将job 和 taskGroup分拆在两个进程,采用rpc实现通信,就能达到分布式能力,避免单进程资源局限。

Stargazers:0Issues:1Issues:0

streamx

Make stream processing easier! Flink & Spark development scaffold, The original intention of StreamX is to make the development of Flink easier. StreamX focuses on the management of development phases and tasks. Our ultimate goal is to build a one-stop big data solution integrating stream processing, batch processing, data warehouse and data laker.

Language:ScalaLicense:Apache-2.0Stargazers:0Issues:0Issues:0

chronus

Chronus是360金融技术团队基于阿里开源项目-TBSchedule重写的分布式调度生产版本开源项目。

Language:JavaLicense:Apache-2.0Stargazers:0Issues:0Issues:0

chunjun

flinkx 数据交换同步

Language:JavaLicense:Apache-2.0Stargazers:0Issues:0Issues:0

CloudShuffleService

Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.

Language:JavaLicense:Apache-2.0Stargazers:0Issues:0Issues:0

datax-web

DataX集成可视化页面,选择数据源即可一键生成数据同步任务,支持RDBMS、Hive、HBase、ClickHouse、MongoDB等数据源,批量创建RDBMS数据同步任务,集成开源调度系统,支持分布式、增量同步数据、实时查看运行日志、监控执行器资源、KILL运行进程、数据源信息加密等。

Language:JavaLicense:MITStargazers:0Issues:0Issues:0

dubbo-study

手写dubbo框架

Language:JavaStargazers:0Issues:0Issues:0

flink-streaming-platform-web

基于flink-sql的实时流计算web平台

Language:JavaLicense:MITStargazers:0Issues:0Issues:0

FlinkSQL

仿照阿里blink使用sql开发flink的实时程序

Language:JavaLicense:Apache-2.0Stargazers:0Issues:0Issues:0

God-Of-BigData

学习之路

Stargazers:0Issues:0Issues:0

mysql-connector-j

MySQL Connector/J

Language:JavaLicense:NOASSERTIONStargazers:0Issues:0Issues:0

netty-to-dubbo

基于Netty手写Dubbo框架

Language:JavaStargazers:0Issues:0Issues:0

orc

Mirror of Apache Orc

Language:HTMLLicense:Apache-2.0Stargazers:0Issues:0Issues:0

spark_study

spark源码学习

License:Apache-2.0Stargazers:0Issues:0Issues:0

tinkerpop

Apache TinkerPop - a graph computing framework

Language:JavaLicense:Apache-2.0Stargazers:0Issues:0Issues:0