flume

There are 10 repositories under flume topic.

heibaiying / BigData-Notes
大数据入门指南 :star:
hadoop hdfs yarn mapreduce hive spark storm hbase scala kafka zookeeper flume azkaban sqoop phoenix bigdata big-data
Language:Java 15266
wangzhiwubigdata / God-Of-BigData
专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
flink spark hadoop hdfs hive hbase kafka zookeeper bigdata flume azkaban
9267
apache / logging-flume
Mirror of Apache Flume
big-data flume java
Language:Java 2501
MoRan1607 / BigDataGuide
大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料
hadoop zookeeper hive flume kafka hbase spark flink scala bigdata javase
Language:Java 2490
chrisjpatty / flume
Extract logic from your apps with a user-friendly node editor powered by React.
flume javascript node react
Language:TypeScript 1327
OBenner / data-engineering-interview-questions
More than 2000+ Data engineer interview questions.
data-engineering interview-questions interview hadoop hadoop-hdfs spark flink sql kafka hive impala airflow aws azure cassandra flume hbase avro nifi data-structures
782
sunnyandgood / BigData
💎🔥大数据学习笔记
hadoop hive hbase hdfs zookeeper sqoop mapreduce flume mysql linux shell
Language:Java 663
xander-wang / logvision
分布式实时日志分析与入侵检测系统
spark streaming-logvision flume flask-web redis
Language:JavaScript 186
aliyun / aliyun-maxcompute-data-collectors
flume kettle sqoop ogg bigdata aliyun-maxcompute
Language:Java 113
wangj1106 / recommendMoteur
电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎
recommendation-engine recommender-system recommendation movies als spark spark-streaming spark-sql flume kafka
Language:Scala 113
soniclavier / bigdata-notebook
bigdata flink flume hadoop kafka machine-learning spark storm streaming
Language:Scala 105
233zzh / TitanDataOperationSystem
最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web系统，然后用flume-kafaka-flume进行日志的读取，在hive设计数仓，编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移，使用azkaban进行定时任务的调度，使用技术：Java/Scala语言，Hadoop、Spark、Hive、Kafka、Flume、Azkaban、SpringBoot，Bootstrap， Echart等；
hadoop spark hive kafka flume azkaban
Language:JavaScript 100
tlhhup / litemall-dw
基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；数据仓库(五层)、实时计算和用户画像。大数据平台采用CDH6.3.2(已使用vagrant+ansible脚本化)，同时也包含了Azkaban的workflow。
kafka hbase cdh6 vagrant openresty lua shell spring-boot hive scala flume azkaban redis oozie maxwell flink clickhouse atlas ranger spark
Language:Java 91
Pushkr / Apache-Spark-Hands-On
Educational notes,Hands on problems w/ solutions for hadoop ecosystem
hive hadoop flume sqoop cloudera spark cca175 handson bigdata basics cheatsheet
Language:Python 86
leonlee / flume-ng-mongodb-sink
Flume NG MongoDB source.
flume sink mongodb
Language:Java 71
zdkzdk / aaocp
一个对用户行为日志进行分析的大数据项目
spark hbase hive hadoop hdfs flume nginx zookeeper echarts
Language:PLpgSQL 67
jcustenborder / flume-ng-rabbitmq
Flume plugin for RabbitMQ
flume rabbitmq
Language:Java 59
lackhurt / flume-canal-source
Flume NG Canal source
canal flume binlog kafka elasticsearch hdfs mq mysql
Language:Java 56
pkeropen / BigData-News
基于Spark2.2新闻网大数据实时系统项目
spark sturctured-streaming hadoop cdh5 hive hbase kafka flume
Language:Scala 55
v5tech / cloud
云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件
sqoop oozie hbase hue hive zookeeper pig flume flume-ng hadoop
Language:Shell 53
vivek2319 / Learn-Hadoop-and-Spark
This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.
hadoop hadoop-filesystem bigdata mapreduce pig oozie hive hbase flume sqoop yarn hiveql impala apache-kafka apache-spark apache-storm apache-solr apache-atlas apache-ranger apache-knox
Language:Python 48
maniram-yadav / Big_DataHadoop_Projects
Big data projects implemented by Maniram yadav
spark pig-latin pig hadoop hdfs sqoop hive mapreduce big-data-analytics big-data-projects hadoop-mapreduce hadoop-hdfs flume
Language:PigLatin 47
Wanfengyueluo / BookRecommenderSystem
基于大数据的图书推荐系统
springboot vue element-ui kafka redis spark mongodb flume azkaban
46
cognitree / flume-elasticsearch-sink
Flume sink plugin for Elasticsearch
flume-sink-plugin elasticsearch-sink flume elasticsearch
Language:Java 42
mrugankray / Big-Data-Cluster
The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center and pgAdmin. This cluster is solely intended for usage in a development environment. Do not use it to run any production workloads.
airflow cassandra flume hadoop hdfs hive hue kafka pgadmin4 postgresql pyspark spark sqoop zeppelin conda-environment control-center kadmin python3 schema-registry
Language:Shell 39
29DCH / Real-time-log-analysis-system
:penguin:基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)
echarts flume hbase java kafka scala spark-streaming spring-boot
Language:Java 33
san089 / Cloudera_Material
Cloudera_Material: Study Material to help people preparing for Cloudera CCA Spark and Hadoop Developer Exam (CCA175). Feel free to collaborate.
cca175 cloudera hadoop big-data bigdata hive sqoop spark flume certification cca pyspark sqoop-import sqoop-export sqoop-session hive-metastore
28
shubhamgosain / twitter-Sentiment-Analysis-using-hadoop
A Project where one can fetch and read tweets and show the analysis like who is most influential
twitter twitter-api big-data bigdata hadoop flume hive hiveserver2 docker mysql
Language:Shell 26
damaohongtu / full-bigdata-docker
docker搭建大数据平台(我的第一本书)
spark kafka flume zookeeper hadoop hive mysql hbase yarn bigdata docker
Language:Shell 25
OrangeDrk / JavaNotes
Java后端学习笔记。包括Linux、maven、git、互联网架构、大数据体系等
javaee javase linux spring spring-boot mybatis springcloud git maven redis mycat rabbitmq zookeeper hadoop hdfs mapreduce hive hbase flume kafka
24
fluent / fluent-plugin-flume
Flume input and output plugin for Fluentd
fluentd fluentd-plugin flume
Language:Ruby 23
wzqwtt / BigData
小白大数据学习笔记 :star:
bigdata hadoop hive hiveql zookeeper flume kafka spark datax flink hbase hdfs maxwell hbase-cluster java jvm scala big-data juc netty
Language:Java 22
peiliping / logwatch
日志采集工具
log lua kafka regex logwatch flume logstash grok rdkafka filebeats fluentd
Language:Lua 21
windwant / bigdata-service
hadoop flume hbase kafka storm；读取kafka数据=》storm实时处理（分割字符，统计字符）=》写入hdfs
hadoop flume hbase kafka storm
Language:Java 21
Captain-SpongeBob / MovieRecommendSystem
电影推荐系统，包括基于ALS、LFM的离线推荐、实时推荐，基于Spark
spark kafka sparkstreaming redis flume mongodb movielens
Language:Scala 20
tim-chow / log-parser
一个基于Python和Flume的日志收集和解析系统
python flume log-parser
Language:Python 20

flume

heibaiying / BigData-Notes

wangzhiwubigdata / God-Of-BigData

apache / logging-flume

MoRan1607 / BigDataGuide

chrisjpatty / flume

OBenner / data-engineering-interview-questions

sunnyandgood / BigData

xander-wang / logvision

aliyun / aliyun-maxcompute-data-collectors

wangj1106 / recommendMoteur

soniclavier / bigdata-notebook

233zzh / TitanDataOperationSystem

tlhhup / litemall-dw

Pushkr / Apache-Spark-Hands-On

leonlee / flume-ng-mongodb-sink

zdkzdk / aaocp

jcustenborder / flume-ng-rabbitmq

lackhurt / flume-canal-source

pkeropen / BigData-News

v5tech / cloud

vivek2319 / Learn-Hadoop-and-Spark

maniram-yadav / Big_DataHadoop_Projects

Wanfengyueluo / BookRecommenderSystem

cognitree / flume-elasticsearch-sink

mrugankray / Big-Data-Cluster

29DCH / Real-time-log-analysis-system

san089 / Cloudera_Material

shubhamgosain / twitter-Sentiment-Analysis-using-hadoop

damaohongtu / full-bigdata-docker

OrangeDrk / JavaNotes

fluent / fluent-plugin-flume

wzqwtt / BigData

peiliping / logwatch

windwant / bigdata-service

Captain-SpongeBob / MovieRecommendSystem

tim-chow / log-parser