sqoop

There are 5 repositories under sqoop topic.

• heibaiying / BigData-Notes

  大数据入门指南 :star:

  hadoophdfsyarnmapreducehivesparkstormhbasescalakafkazookeeperflumeazkabansqoopphoenixbigdatabig-data
  Language:Java 15339

• apache / sqoop

  Mirror of Apache Sqoop

  javabig-datasqoop
  Language:Java 966

• sunnyandgood / BigData

  💎🔥大数据学习笔记

  flumehadoophbasehdfshivelinuxmapreducemysqlshellsqoopzookeeper
  Language:Java 664

• WeBankFinTech / Exchangis

  Exchangis is a lightweight,highly extensible data exchange platform that supports data transmission between structured and unstructured heterogeneous data sources

  exchangisdataxtransmission-enginesqoopwedataspheredataspherestudiolinkisetlflink
  Language:Java 427
• bdp

  bluishglc / bdp

  A prototype project of big data platform, the source codes of the book Big Data Platform Architecture and Prototype

  bigdataprototypequickstartsparkspark-streamingspark-sqldemooozierediskafkaspark-demospark-streaming-examplessqoopsqoop-importsparksqlspark-examplesmiddle-endmiddle-office
  Language:Java 190

• aliyun / aliyun-maxcompute-data-collectors

  flumekettlesqoopoggbigdataaliyun-maxcompute
  Language:Java 114

• Pushkr / Apache-Spark-Hands-On

  Educational notes,Hands on problems w/ solutions for hadoop ecosystem

  hivehadoopflumesqoopclouderasparkcca175handsonbigdatabasicscheatsheet
  Language:Python 86

• dimajix / spark-training

  Repository used for Spark Trainings

  sparkpysparkspark-streamingspark-mlhadoophivesqoopscalapythonspark-traininghadoop-training
  Language:Jupyter Notebook 53

• v5tech / cloud

  云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件

  sqoopooziehbasehuehivezookeeperpigflumeflume-nghadoop
  Language:Shell 53

• Cigna / ibis

  IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.

  hadoophadoop-ecosystemhadoop-frameworkibisooziesqoopsqoop2ingestionworkflow-automationworkflow-schedulerworkflowcigna
  Language:Python 51

• maniram-yadav / Big_DataHadoop_Projects

  Big data projects implemented by Maniram yadav

  sparkpig-latinpighadoophdfssqoophivemapreducebig-data-analyticsbig-data-projectshadoop-mapreducehadoop-hdfsflume
  Language:PigLatin 49

• vivek2319 / Learn-Hadoop-and-Spark

  This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.

  hadoophadoop-filesystembigdatamapreducepigooziehivehbaseflumesqoopyarnhiveqlimpalaapache-kafkaapache-sparkapache-stormapache-solrapache-atlasapache-rangerapache-knox
  Language:Python 48

• mrugankray / Big-Data-Cluster

  The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center and pgAdmin. This cluster is solely intended for usage in a development environment. Do not use it to run any production workloads.

  airflowcassandraflumehadoophdfshivehuekafkapgadmin4postgresqlpysparksparksqoopzeppelinconda-environmentcontrol-centerkadminpython3schema-registry
  Language:Shell 41

• tejasjbansal / HELTHCARE-SYSTEM

  Data cleaning, pre-processing, and Analytics on a Health care data using Spark and Python.

  big-databig-data-projectshivepythonsparkspark-sqlsqoop
  Language:Jupyter Notebook 41

• Powerspace / pg2bq

  Export PostgreSQL tables to Google BigQuery

  postgresqlbigquerygcloudsqoop
  Language:Scala 37

• peiliping / meepo

  异构存储数据迁移

  dataxsqoopmysqlparquetroaringbitmap
  Language:Java 30

• san089 / Cloudera_Material

  Cloudera_Material: Study Material to help people preparing for Cloudera CCA Spark and Hadoop Developer Exam (CCA175). Feel free to collaborate.

  cca175clouderahadoopbig-databigdatahivesqoopsparkflumecertificationccapysparksqoop-importsqoop-exportsqoop-sessionhive-metastore
  29

• Mrkuhuo / bigdata_learning

  大数据组件学习代码

  flinkhadoopjavapythonsparkclickhousedataxdolphinschedulerdoriselasticsearchhbasehivehudiicebergcdh5sqoop
  Language:Java 23

• ven2day / Bigdata-docker-sandbox

  Docker Big Data Tools: This docker-compose file is configured to run multiple nodes. This is a Hadoop Cluster that contains the necessary tools that can be used in the BigData domain, It's a collection of docker containers that you can use directly.

  flinksparkhbasehadoopkafkasqoophivehuemysqlzookeepermongometabasestreamsetsstormnifi
  Language:VBA 22

• gouchaoer / Increment_Backup_To_Hive

  一个增量备份关系数据库(MySQL, PostgreSQL, SQL Server, SQLite, Oracle等)到hive的php脚本工具

  hivemysqlsqoopphp
  Language:PHP 20

• zenoyang / web-click-flow

  网站点击流离线日志分析

  hadoopmapreducehiveetlflumesqoop
  Language:Java 18

• Jayvardhan-Reddy / BigData-Ecosystem-Architecture

  Life-cycle: Internal working of HDFS, SQOOP, HIVE, SPARK, HBASE, KAFKA with code.

  sparkhadoop-ecosystemhadoopyarn-hadoop-clusterhadooparchitecturearchitecture-componentshivesqoophdfskafkaspark-streamingarchitecturebigdatabigdata-modulebig-databig-data-essentialshbasehbase-clusterzookeeper
  Language:Shell 15
• rdbms_to_hdfs_data_pipeline

  Pathairush / rdbms_to_hdfs_data_pipeline

  A data pipeline moving data from a Relational database system (RDBMS) to a Hadoop file system (HDFS).

  postgresqlsqoopsparkhivehadoopdocker
  Language:Python 13

• Pathairush / airflow_hive_spark_sqoop

  A docker using the airflow with Hadoop ecosystem (hive, spark, and sqoop)

  dockerairflowsparkhivesqoophadoop
  Language:Shell 11

• rss161030 / ETL-processes-using-Sqoop-Hadoop-Hive-Spark-and-Scala

  I implemented various ETL processes like loading the data using sqoop from mysql to hdfs, transform the data using Spark and Scala, perform analytics using Spark and Scala and loading the data back to HDFS.

  sparkscalasqoophdfs
  11

• conch-stack / conch-bigdata

  Big Data

  bigdatasoftware-engineerdata-sciencesparkhivehbaseflinkflumekafkahadoopsqoopambaricdhhdp
  Language:HTML 10

• milindjagre / HDPCD

  This repository contains all the documents related to HDPCD certification.

  apachepigpig-latinhdpcdbigdatahadoophivecertificationbigdatahortonworksflumesqoophcatalog
  Language:PigLatin 8

• Sathiyarajan / big-data-pipeline

  Big Data

  hadoopsparkkafkaflumehivejavascalahbasepigsqoopzookeeperhcatalogclouderapythonwindows-10ubuntu1804
  Language:Java 8

• avatime / gamul-gamul

  🏆가물가물 : 빅데이터 분산 처리를 활용한 물가기반 식재료 가격 정보 제공 웹앱 서비스 - 🥇SSAFY 7기 특화프로젝트 우수상 1등(2022.10.07)

  javatypescriptmysqljpahadoopmapreducehivehiveqlsqoopspring-bootspring-securityaws-s3swagger-uireactnextjsnext-pwamuidockerjenkinsnginx
  Language:Java 6

• bhvikp / sqoop-spark-hive

  MYSQL | SQOOP | SPARK | HIVE workflow

  sparksqoophivemysqlhiveql
  Language:Scala 6

• ghosh17 / Predictive-Analysis

  Predictive Analysis using Big Data platforms and Machine Learning Libraries

  predictive-analysissparkdatabig-datahadoopsqoopclustering-algorithmscala
  Language:Shell 6

• Madadata / hasoop

  Hasoop - Node.js client for Sqoop 2

  sqoopsqoop2hadooprest-api
  Language:JavaScript 6

• MehdiTAZI / BigData-Platform

  End to end big data project, that aims to show how to implement different big data layers, from the infrastructure layer to the end user one. [HADOOP][Spark][Kafka][Cassandra][Ansible][Jupyter][Docker]

  bigdatahadoopdatalakesqoopsparkhiveansibleimpaladockerhdfskafkaparquetflume
  Language:Jupyter Notebook 6

• melwinmpk / PizzaOrders_DataPipeline

  Pizza Orders Data Pipeline Usecase Solved by SQL, Sqoop, HDFS, Hive, Airflow.

  airflowpysparksqoopsqlhive
  Language:Python 6

• Stefen-Taime / ETL-Data-Pipeline-RDBMS-TO-HDFS-using-Airflow-Apache-Sqoop-Spark-Postgres-and-Hive

  This project aims to move the data from a Relational database system (RDBMS) to a Hadoop file system (HDFS)

  airflowbig-datadatadocker-composeetl-pipelinehdfshiveinfrastructure-as-coderdbmssparksqlsqoop
  Language:Python 6

• TritonDataCenter / hadoop-manta

  Hadoop Filesystem Driver for Manta

  hadoophadoop-filesystemmantajoyenttritondrillsqoop
  Language:Java 6