Developer-AD / SBDL

Spark Bulk Data Load. This is a data engineering project. Ingest the data from Hive tables present in the Master Data Management Platform and do the all processing in spark.

Geek Repo

Github PK Tool

data-engineering data-processing hive-table jenkins spark

SBDL

About

Spark Bulk Data Load. This is a data engineering project. Ingest the data from Hive tables present in the Master Data Management Platform and do the all processing in spark.

data-engineering data-processing hive-table jenkins spark

Languages

Language:Python 99.2%Language:Shell 0.8%