okzapradhana

Okza Pradhana's repositories

etl-flatfile-airflow

Building Data Warehouse on BigQuery which takes flat file as the data sources with Airflow as the Orchestrator

Language:Python10 20

cloud-flower

Batch ETL using Cloud Environment which is GCP by utilizing Cloud Composer + Google Cloud Storage + Dataflow + Cloud Build

Language:Python6 20

indonesia-city-geojson

This repo contains all Indonesia's cities in GeoJSON format. You may visit http://geojson.io/ to see this geojson on map view

Language:JavaScript6 20

jobstreet-scrapper

Command Line Based Tool for scrap job/vacancy data from JobStreet website.

Language:Python6 20

data-engineering-zoomcamp

My works on Data Engineering Zoomcamp 2024

Language:Python3 10

data-pipeline-python

Implementation of simple Data Pipeline using Python. This repo is used as demo in my workshop at DE-Kita Whatsapp Group

Language:Python3 20

pubsub-gatekeeper-api

API endpoint to validate and process incoming message that comes from Backend Team to our Database. It is similar to CDC process that empowers message queue with help from Google PubSub

Language:Python1 20

Python

All Algorithms implemented in Python

Language:PythonMIT1 10

taxi-trip-assignment

Hacktiv8 assignment for Data Engineer Instructor (Part Time)

Language:Python1 20

beginner-kafka-infra

Minimal infra setup to supports Journey on learning Kafka with Java

010

beginner-kafka-java

My journey of learning Kafka with Java as programming language by following the course from https://www.udemy.com/course/apache-kafka/ with adjustments due to versions discrepancy

Language:Java010

cassandra-playground

Spin up your Cassandra cluster with UI Client in local less than 5 minutes with just one command!

Language:HCL010

dataproc-spark-processing

Contains PySpark jobs to do batch processing from GCS to BigQuery & GCS to GCS and also bash script to perform end to end Dataproc process from creating cluster, submitting jobs and delete cluster.

Language:Python020