Okza Pradhana's repositories
etl-flatfile-airflow
Building Data Warehouse on BigQuery which takes flat file as the data sources with Airflow as the Orchestrator
cloud-flower
Batch ETL using Cloud Environment which is GCP by utilizing Cloud Composer + Google Cloud Storage + Dataflow + Cloud Build
indonesia-city-geojson
This repo contains all Indonesia's cities in GeoJSON format. You may visit http://geojson.io/ to see this geojson on map view
jobstreet-scrapper
Command Line Based Tool for scrap job/vacancy data from JobStreet website.
data-engineering-zoomcamp
My works on Data Engineering Zoomcamp 2024
data-pipeline-python
Implementation of simple Data Pipeline using Python. This repo is used as demo in my workshop at DE-Kita Whatsapp Group
pubsub-gatekeeper-api
API endpoint to validate and process incoming message that comes from Backend Team to our Database. It is similar to CDC process that empowers message queue with help from Google PubSub
taxi-trip-assignment
Hacktiv8 assignment for Data Engineer Instructor (Part Time)
beginner-kafka-infra
Minimal infra setup to supports Journey on learning Kafka with Java
beginner-kafka-java
My journey of learning Kafka with Java as programming language by following the course from https://www.udemy.com/course/apache-kafka/ with adjustments due to versions discrepancy
cassandra-playground
Spin up your Cassandra cluster with UI Client in local less than 5 minutes with just one command!
dataproc-spark-processing
Contains PySpark jobs to do batch processing from GCS to BigQuery & GCS to GCS and also bash script to perform end to end Dataproc process from creating cluster, submitting jobs and delete cluster.
belajar-kubernetes
Berisi hasil belajar kubernetes untuk keperluan deploying & scaling service
Covid19-API
Covid19 API. (Currently Scrapes: worldometers)
dibimbing-web-scraping-demo
To accomodate practical session of dibimbing DE 2nd Batch about Web Scraping
free-programming-books
:books: Freely available programming books
generathon
Synthetic data generator about participant's registration on DQLab hackathon event named DQThon
git-101-demo
For Data Engineering Indonesia workshop about Git 101 for Data Engineers
learn-dbt-cloud-course
Journey of learning at https://courses.getdbt.com by utilizing https://cloud.getdbt.com/ as managed dbt
okzapradhana
Config files for my GitHub profile.
zsh-autosuggestions
Fish-like autosuggestions for zsh