janaom's repositories

gcp-data-engineering-etl-with-composer-dataflow

This project leverages GCS, Composer, Dataflow, BigQuery, and Looker on Google Cloud Platform (GCP) to build a robust data engineering solution for processing, storing, and reporting daily transaction data in the online food delivery industry.

Language:PythonStargazers:17Issues:1Issues:0

GCP-DE-project-uber-etl-pipeline

Technologies used: GCS, Compute Engine, Mage, BigQuery, Looker, Python

Language:Jupyter NotebookStargazers:8Issues:1Issues:0

KodeKloud-Engineer-2.0

Solutions for the KodeKloud Engineer 2.0 tasks.

Stargazers:8Issues:0Issues:0

gcp-de-project-streaming-pubsub-beam-dataflow

This project demonstrates an end-to-end solution for processing and analyzing real-time conversations data from a JSON file using GCP services and infrastructure automation, showcasing data storage, streaming, processing, and analysis at scale.

Language:PythonStargazers:7Issues:1Issues:0

Meta-Database-Engineer-Professional-Certificate

Labs from Meta Database Engineer Professional Certificate on Coursera

Stargazers:2Issues:0Issues:0

gcp-de-project-weather-forecast-sms-with-airflow

This project was born out of the need to know the weather forecast for Paris/Vilnius while attending the KubeCon Europe conference. Fetches next-day forecast for Paris and Vilnius using a weather API, securely stores data in GCS bucket, and sends personalized SMS updates via Twilio. Powered by GCP and automated with Composer/Airflow

Language:PythonStargazers:1Issues:1Issues:0

airflow-cert-dag-authoring

Course notes for the Astronomer Certification DAG Authoring for Apache Airflow

Language:PythonStargazers:0Issues:0Issues:0

Apache-Beam-practice

It's time to learn Beam! This repository contains a collection of tasks and exercises focused on Apache Beam.

Language:Jupyter NotebookStargazers:0Issues:0Issues:0

GCP-BigQuery-Project-Exploring-Londons-Travel-Network

Use BigQuery to build a project. Use SQL to analyze a database containing information about Transport for London journeys over 12 years

Stargazers:0Issues:0Issues:0

gcp-de-project-connect-four-with-python-dataflow

Connect Four Data Engineering Project: leveraging GCS for scalable and durable storage, Dataflow for data extraction and transformation, BigQuery as the data repository, Slack Integration for real-time sharing, Looker for insightful reports and visualizations, and Email Scheduler for automated report delivery.

Language:PythonStargazers:0Issues:1Issues:0

airflow-vars-conn-secret-manager

This RP highlights the importance of securing Airflow variables and connections using GCP Secret Manager.

Language:PythonStargazers:0Issues:1Issues:0

Automating-Real-World-Tasks-with-Python

Solutions for the final course "Automating Real-World Problems with Python" from the course Google IT Automation with Python Professional Certificate

Language:PythonStargazers:0Issues:0Issues:0

certified-kubernetes-administrator-course

Certified Kubernetes Administrator - CKA Course

Stargazers:0Issues:0Issues:0
Language:JavaLicense:Apache-2.0Stargazers:0Issues:0Issues:0

devops-exercises

Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions

Language:PythonLicense:NOASSERTIONStargazers:0Issues:0Issues:0

diveintoansible

Content for DiveInto.com's 'Dive Into Ansible' Course

Language:JinjaStargazers:0Issues:0Issues:0

example-voting-app

Example distributed app composed of multiple containers for Docker, Compose, Swarm, and Kubernetes

License:Apache-2.0Stargazers:0Issues:0Issues:0
Stargazers:0Issues:0Issues:0

gcp-de-project-data-pipeline-with-cloud-run-functions-airflow-biggueryml

Build a data pipeline on Google Cloud using an event-driven architecture, leveraging GCS, Cloud Run functions, and BigQuery. Explore both VM and Composer options for Airflow management, and utilize Logging & Monitoring for pipeline health. Discover how SQL-based BigQuery ML can be used for initial ML implementation in specific scenarios.

Language:PythonStargazers:0Issues:0Issues:0
Language:DockerfileStargazers:0Issues:0Issues:0

gcp-notes

A comprehensive RP of notes, tutorials, and practical tasks to facilitate learning and mastery of Google Cloud Platform (GCP)

Language:PythonStargazers:0Issues:1Issues:0
Stargazers:0Issues:1Issues:0

it-cert-automation-practice

Google IT Automation with Python Professional Certificate - Practice files

License:Apache-2.0Stargazers:0Issues:0Issues:0

janaom

Config files for my GitHub profile.

Stargazers:0Issues:0Issues:0

Kubernetes-and-Cloud-Native-Associate-KCNA

Useful notes for the KCNA - Kubernetes and Cloud Native Associate

License:Apache-2.0Stargazers:0Issues:0Issues:0

kubernetes-learning-path

A roadmap to learn Kubernetes from scratch (Beginner to Advanced level)

Stargazers:0Issues:0Issues:0

learn-cantrill-io-labs

Standard and Advanced Demos for learn.cantrill.io courses

License:MITStargazers:0Issues:0Issues:0

Python-Pandas-Data-Science-Tutorial

Python Pandas Data Science Tutorial (Read CSV/Excel, add/delete columns, Filter, Groupby, Slice)

Language:Jupyter NotebookStargazers:0Issues:0Issues:0
Language:PythonStargazers:0Issues:0Issues:0

terraform-zero-to-hero

Master Terraform in 7 days using this Zero to Hero course.

Stargazers:0Issues:0Issues:0