Welbert Hime's repositories
covid19retail
Covid19 and Iowa Liquor Sales analysis at BigQuery using dbt, Airflow, Marquez, Google Cloud and other modern data stack tools
airflow_celery_workers
Airflow 2.0 configuration with Celery Executor based on Docker containers with Postgres and Redis broker plus Flower and Webserver UI
weather_gather
INMET weather data extraction, structuring and visualization with Docker, Apache Airflow, BigQuery and Apache Superset.
airport_streaming
A visualization of ANAC open database builded with Apache Airflow, PySpark, Docker, Terraform and GCP
gcp-terraform-airflow
Infrastructure of Airflow with Celery workers builded with Terraform resources based on GCP Compute Engine VM Instances
voc-person-detection
YOLO-Tiny and YOLO-Tiny + XNOR-Net person detection with Pascal VOC 2007 and 2012 datasets
ifood-data
Ifood data wrangling with Apache Airflow and Apache Spark running on Kubernetes
java-virtual-machine
Hardware description of a JVM with a reduced set of instructions implemented in VHDL
trending-explorer
Extraction and data wrangling from Twitter API with Apache Airflow, PySpark and DeltaLake
aws-serverless
Event driven data pipeline processing data from S3 to Athena with Lambda functions, SQS queues, Glue metastore/jobs
cats_and_dogs
The classic cats and dogs image classification with Keras and Tensorflow
github-sink
Silly extraction and parsing of data from Github API to sinks like Console, File, MongoDB and Kafka
himewel.github.io
Minimal landing page for developers
kind-airflow
Apache Airflow helm chart environment running on local kubernetes (kind) with docker abstraction
scala-projects
A project to store my fundamentals study in Scala
sentiment-analysis
Sentiment analysis with pre trained FastText model, with a Flask API and multiple deploy options in Google Cloud
trip-analysis
BigQuery data ingestion using PubSub and Cloud Functions
weather_pubsub
Weather data ingested in Kafka broker and processed with Spark Streaming