Albert Franzi's repositories
mlflow-workshop
First steps to interact with MLflow (mlflow.org)
mini-data-platform
Mini Data Platform
pytest-dbt-postgres
Unittest DBT Postgres projects
airflow-aws-shared-secrets
SecretsManagerBackend with cross-account access
awesome-spark
A curated list of awesome Apache Spark packages and resources.
rabbitmq-poc
Notification System PoC with Delayed/Expired queues.
airbyte
Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.
aws-glue-data-catalog-client-for-apache-hive-metastore
The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog as a central repository to store structural and operational metadata for their data. AWS Glue provides out-of-box integration with Amazon EMR that enables customers to use the AWS Glue Data Catalog as an external Hive Metastore. This is an open-source implementation of the Apache Hive Metastore client on Amazon EMR clusters that uses the AWS Glue Data Catalog as an external Hive Metastore. It serves as a reference implementation for building a Hive Metastore-compatible client that connects to the AWS Glue Data Catalog. It may be ported to other Hive Metastore-compatible platforms such as other Hadoop and Apache Spark distributions
data-access-layer
Library to facilitate accessing Data from Databricks
datahub
A Generalized Metadata Search & Discovery Tool
datahub-helm
Repository of helm charts for deploying DataHub on a Kubernetes cluster
dbt-core
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
elementary
Open-source data observability for analytics engineers.
helm-charts
Lightdash Community helm charts
json-schema
JSON Schema validator for java, based on the org.json API
kafdrop
Kafka Web UI
kafka-connect-field-and-time-partitioner
Kafka Connect Store Partitioner by a custom field and time
prefect
The easiest way to automate your data
prefect-poc
Prefect Flow Evaluation
presto
Distributed SQL query engine for big data
quinn
pyspark methods to enhance developer productivity 📣 👯 🎉
redis-poc
Notification System PoC with ZSETs using the time to send as Scores
rudderstack-helm
Open-source, warehouse-first Customer Data Pipeline and Segment-alternative. Collects and routes clickstream data and builds your customer data lake on your data warehouse.
rust-efimer
PoC to try & learn Rust
scala-skeleton
Scala Skeleton
spark-daria
Essential Spark extensions and helper methods ✨😲
spark-json-schemas
Create Spark schemas using JSON-schemas
telegraf
The plugin-driven server agent for collecting & reporting metrics.
thunderstruck
CDP based on ray.io