Kaio Silva's repositories
duckdb-on-linux
Passo a passo para instalar no linux/wsl ubuntu
fastapi-docker
Building a optmize docker image using poetry
fancy-git-on-wsl
Passo a passo para instalar no fancy-git no WSL/Ubuntu
OneBillionRowsDataQuality
OneBillionRows with DataQuality project aims to ensure the integrity and quality of massive datasets comprising one billion rows. It harnesses the capabilities of Python 3.11.5 and advanced data quality libraries like Pydantic, Pandera, DuckDB,Pandas and Dash.
data-engineering-roadmap
roadmap de engenharia de dados da jornada 2024
DataProjectStarterKit
Estrutura completa para iniciar um projeto de dados com Python, abrangendo ambiente, git, desenvolvimento, testes e documentação.
duckdb_get_start
Start a DuckDb and Python Project End to End
fakeapiinjest
This project is designed to generate a fictitious database and populate a relational database hosted on Google Cloud. The data will be generated using the Faker and Random libraries, and the ORM will utilize SQLAlchemy. The API will follow REST standards and be implemented using Flask, containerized with Docker.
freecurrencyapi
Study Project: Collect data from the FreeCurrencyAPI a Private API, process and store it in Google Cloud services (Cloud Function, Cloud Scheduler, Cloud Scret Manager and Cloud Storage).
pydantic_pandas
Example how to use pydantic and pandas
webscraping
Bootcamp advanced webscraping