sid6389

gravity-backend

aws-genai-llm-chatbot

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS

rasterframes

Geospatial Raster support for Spark DataFrames

SQL-DQC

SQL based data profiling & data quality checks, which will help you to perform data profiling & data quality checks on SQL database at table & database level.

deequ

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

sql-translator

SQL Translator is a tool for converting natural language queries into SQL code using artificial intelligence. This project is 100% free and open source.

data-engineer-roadmap

Roadmap to becoming a data engineer in 2021

prefect

Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

applied-ml

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

Made-With-ML

Learn how to design, develop, deploy and iterate on production-grade ML applications.

manifesto

The OpenTF Manifesto expresses concern over HashiCorp's switch of the Terraform license from open-source to the Business Source License (BSL) and calls for the tool's return to a truly open-source license.

serge

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

ideas-for-projects-people-would-use

Every time I have an idea, I write it down. These are a collection of my top software ideas -- problems I think enough people have that don't have solutions. I expect you can reach a decent userbase if marketed correctly, as I am surely not the only one with these problems.

usaddress

:us: a python library for parsing unstructured United States address strings into address components

bytebytego

awesome-selfhosted

A list of Free Software network services and web applications which can be hosted on your own servers

interview-guide

An opinionated, actionable guide for software engineering interviews.

DataProfiler

What's in your data? Extract schema, statistics and entities from datasets

tutorial-great-expectations

A tutorial for the Great Expectations library.

shopify_django_app

Get a Shopify app up and running with Django and Python Shopify API

kedro-great

The easiest way to integrate Kedro and Great Expectations

data-engineering-zoomcamp

Free Data Engineering course!

address-net

A package to structure Australian addresses

parserator

:bookmark: A toolkit for making domain-specific probabilistic parsers

Data-Engineering-HowTo

A list of useful resources to learn Data Engineering from scratch

libpostal

A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

WebCrawlerForOnlineInflation

Price Crawler - Tracking Price Inflation

HashtagCashtag

My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on ​lambda architecture​, that aggregates Twitter and US stock market data for user sentiment analysis using open source tools - ​Apache Kafka ​for data ingestions, Apache Spark ​& ​Spark Streaming ​for batch & real-time processing, ​Apache Cassandra f​ or storage, ​Flask​, ​Bootstrap and ​HighCharts f​ or frontend.

TASK-Management-System

Spring Boot and Angular 7 web application for task management .

code_snippets