markdouthwaite

Mark Douthwaite's starred repositories

system-design

Learn how to design systems at scale and prepare for system design interviews

Data-Science-For-Beginners

10 Weeks, 20 Lessons, Data Science for All!

Language:Jupyter NotebookMIT26998 496 115

qdrant

Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Language:RustApache-2.018790 118 1129

data-science

:bar_chart: Path to a free self-taught education in Data Science!

NOASSERTION18402 963 56

Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

CC0-1.015962 343 24

:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

Language:PythonApache-2.014524 128 3337

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Language:PythonNOASSERTION14346 265 203

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Language:C++MIT13478 244 6187

danswer

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

Language:PythonNOASSERTION9771 95 404

promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Language:PythonMIT8700 98 461

openplayground

An LLM playground you can run on your laptop

Language:TypeScriptMIT6153 61 92

RedPajama-Data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

Language:PythonApache-2.04438 76 87

llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

Language:PythonApache-2.04221 40 116

llm-app

Dynamic RAG for enterprise. Ready to run with Docker,⚡in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

MIT3356 30 13

Data-Engineering-HowTo

A list of useful resources to learn Data Engineering from scratch

3342 100 2

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Language:PythonNOASSERTION2843 22 58

obsidian-smart-connections

Chat with your notes & see links to related content with AI embeddings. Use local models or 100+ via APIs like Claude, Gemini, ChatGPT & Llama 3

Language:JavaScriptGPL-3.02188 29 442

griptape

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

Language:PythonApache-2.01775 27 285

sqlite-vss

A SQLite extension for efficient vector search, based on Faiss!

Language:C++MIT1592 22 99

awesome-fastapi-projects

List of FastAPI projects! :sunglasses: :rocket:

Language:TypeScript1301 18 17

fastembed

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

Language:PythonApache-2.01021 9 102

business-rules

Python DSL for setting up business intelligence rules that can be configured without code

Language:PythonMIT881 87 30

pgvector-python

pgvector support for Python

Language:PythonMIT781 12 57

objaverse-xl

🪐 Objaverse-XL is a Universe of 10M+ 3D Objects. Contains API Scripts for Downloading and Processing!

Language:PythonApache-2.0630 8 42

obsidian-copilot

🤖 A prototype assistant for writing and thinking

Language:PythonApache-2.0464 9 8

Awesome-VQVAE

📚 A collection of resources and papers on Vector Quantized Variational Autoencoder (VQ-VAE) and its application

MIT165 8 2

tinyllm

Develop, evaluate and monitor LLM applications at scale

Language:PythonMIT86 3 1

system-design-101

Explain complex systems using visuals and simple terms. Help you prepare for system design interviews.

NOASSERTION7100

UniRec

UniRec is an easy-to-use, lightweight, and scalable implementation of recommender systems. Its primary objective is to enable users to swiftly construct a comprehensive ecosystem of recommenders using a minimal set of robust and practical recommendation models.

Language:PythonMIT32 5 3

inai

An experiment in structuring a NodeJS application *internally* using REST principles.

Language:JavaScriptApache-2.03 20