Beast code in Giters

Sergey Feldman's starred repositories

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Language:PythonApache-2.027653 226 4649

ExplorerPatcher

This project aims to enhance the working environment on Windows

Language:CGPL-2.024135 257 1982

litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Language:PythonNOASSERTION12585 71 3174

OpenLLM

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

Language:PythonApache-2.09810 55 267

instructor

structured outputs for llms

Language:PythonMIT7660 48 301

litestar

Production-ready, Light, Flexible and Extensible ASGI API framework | Effortlessly Build Performant APIs

Language:PythonMIT5400 40 1107

simpleaichat

Python package for easily interfacing with chat apps, with robust features and minimal code complexity.

Language:PythonMIT3474 35 82

autolabel

Label, clean and enrich text datasets with LLMs.

Language:PythonMIT2030 20 250

deep-chat

Fully customizable AI chatbot component for your website

Language:TypeScriptMIT1432 28 255

voyager

🛰️ An approximate nearest-neighbor search library for Python and Java with a focus on ease of use, simplicity, and deployability.

Language:C++Apache-2.01283 13 28

TabPFN

Official implementation of the TabPFN paper (https://arxiv.org/abs/2207.01848) and the tabpfn package.

Language:PythonApache-2.01187 16 79

tinyvector

A tiny nearest-neighbor embedding database built with SQLite and Pytorch. (In development!)

Language:PythonMIT773 10 10

pyllms

Minimal Python library to connect to LLMs (OpenAI, Anthropic, Google, Groq, Reka, Together, AI21, Cohere, Aleph Alpha, HuggingfaceHub), with a built-in model performance benchmark.

Language:PythonMIT705 11 11