wuxmax

wuxmax

Geek Repo

Location:Berlin

Github PK Tool:Github PK Tool

wuxmax's starred repositories

ollama

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

open-interpreter

A natural language interface for computers

Language:PythonLicense:AGPL-3.0Stargazers:51173Issues:382Issues:889

rich

Rich is a Python library for rich text and beautiful formatting in the terminal.

Language:PythonLicense:MITStargazers:48423Issues:538Issues:1289

ColossalAI

Making large AI models cheaper, faster and more accessible

Language:PythonLicense:Apache-2.0Stargazers:38410Issues:384Issues:1622

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Language:PythonLicense:Apache-2.0Stargazers:35938Issues:348Issues:1732

open-webui

User-friendly WebUI for LLMs (Formerly Ollama WebUI)

Language:SvelteLicense:MITStargazers:33412Issues:184Issues:1634

ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Language:PythonLicense:Apache-2.0Stargazers:32275Issues:476Issues:18087

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Language:PythonLicense:Apache-2.0Stargazers:23847Issues:221Issues:3660

guidance

A guidance language for controlling large language models.

Language:Jupyter NotebookLicense:MITStargazers:18323Issues:116Issues:507

llamafile

Distribute and run LLMs with a single file.

Language:C++License:NOASSERTIONStargazers:17900Issues:165Issues:377

uv

An extremely fast Python package installer and resolver, written in Rust.

Language:RustLicense:Apache-2.0Stargazers:15499Issues:35Issues:2163

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Language:PythonLicense:Apache-2.0Stargazers:15260Issues:105Issues:982

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate, Groq (100+ LLMs)

Language:PythonLicense:NOASSERTIONStargazers:10835Issues:60Issues:2741

outlines

Structured Text Generation

Language:PythonLicense:Apache-2.0Stargazers:7396Issues:45Issues:515

chat-ui

Open source codebase powering the HuggingChat app

Language:TypeScriptLicense:Apache-2.0Stargazers:6908Issues:82Issues:527

instructor

structured outputs for llms

Language:PythonLicense:MITStargazers:6880Issues:48Issues:256

skypilot

SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

Language:PythonLicense:Apache-2.0Stargazers:6332Issues:71Issues:1653

serge

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

Language:SvelteLicense:Apache-2.0Stargazers:5606Issues:52Issues:180

01

The open-source language model computer

Language:PythonLicense:AGPL-3.0Stargazers:4794Issues:82Issues:108

llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

Language:PythonLicense:Apache-2.0Stargazers:4300Issues:40Issues:124

mergekit

Tools for merging pretrained large language models.

Language:PythonLicense:LGPL-3.0Stargazers:4194Issues:47Issues:267

inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

Language:PythonLicense:Apache-2.0Stargazers:3914Issues:39Issues:1016

guardrails

Adding guardrails to large language models.

Language:PythonLicense:Apache-2.0Stargazers:3692Issues:25Issues:271

sglang

SGLang is yet another fast serving framework for large language models and vision language models.

Language:PythonLicense:Apache-2.0Stargazers:3435Issues:36Issues:309

thefuzz

Fuzzy String Matching in Python

Language:PythonLicense:MITStargazers:2670Issues:23Issues:51

ray-llm

RayLLM - LLMs on Ray

Language:PythonLicense:Apache-2.0Stargazers:1207Issues:20Issues:89

moderncv

A modern curriculum vitae class for LaTeX

Language:TeXLicense:LPPL-1.3cStargazers:694Issues:15Issues:92

repeng

A library for making RepE control vectors

Language:Jupyter NotebookLicense:MITStargazers:436Issues:6Issues:20

ollama_proxy_server

A proxy server for multiple ollama instances with Key security

Language:PythonLicense:Apache-2.0Stargazers:213Issues:6Issues:9

lm-inference-engines

Comparison of Language Model Inference Engines