hurshd0

ollama

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

lobe-chat

🤯 Lobe Chat - an open-source, modern-design LLMs/AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Bedrock / Azure / Mistral / Perplexity ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT chat application.

ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

GPTs

leaked prompts of GPTs

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

langflow

⛓️ Langflow is a visual framework for building multi-agent and RAG applications. It's open-source, Python-powered, fully customizable, model and vector store agnostic.

tabby

Self-hosted AI coding assistant

AnimateAnyone

Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation

triton

Development repository for the Triton language and compiler

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate, Groq (100+ LLMs)

TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

Megatron-LM

Ongoing research training transformer models at scale

trl

Train transformer language models with reinforcement learning.

text-generation-inference

Large Language Model Text Generation Inference

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Voyager

An Open-Ended Embodied Agent with Large Language Models

promptbase

All things prompt engineering

cutlass

CUDA Templates for Linear Algebra Subroutines

interpretable-ml-book

Book about interpretable machine learning

mamba-minimal

Simple, minimal implementation of the Mamba SSM in one file of PyTorch.

GenossGPT

One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.

llmperf

LLMPerf is a library for validating and benchmarking LLMs

med-flamingo

microchain

function calling-based LLM agents

vllm_backend

llm-perf-bench

DS

DS-scraper

drugs.com scraper