IMOKURI

k8s-dra-driver

Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes

FlashRAG

⚡FlashRAG: A Python Toolkit for Efficient RAG Research

mesop

optimum-nvidia

nos

Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elastic quotas - Effortless optimization at its finest!

llm-on-openshift

Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.

mistral-finetune

langroid

Harness LLMs with Multi-Agent Programming

chat_templates

Chat Templates for 🤗 HuggingFace Large Language Models

llama-inference

experiments with inference on llama

intro-llm-rag

LLM Models and RAG Hands-on guide

ragapp

The easiest way to use Agentic RAG in any enterprise

ChatRTX

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM

openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend

tensorrtllm_backend

The Triton TensorRT-LLM Backend

cognita

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

unstructured

Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.

ts-comments.nvim

Tiny plugin to enhance Neovim's native comments

nvim-best-practices

Collection of DOs and DON'Ts for modern Neovim Lua plugin development

GPU-Benchmarks-on-LLM-Inference

Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

LLMenv

e-learning

ez-cheat

Unofficial Cheat Book for HPE Ezmeral Products

DeepSpeedFugaku

tegon

Tegon is an open-source, AI-first alternative to Jira, Linear

IC-Light

More relighting!

timesfm

TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.

llm.nvim

LLM powered development for Neovim

llm-ls

LSP server leveraging LLMs for code completion (and more?)

llama.cpp

LLM inference in C/C++