ckadner

katalog

MLX Katalog is a project to hold the default content samples to bootstrap Machine Learning eXchange.

modelmesh-minio-examples

ModelMesh example models packaged into a MinIO container for user exploration and functional verification testing

pipelines

Machine Learning Pipelines for Kubeflow

caicats

caikit

Caikit is an AI toolkit that enables users to manage models through a set of developer friendly APIs.

caikit-demo

caikit-huggingface-demo

caikit-template

Template for generating Caikit extensions

caikit-tgis-serving

caikit_website

community

KServe community docs for contributions and process

demo-models

docs

The open-source repo for docs.github.com

eclairjs-examples

Examples for eclairjs-node and eclairjs-nashorn

examples

A repository to host extended examples and tutorials

flash-attention

Fast and memory-efficient exact attention

kernel_gateway_demos

Demos associated with the kernel gateway incubator project

kserve

Serverless Inferencing on Kubernetes

kserve_website

User documentation for KServe.

llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

modelmesh

Distributed Model Serving Framework

modelmesh-performance

ModelMesh Performance Scripts, Dashboard and Pipelines

modelmesh-runtime-adapter

Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods

modelmesh-serving

Controller for ModelMesh

oshi

Native Operating System and Hardware Information

rest-proxy

KServe V2 Protocol Rest API Implementation Proxy

taxonomy

Taxonomy tree that will allow you to create models tuned with your data

text-generation-inference

IBM development fork of https://github.com/huggingface/text-generation-inference

text-generation-router

Routing proxy for TGIS

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs