mfuntowicz

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

milvus

A cloud-native vector database, storage for next generation AI applications

netron

Visualizer for neural network, deep learning and machine learning models

datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

onnx

Open standard for machine learning interoperability

sentence-transformers

Multilingual Sentence & Image Embeddings with BERT

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

hydra

Hydra is a framework for elegantly configuring complex applications

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

FasterTransformer

Transformer related optimization, including BERT, GPT

lit

The Learning Interpretability Tool: Interactively analyze ML models to understand their behavior in an extensible and framework agnostic interface.

console

a debugger for async rust!

iree

A retargetable MLIR-based machine learning compiler and runtime toolkit.

libcudacxx

[ARCHIVED] The C++ Standard Library for your entire system. See https://github.com/NVIDIA/cccl

liquidctl

Cross-platform CLI and Python drivers for AIO liquid coolers and other devices

neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

aimet

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

maxtext

A simple, performant and scalable Jax LLM!

torch-mlir

The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.

deduplicate-text-datasets

docs

Dapr user documentation, used to build docs.dapr.io

optimum-nvidia

quanto

A pytorch Quantization Toolkit

mlir-hlo

stablehlo

Backward compatible ML compute opset inspired by HLO/MHLO

windows-samples-rs

optimum-habana

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

optimum-graphcore

Blazing fast training of 🤗 Transformers on Graphcore IPUs

hfapi

Simple Python client for the Hugging Face Inference API