Foundation Model Stack

fms-fsdp

🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

foundation-model-stack

🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

multi-nic-cni

fms-extras

fms-hf-tuning

🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

fms-sdg

Synthetic Data Generation for Foundation Models

train-conductor

Training job management tool for foundation model service

base-images

text-generation-inference

Large Language Model Text Generation Inference

fms-acceleration

🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

fms-guardrails-orchestrator

🚀 Guardrails orchestration server for application of various detections on text generation input and output.

ocp-efa-operator

Operator that enables EFA and/or GDRCOPY in an OpenShift cluster

training-operator

Training operators on Kubernetes.

trl

Train transformer language models with reinforcement learning.

avengers

fastsafetensors

High-performance safetensors model loader

fms-lm-eval-service