Mark McLoughlin's repositories
crustyblaa
Crusty Blaa - Mark McLoughlin's Blog
ai-lab-recipes
Examples for building and running LLM services and applications locally with Podman
clarifai-python
Experience the power of Clarifai’s AI platform with the python SDK. 🌟 Star to support our work!
compressed-tensors
A safetensors extension to efficiently store sparse quantized tensors on disk
dev-docs
Design documents that for InstructLab
FBGEMM
FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
instructlab
InstructLab Command-Line Interface. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data.
llm-compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
pip
A tool for installing and managing Python packages
pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
rhelai-dev-preview
Red Hat Enterprise Linux AI -- Developer Preview
sdg
Python library for Synthetic Data Generation
taxonomy
Taxonomy tree that will allow you to create models tuned with your data
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs