distantmagic / llmops-handbook

Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)

LLMOps Handbook

This is the handbook for the LLM Operations team. It is a living document.

For the rendered version, visit our website: https://llmops-handbook.distantmagic.com/

Our Other Projects

• Paddler - Stateful load balancer custom-tailored for llama.cpp
• Resonance - Modern PHP framework for IO-intensive applications

License

Creative Commons Attribution Share Alike 4.0 International

Community

Discord: https://discord.gg/kysUzFqSCK