JohnClaw / chatllm.cs

C# api wrapper for llm-inference chatllm.cpp

Repository from Github https://github.comJohnClaw/chatllm.cs

api-wrapper bindings chatllm csharp gemma ggml int8 int8-inference int8-quantization llama llm-inference mistral qwen cpu-inference inference llm llms

chatllm.cs

C# api wrapper for llm-inference chatllm.cpp

All credits go to original repo: https://github.com/foldl/chatllm.cpp and Llama 405b (https://cloud.sambanova.ai/) which made 99% of work. I only guided it with prompts.

About

C# api wrapper for llm-inference chatllm.cpp

api-wrapper bindings chatllm csharp gemma ggml int8 int8-inference int8-quantization llama llm-inference mistral qwen cpu-inference inference llm llms

Languages

Language:C# 100.0%