catai

There are 0 repository under catai topic.

node-llama-cpp
withcatai / node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
ai bindings catai cmake cmake-js cuda gguf grammar json-schema llama llama-cpp llm metal nodejs prebuilt-binaries self-hosted
Language:TypeScript 759
withcatai / catai
Run AI ✨ assistant locally! with simple API for Node.js 🚀
ai ai-assistant catai chatbot chatgpt chatui dalai ggmlv3 gguf llama-cpp llm local-llm localai node-llama-cpp nodejs openai vicuna vicuna-installation-guide wizardlm
Language:TypeScript 429