exllama

There are 0 repository under exllama topic.

• gotzmann / booster

  Booster - open platform for serving LLM models

  chatgptexllamaggmlgptllamallama-cppllamacppllmollamaoobaboogaopenaivllm
  Language:C++ 127

• c0sogi / llama-api

  An OpenAI-like LLaMA inference API

  apiexllamafastapillamallamacpp
  Language:Python 108

• innightwolfsleep / text-generation-webui-telegram_bot

  LLM telegram bot

  large-language-modelsllmtelegram-botaiogrambotexllamallamacpptelegramtext-generation-webui
  Language:Python 98

• Zuellni / ComfyUI-ExLlama-Nodes

  ExLlamaV2 nodes for ComfyUI.

  comfyuiexllamastable-diffusion
  Language:Python 89

• shinomakoi / magi_llm_gui

  A Qt GUI for large language models

  guillamallmpythonllamacppexllamaqt
  Language:Python 39

• shinomakoi / AI-Messenger

  A QT GUI for large language models

  exllamallamallamacppqt6
  Language:Python 19

• silphendio / sliced_llama

  Simple LLM inference server

  llm-inferenceexllamallm
  Language:Python 15

• NO-ob / simpleLlama

  A Simple webserver for generating text with exllamav2

  exllama
  Language:Python 14

• Aqirito / A.L.I.C.E

  A.L.I.C.E (Artificial Labile Intelligence Cybernated Existence). A REST API of A.I companion for creating more complex system

  langchainlangchain-pythonllmtext-generationtext-to-speechttsvitsanimeartificial-intelligencegenshin-impactllmsotakuwaifuexllamafastapigptqhuggingface-transformerspygmalionrest-api
  Language:Python 4

• seyf1elislam / LocalLLM_OneClick_Colab

  Run gguf LLM models in Latest Version TextGen-webui

  colab-notebookexllamaggufgptqllmllmslocalllamalocalllmpython
  Language:Jupyter Notebook 4

• nickpotafiy / exl2-api

  JavaScript WebSocket API for ExLlamav2

  apiexllamajavascriptnodejswebsocket
  Language:JavaScript 1

• nickpotafiy / illama

  A lightweight, fast, parallel inference server for Llama

  exllamainferencellamallama2llama3llm-inferenceserverflash-attention-2paged-attentionexllamav2
  Language:Python 1

• alexkreidler / quote-constraint

  A constrained generation filter for local LLMs that makes them quote properly from a source document

  constrained-generationexllamallmlocal-llm
  Language:Python

• countzero / windows_exllama

  This is a playground to explore the ExLlama project in a Windows environment.

  exllamapythontorchcondacuda
  Language:PowerShell

• kooten111 / EasyEXL

  A Python script designed to streamline the process of quantizing models to exllamav2 format

  exllamallmquantization
  Language:Python