exllamav2

There are 0 repository under exllamav2 topic.

/ illama
A fast, lightweight, parallel inference server for Llama LLMs.
exllama inference llama llama2 llama3 llm-inference server flash-attention-2 paged-attention exllamav2
Language:Python 2
/ tabload
TabLoad is a GUI application for interacting with TabbyAPI the Exllamav2 Server
ai exl2 exllamav2 llm tabby tabbyapi
Language:Go 1

/ illama