FMInference/FlexGen Issues
File "setup.py" not found.
Updated 3Please do not abandon this project!
Updated 3what is the helm version?
Updated 1Benchmark for 1 node with 4 GPUs
Updated 1Is LLaMa supported?
Updated 28how to install from source
Updated 4question about quantization
Updatedflexgen without GPU?
UpdatedMultiGPU problem
Closed 4Support for LLaMA
Closed 1interesting you can crop 65b
UpdatedSoft lockup after running flex_opt
Updated 1Is FlexGen+GPTQ 4bit possible?
Updated 1Support for ChatGLM
UpdatedWhere is the chatbot? I miss it!
Closed 7is cpu peak_mem monitoring work?
Updated 2Support Galactica
Closed 1AttributeError
ClosedSoft Label of Flexgen
Updated 1Context Length?
Closed 1