Minimum requirements?
Lucaffo opened this issue · comments
I would like to know if there are minimum requirements before installing it
Hello there, thanks for opening your first issue. We welcome you to the FauxPilot community!
I think 2GB for 350M model can run,
Here is the function that defines it.
https://github.com/fauxpilot/fauxpilot/blob/770f56a6588fbcf1a366c3b9ec9efc4701f52943/setup.sh#L59
echo "Models available:"
echo "[1] codegen-350M-mono (2GB total VRAM required; Python-only)"
echo "[2] codegen-350M-multi (2GB total VRAM required; multi-language)"
echo "[3] codegen-2B-mono (7GB total VRAM required; Python-only)"
echo "[4] codegen-2B-multi (7GB total VRAM required; multi-language)"
echo "[5] codegen-6B-mono (13GB total VRAM required; Python-only)"
echo "[6] codegen-6B-multi (13GB total VRAM required; multi-language)"
echo "[7] codegen-16B-mono (32GB total VRAM required; Python-only)"
echo "[8] codegen-16B-multi (32GB total VRAM required; multi-language)"
That's what i search for thanks! Maybe a split header in the readme for the "minimum requirements" instead of "prerequisites" could improve readability of this information.
Hello there! Can any one describe difference between models?
for example codegen-350M-multi vs codegen-16B-multi what difference?