Beast code in Giters

ardfork's repositories

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

Language:PythonMIT100

A fast inference library for running LLMs locally on modern consumer-class GPUs

Language:PythonMIT000

Port of Facebook's LLaMA model in C/C++

Language:CMIT000

A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.

Language:PythonAGPL-3.0000

Port of OpenAI's Whisper model in C/C++

Language:CMIT000