ereslibre

Rafael Fernández López's starred repositories

LLM-Shearing

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

Language:PythonMIT49600

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Language:C++MIT769200

llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

Language:RustApache-2.0606000

NixThePlanet

Run macOS, Windows and more via a single Nix command, or simple nixosModules

Language:NixMIT51800

poem

A full-featured and easy-to-use web framework with the Rust programming language.

Language:RustApache-2.0336800

leptos

Build fast web applications with Rust.

Language:RustMIT1545000

rust-design-axioms

Discovering and describing Rust's design axioms

NOASSERTION6400

wali-musl

Exploring Webassembly Linux Interface using Libc

Language:CNOASSERTION400

WALI

A low-level virtualization interface for Linux-based systems using WebAssembly

Language:CMIT8000

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate, Groq (100+ LLMs)

Language:PythonNOASSERTION1075800

ray-llm

RayLLM - LLMs on Ray

Language:PythonApache-2.0120700

NeMo-Guardrails

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Language:PythonNOASSERTION382000

OpenLLM

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

Language:PythonApache-2.0942100

giskard

🐢 Open-Source Evaluation & Testing for LLMs and ML models

Language:PythonApache-2.0379100

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

Language:PythonApache-2.02919600

advent-of-cuda

Doing advent of code with CUDA and rust.

Language:Rust19900

ollama

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

Language:GoMIT8056500

gradio

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

Language:PythonApache-2.03117100

compiler

Compiler for Elm, a functional language for reliable webapps.

Language:HaskellBSD-3-Clause748300

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

Language:PythonApache-2.0739300

stringer

A self-hosted, anti-social RSS reader.

Language:RubyMIT383500

hedgedoc

HedgeDoc - Ideas grow better together

Language:TypeScriptAGPL-3.0489400

gpu_poor

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

Language:JavaScript73000

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

Language:PythonMIT580200

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

Language:Jupyter NotebookMIT974500

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Language:PythonApache-2.01519600

paperless-ngx

A community-supported supercharged version of paperless: scan, index and archive all your physical documents

Language:PythonGPL-3.01829700

Eureka

Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models" (ICLR 2024)

Language:Jupyter NotebookMIT275100

llm

Access large language models from the command-line

Language:PythonApache-2.0354400

ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

Language:PythonApache-2.01102000