Eric Buehler (EricLBuehler)

EricLBuehler

Geek Repo

Github PK Tool:Github PK Tool

Eric Buehler's repositories

mistral.rs

Blazingly fast LLM inference.

Language:RustLicense:MITStargazers:2634Issues:28Issues:128

candle-vllm

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

Language:RustLicense:MITStargazers:149Issues:5Issues:28

candle-lora

Low rank adaptation (LoRA) for Candle.

Language:RustLicense:MITStargazers:109Issues:7Issues:14

xlora

X-LoRA: Mixture of LoRA Experts

Language:PythonLicense:Apache-2.0Stargazers:104Issues:7Issues:13

trc

A faster Arc.

Language:RustLicense:MITStargazers:39Issues:5Issues:14

candle-sampling

Sampling techniques for Candle.

Language:RustLicense:MITStargazers:10Issues:3Issues:1

candle-lora-macro

Macros for candle-lora.

Language:RustLicense:MITStargazers:6Issues:2Issues:0

candle_llm_dataset

A LLM-specific dataset for Candle.

Language:RustLicense:MITStargazers:6Issues:2Issues:0

candle

Minimalist ML framework for Rust

Language:RustLicense:Apache-2.0Stargazers:4Issues:1Issues:0

simd_matmul

O(n^2) matmul with SIMD.

Language:C++License:MITStargazers:3Issues:2Issues:0
Language:RustLicense:Apache-2.0Stargazers:2Issues:0Issues:0

dora

DORA (Dataflow-Oriented Robotic Application) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.

Language:RustLicense:Apache-2.0Stargazers:2Issues:0Issues:0

flexrc

Fast, flexible, and safe reference counted type.

Language:RustLicense:MITStargazers:2Issues:2Issues:0

merlin_rust

Make your code fly.

Language:RustLicense:MITStargazers:2Issues:2Issues:0

pyo3-special-method-derive

Automatically derive Python dunder methods for your Rust code

Language:RustLicense:MITStargazers:2Issues:0Issues:0

range-checked

Range checked types leveraging Rust's type system.

Language:RustLicense:MITStargazers:2Issues:2Issues:0

candle-ext

An extension library to Candle that provides PyTorch functions not currently available in Candle

Language:RustLicense:Apache-2.0Stargazers:1Issues:1Issues:0
Language:CudaLicense:Apache-2.0Stargazers:1Issues:1Issues:0

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Language:PythonLicense:Apache-2.0Stargazers:1Issues:1Issues:0
License:MITStargazers:0Issues:2Issues:0
Language:CudaLicense:Apache-2.0Stargazers:0Issues:1Issues:0
Language:RustLicense:Apache-2.0Stargazers:0Issues:1Issues:0

cudarc

Safe rust wrapper around CUDA toolkit

Language:RustLicense:Apache-2.0Stargazers:0Issues:1Issues:0
Language:MDXStargazers:0Issues:1Issues:0

llama_index

LlamaIndex is a data framework for your LLM applications

Language:PythonLicense:MITStargazers:0Issues:0Issues:0

mirage

A multi-level tensor algebra superoptimizer

License:Apache-2.0Stargazers:0Issues:0Issues:0

ratchet

A cross-platform browser ML framework.

Language:RustLicense:MITStargazers:0Issues:1Issues:0

tch-rs

Rust bindings for the C++ api of PyTorch.

Language:RustLicense:Apache-2.0Stargazers:0Issues:1Issues:0

triomphe

Fork of std::sync::Arc with lots of utilities useful for FFI

Language:RustLicense:Apache-2.0Stargazers:0Issues:1Issues:0

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Language:PythonLicense:Apache-2.0Stargazers:0Issues:1Issues:0