Beast code in Giters

shivams's starred repositories

Awesome-LLMOps

An awesome & curated list of best LLMOps tools for developers

Language:ShellCC0-1.0353900

awesome-local-ai

An awesome repository of local AI tools

108900

lms

LM Studio CLI. Written in TypeScript/Node

Language:TypeScriptMIT121000

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Language:C++MIT773000

ollama

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

Language:GoMIT8350400

awesome-local-llms

Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.

31400

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

Language:PythonMIT332900

xmrig

RandomX, KawPow, CryptoNight and GhostRider unified CPU/GPU miner and RandomX benchmark

Language:CGPL-3.0854400

gddr6

Linux based GDDR6/GDDR6X VRAM temperature reader for NVIDIA RTX 3000/4000 series GPUs.

Language:C6700

SikuliX1

SikuliX version 2.0.0+ (2019+)

Language:JavaMIT268900

vasttools

My swiftsknife for vast.ai service

Language:Shell10300

hardcaml

Hardcaml is an OCaml library for designing hardware.

Language:OCamlMIT63300

milewski-ctfp-pdf

Bartosz Milewski's 'Category Theory for Programmers' unofficial PDF and LaTeX source

Language:TeXNOASSERTION1086700

trio

Trio – a friendly Python library for async concurrency and I/O

Language:PythonNOASSERTION602600

SSFS

Simple & Stupid Filesystem (Using FUSE)

Language:CGPL-3.08900

pyfuse3

Python 3 bindings for libfuse 3 with asynchronous API (Trio compatible)

Language:PythonNOASSERTION16400

fusepy

Simple ctypes bindings for FUSE

Language:PythonISC78100

codelite

A multi purpose IDE specialized in C/C++/Rust/Python/PHP and Node.js. Written in C++

Language:C++GPL-2.0210100

python-fuse

Python 2.x/3.x bindings for libfuse 2.x

Language:PythonLGPL-2.127700

dispatch

Combine internet connections, increase your download speed

Language:RustApache-2.036800

katana

A next-generation crawling and spidering framework.

Language:GoMIT1062000

autoscraper

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Language:PythonMIT609800

machine-learning-for-trading

Code for Machine Learning for Algorithmic Trading, 2nd edition.

Language:Jupyter Notebook1257700

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Language:PythonApache-2.0924500

text-generation-webui

A Gradio web UI for Large Language Models.

Language:PythonAGPL-3.03882600

LLaMA-Factory

A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

Language:PythonApache-2.02844100

tabbyAPI

An OAI compatible exllamav2 API that's both lightweight and fast

Language:PythonAGPL-3.039300

llama-cpp-python

Python bindings for llama.cpp

Language:PythonMIT737100

cosmopolitan

build-once run-anywhere c library

Language:CISC1753100

llamafile

Distribute and run LLMs with a single file.

Language:C++NOASSERTION1809500