shubham0204

coolify

An open-source & self-hostable Heroku / Netlify / Vercel alternative.

tinygrad

You like pytorch? You like micrograd? You love tinygrad! ❤️

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

mlc-llm

Universal LLM Deployment Engine with ML Compilation

web-llm

High-performance In-browser LLM Inference Engine

petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

warp

A Python framework for high performance GPU simulation and graphics

amber

💎 Amber the programming language compiled to bash

poem

A full-featured and easy-to-use web framework with the Rust programming language.

hugo-book

Hugo documentation theme as simple as plain book

mistral.rs

Blazingly fast LLM inference.

ANR-WatchDog

A simple watchdog that detects Android ANR (Application Not Responding) error and throws a meaningful exception

c-style

My favorite C programming practices.

teo

Schema-driven web server framework.

model-explorer

A modern model graph visualizer and debugger

Local-LLM-Comparison-Colab-UI

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

awesome-emdl

Embedded and mobile deep learning research resources

kotlinx-rpc

Add asynchronous RPC services to your multiplatform applications.

rio

WebApps in pure Python. No JavaScript, HTML and CSS needed

lightbug_http

Simple and fast HTTP framework for Mojo! 🔥

smol-vision

Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜

Ketch

An Android File downloader library based on WorkManager.

llm.mojo

port of Andrjey Karpathy's llm.c to Mojo

ai-edge-torch

Supporting PyTorch models with the Google AI Edge TFLite runtime.

kompendium

Ktor OpenAPI Spec Generator

Blueprint

📐 Visualize the dimensions of your composables on a blueprint!

GitHub-Star-Counter

✨An API to count a GitHub user's total stars, working with shield.io.

rag-from-scratch

An entirely local RAG system from scratch

Room-CMP

Formula1KMP

Formula1KMP: Provides information on Formula 1 2024 teams and drivers built using Compose Multiplatform, Androidx ViewModel & Navigation, Room, Datastore, Material 3...