ZeroCool2u

ollama

Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.

yt-dlp

A feature-rich command-line audio/video downloader

open-interpreter

A natural language interface for computers

ClickHouse

ClickHouse® is a real-time analytics DBMS

influxdb

Scalable datastore for metrics, events, and real-time analytics

autogen

A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

hyperfine

A command-line benchmarking tool

atuin

✨ Magical shell history

earthly

Super simple build framework with fast, repeatable builds and an instantly familiar syntax – like Dockerfile and Makefile had a baby.

mise

dev tools, env vars, task runner

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

streaming-llm

[ICLR 2024] Efficient Streaming Language Models with Attention Sinks

CTranslate2

Fast inference engine for Transformer models

gitlab-ci-local

Tired of pushing to test your .gitlab-ci.yml?

windows-drivers-rs

Platform that enables Windows driver development in Rust. Developed by Surface.

rapidpages

Generate React and Tailwind components using AI

blaze

Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.

seqio

Task-based datasets, preprocessing, and evaluation for sequence models.

GeoStats.jl

An extensible framework for geospatial data science and geostatistical modeling fully written in Julia

sapientml

Generative AutoML for Tabular Data

carton

Run any ML model from any programming language.

open_lm

A repository for research on medium sized language models.

huggingface-vscode-endpoint-server

starcoder server for huggingface-vscdoe custom endpoint

geospatial-data-science-with-julia

Geospatial Data Science with Julia

rfparty-xyz

its like a tricorder, for your wireless world.

sideko

Generate SDKs and docs for your API

llm-vscode-inference-server

An endpoint server for efficiently serving quantized open-source LLMs for code.

rustls-rustcrypto

Rustls cryptography provider built on the pure Rust crates from the RustCrypto organization

rfparty-mobile