Ddnirvana

llama.cpp

LLM inference in C/C++

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

wrk

Modern HTTP benchmarking tool

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

darknet

Convolutional Neural Networks

llm.c

LLM training in simple, raw C/CUDA

semantic-kernel

Integrate cutting-edge LLM technology quickly and easily into your apps

llama2.c

Inference Llama 2 in one file of pure C

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

wrk2

A constant throughput, correct latency recording variant of wrk

AIOS

AIOS: LLM Agent Operating System

crane

Crane is a FinOps Platform for Cloud Resource Analytics and Economics in Kubernetes clusters. The goal is not only to help users to manage cloud cost easier but also ensure the quality of applications.

JPlag

State-of-the-Art Software Plagiarism & Collusion Detection

kairos

:penguin: The immutable Linux meta-distribution for edge Kubernetes.

kube-batch

A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC

k8spacket

k8spacket - collects TCP traffic and TLS connection metadata in the Kubernetes cluster using eBPF and visualizes in Grafana

pulsar

A modular and blazing fast runtime security tool for the IoT, powered by eBPF.

firesim

FireSim: Fast and Effortless FPGA-accelerated Hardware Simulation with On-Prem and Cloud Flexibility

asterinas

Asterinas is a secure, fast, and general-purpose OS kernel, written in Rust and providing Linux-compatible ABI.

merbridge

Use eBPF to speed up your Service Mesh like crossing an Einstein-Rosen Bridge.

kubernetes-json-schema

JSON Schemas for every version of every object in every version of Kubernetes

predictive-horizontal-pod-autoscaler

Horizontal Pod Autoscaler built with predictive abilities using statistical models

Personal_LLM_Agents_Survey

Paper list for Personal LLM Agents

salus

Risc-V hypervisor for TEE development

awesome-serverless-research

A curated list of awesome serverless research works, including papers and open-sourced projects.

tssx

Transparently replace domain sockets with a fast shared memory channel

DuVisor

cxl-reskit

CXL Memory Resource Kit top-level repository

molecule-artifact

Molecule's artifact for ASPLOS'22

Ddnirvana.github.io