JayjeetAtGithub

ChatGPT

🔮 ChatGPT Desktop Application (Mac, Windows and Linux)

polars

Dataframes powered by a multithreaded, vectorized query engine, written in Rust

folly

An open-source C++ library developed and used at Facebook.

open-gpu-kernel-modules

NVIDIA Linux open GPU kernel module source

annoy

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

DALI

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

SPTAG

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.

hnswlib

Header-only C++/python library for fast approximate nearest neighbors

gpustat

📊 A simple command-line utility for querying and monitoring GPU status

nmslib

Non-Metric Space Library (NMSLIB): An efficient similarity search library and a toolkit for evaluation of k-NN methods for generic non-metric spaces.

habitat-sim

A flexible, high-performance 3D simulator for Embodied AI research.

vearch

Distributed vector search for AI-native applications

oomd

A userspace out-of-memory killer

stdexec

`std::execution`, the proposed C++ framework for asynchronous and parallel programming.

spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

raft

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

legion

The Legion Parallel Programming System

n2

TOROS N2 - lightweight approximate Nearest Neighbor library which runs fast even with large datasets

OpenCL-SDK

OpenCL SDK

cuCollections

omnitrace

Omnitrace: Application Profiling, Tracing, and Analysis

NVTX

The NVIDIA® Tools Extension SDK (NVTX) is a C-based Application Programming Interface (API) for annotating events, code ranges, and resources in your applications.

rapids-cmake

faiss-fpga

An FPGA integration and acceleration of the popular FAISS framework for approximate similarity search

nvbench_demo

Simple starter CMake project that uses NVBench.

nvmeof

Scripts to setup NVMe over TCP in Linux

nmon_gpu

nmon utility with updates for monitoring GPU memory

tpch-kit

TPC-H benchmark kit with some modifications/additions