Beast code in Giters

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

Language:C++Apache-2.0739900

flash-attention

Fast and memory-efficient exact attention

Language:PythonBSD-3-Clause1188400

cognita

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

Language:PythonApache-2.0297800

unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Language:PythonApache-2.01228200

fastapi

FastAPI framework, high performance, easy to learn, fast to code, ready for production

Language:PythonMIT7320100

usearch

Fast Open-Source Search & Clustering engine × for Vectors & 🔜 Strings × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C#, GoLang, and Wolfram 🔍

Language:C++Apache-2.0192400

SimSIMD

Up to 200x Faster Inner Products and Vector Similarity — for Python, JavaScript, Rust, C, and Swift, supporting f64, f32, f16 real & complex, i8, and binary vectors using SIMD for both x86 AVX2 & AVX-512 and Arm NEON & SVE 📐

Language:CApache-2.079700

llama_index

LlamaIndex is a data framework for your LLM applications

Language:PythonMIT3330700

ollama

Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.

Language:GoMIT7700400

langchain-extract

🦜⛏️ Did you say you like data?

Language:Rich Text FormatMIT97100

faiss

A library for efficient similarity search and clustering of dense vectors.

Language:C++MIT2936700

langchain

🦜🔗 Build context-aware reasoning applications

Language:PythonMIT8861000

gpt4all

GPT4All: Chat with Local LLMs on Any Device

Language:C++MIT6663600

sparrow

Data processing with ML and LLM

Language:PythonGPL-3.0228500

zero_to_gpt

Go from no deep learning knowledge to implementing GPT.

Language:Jupyter NotebookNOASSERTION88900

mojo

The Mojo Programming Language

Language:MojoNOASSERTION2208500

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Language:PythonNOASSERTION8012900

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Language:PythonMIT16365700

pytorch-deep-learning

Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.

Language:Jupyter NotebookMIT922600