moise-g

ollama

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

llama.cpp

LLM inference in C/C++

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

SWE-agent

[NeurIPS 2024] SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges.

pandas-ai

Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.

mamba

Mamba SSM architecture

ml-engineering

Machine Learning Engineering Open Book

ggml

Tensor library for machine learning

OpenLLM

Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.

mistral-inference

Official inference library for Mistral models

gpt-prompt-engineer

RAG_Techniques

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and contextually rich responses.

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

axolotl

Go ahead and axolotl questions

streaming-llm

[ICLR 2024] Efficient Streaming Language Models with Attention Sinks

sglang

SGLang is a fast serving framework for large language models and vision language models.

ColBERT

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)

text-embeddings-inference

A blazing fast inference solution for text embeddings models

adapters

A Unified Library for Parameter-Efficient and Modular Transfer Learning

semantic-router

Superfast AI decision making and intelligent processing of multi-modal data.

self-rag

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

optillm

Optimizing inference proxy for LLMs

wtpsplit

Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.

FlashRank

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.

RankGPT

Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]

ir_datasets

Provides a common interface to many IR ranking datasets.

pylate

Late Interaction Models Training & Retrieval

AiTimeline

A timeline of notable generative AI events