zye1996

Alpaca-CoT

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

flute

Fast Matrix Multiplications for Lookup Table-Quantized LLMs

fastText

Library for fast text representation and classification.

magpie

Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality synthetic data generation pipeline!

immich

High performance self-hosted photo and video management solution.

cosmopedia

storm

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

PDF-Extract-Kit

A Comprehensive Toolkit for High-Quality PDF Content Extraction

crawlee-python

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

BiLLM

Tool for converting LLMs from uni-directional to bi-directional by removing causal mask for tasks like classification and sentence embeddings. Compatible with 🤗 transformers.

AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard

pyserini

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.

rank_llm

Repository for prompt-decoding using LLMs (GPT3.5, GPT4, Vicuna, and Zephyr)

InPars

Inquisitive Parrots for Search

graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

mistral.rs

Blazingly fast LLM inference.

Scrapegraph-ai

Python scraper based on AI

llm2vec

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

LASER

Language-Agnostic SEntence Representations

GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

tevatron

Tevatron - A flexible toolkit for neural retrieval research and development.

awesome-software-architecture

🚀 A curated list of awesome articles, videos, and other resources to learn and practice software architecture, patterns, and principles.

ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

ChatLaw

ChatLaw：A Powerful LLM Tailored for Chinese Legal. 中文法律大模型

cobalt

save what you love

EVA

EVA Series: Visual Representation Fantasies from BAAI

infinity

Infinity is a high-throughput, low-latency REST API for serving vector embeddings, supporting a wide range of text-embedding models and frameworks.

reddit-dataset

Dataset of threads and comments from reddit

LexLIP-ICCV23

Official Code for the ICCV23 Paper: "LexLIP: Lexicon-Bottlenecked Language-Image Pre-Training for Large-Scale Image-Text Sparse Retrieval"

omniglue

Code release for CVPR'24 submission 'OmniGlue'