izhx - Giters

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

Language:Jupyter NotebookApache-2.02509 37 98

text-embeddings-inference

A blazing fast inference solution for text embeddings models

Language:RustApache-2.02207 27 177

yarn

YaRN: Efficient Context Window Extension of Large Language Models

Language:PythonMIT1233 14 54

streaming

A Data Streaming Library for Efficient Neural Network Training

Language:PythonApache-2.01000 20 138

anserini

Anserini is a Lucene toolkit for reproducible information retrieval research

Language:JavaApache-2.0993 41 603

agent-protocol

Common interface for interacting with AI agents. The protocol is tech stack agnostic - you can use it with any framework for building agents.

Language:PythonMIT834 11 39

nlp-phd-global-equality

A repo for open resources & information for people to succeed in PhD in CS & career in AI / NLP

802 170

Generative-AI

[TPAMI 2023] Multimodal Image Synthesis and Editing: The Generative AI Era

Language:TeX769 45 2

vec2text

utilities for decoding deep representations (like sentence embeddings) back to text

Language:PythonNOASSERTION632 13 38

fairseq2

FAIR Sequence Modeling Toolkit 2

Language:PythonMIT609 18 88

examples

Fast and flexible reference benchmarks

Language:ShellApache-2.0423 16 39

GPT-Fathom

GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well as OpenAI's earlier models on 20+ curated benchmarks under aligned settings.

Language:PythonMIT344 1 6

DreamLLM

[ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation

Language:PythonApache-2.0341 18 20

rerope

Rectified Rotary Position Embeddings

Language:Python318 11 12

Gentopia

Build Hierarchical Autonomous Agents through Config. Collaborative Growth of Specialized Agents.

Language:PythonMIT282 2 5

CapsFusion

[CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale

Language:Python179 22 5

FlagAttention

A collection of memory efficient attention operators implemented in the Triton language.

Language:PythonNOASSERTION171 6 2

multires-conv

Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)

Language:PythonMIT118 6 4

swim-ir

SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 languages, generated using PaLM 2 and summarize-then-ask prompting.

40 70

ChatIR

Official repository of "Chatting Makes Perfect: Chat-based Image Retrieval"

Language:PythonMIT16 3 4

Visual-C3

Towards Real-World Writing Assistance: A Chinese Character Checking Benchmark with Faked and Misspelled Characters

Language:Python15 1 1

CLEME

The repository of EMNLP 2023 "CLEME: Debiasing Multi-reference Evaluation for Grammatical Error Correction"

Language:PythonApache-2.0800