upura

langchain

🦜🔗 Build context-aware reasoning applications

openai-cookbook

Examples and guides for using the OpenAI API

text-generation-webui

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

DocsGPT

GPT-powered chat for documentation, chat with your documents

FinGPT

FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

NeMo-Guardrails

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

trafilatura

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

awesome-local-ai

An awesome repository of local AI tools

KnowledgeEditingPapers

Must-read Papers on Knowledge Editing for Large Language Models.

vec2text

utilities for decoding deep representations (like sentence embeddings) back to text

embetter

just a bunch of useful embeddings

relora

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

starting-kit

Starting kit for the NeurIPS 2023 unlearning challenge

GPTSAN

General-purpose Swich transformer based Japanese language model

HojiChar

The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.

kaggle-book-gokui

付録コード

lmppl

Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).

ir100

情報検索100本ノック

llm-japanese-dataset

LLM構築用の日本語チャットデータセット

SkillSpan

SKILLSPAN: Competences as Spans for Skill Extraction from Job Postings

Extracting-Training-Data-from-Large-Langauge-Models

A re-implementation of the "Extracting Training Data from Large Language Models" paper by Carlini et al., 2020

shirokumas

A set of scikit-learn style transformers for Polars

instruction_ja

Japanese instruction data (日本語指示データ)

semantic-shift-stability

implementation of Semantic Shift Stability (AACL2022)

commonsense-moral-ja

thun_search

newschat-with-impression

matcha

ecifr