mzthhy

DeepKE

[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction

DataTager

Fine-Tune LLM Synthetic-Data application and "From Data to AGI: Unlocking the Secrets of Large Language Model"

LLM4Chem

Official code repo for the paper "LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Dataset"

EasyInstruct

[ACL 2024] An Easy-to-use Instruction Processing Framework for LLMs.

Mol-Instructions

[ICLR 2024] Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Models

Darwin

An open-source project dedicated to build foundational large language model for natural science, mainly in physics, chemistry and material science.

SciCrawler

Web-Scarping tool for downloading the content of the following publishers: Elsevier, RSC, Web of Science, Springer Nature , Wiley.

text-generation-inference

Large Language Model Text Generation Inference

BLOOM-LORA

Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigscience/license) using Alpaca-LoRA and Alpaca_data_cleaned.json

bigscience

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

LegalQA-bloomz-560m

Finetuning a small BLOOMZ model (bloomz-560m) on a small dataset and with limited resources.

TencentPretrain

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

TianGong-AI-Unstructure

TianGong-AI-Unstructure

nltk_data

NLTK Data

KnowLM

An Open-sourced Knowledgable Large Language Model Framework.

gpt-2

Code for the paper "Language Models are Unsupervised Multitask Learners"

Scripts

llm.c

LLM training in simple, raw C/CUDA

reader

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

Awesome-RAG-Evaluation

The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.

MarineGPT

The official implementation of MarineGPT

multi-llm-chat

An application allowing for interaction with different LLM models. With the option to provide PDF, web and CSV links for context.

HalluQA

Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"

Awesome-LLMs-Evaluation-Papers

The papers are organized according to our survey: Evaluating Large Language Models: A Comprehensive Survey.

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

self-rag

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

LLMsPracticalGuide

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

eRAG

Codes and packages for the paper titled Evaluating Retrieval Quality in Retrieval-Augmented Generation.

test

Measuring Massive Multitask Language Understanding | ICLR 2021

llm-continual-learning-survey

Continual Learning of Large Language Models: A Comprehensive Survey