EagleW

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

dspy

DSPy: The framework for programming—not prompting—foundation models

MemGPT

Create LLM agents with long-term memory and custom tools 📚🦙

llama-recipes

Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

Promptify

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

esm

Evolutionary Scale Modeling (esm): Pretrained language models for proteins

meditron

Meditron is a suite of open-source medical Large Language Models (LLMs).

ProtTrans

ProtTrans is providing state of the art pretrained language models for proteins. ProtTrans was trained on thousands of GPUs from Summit and hundreds of Google TPUs using Transformers Models.

lingua-py

The most accurate natural language detection library for Python, suitable for short text and mixed-language text

dolma

Data and tools for generating and inspecting OLMo pre-training data.

KnowledgeEditingPapers

[知识编辑] Must-read Papers on Knowledge Editing for Large Language Models.

progen

Official release of the ProGen models

Megatron-LLM

distributed trainer for LLMs

gt4sd-core

GT4SD, an open-source library to accelerate hypothesis generation in the scientific discovery process.

UltraFeedback

A large-scale, fine-grained, diverse preference dataset (and models).

hetionet

Hetionet: an integrative network of disease

MetaICL

An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi

enzynet

EnzyNet: enzyme classification using 3D convolutional neural networks on spatial representation

tart

Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.

gpqa

GPQA: A Graduate-Level Google-Proof Q&A Benchmark

Generative_KG_Construction_Papers

[EMNLP 2022] Generative Knowledge Graph Construction: A Review

SPECTER2

group-selfies

CODA-19

This is the Github repo of "CODA-19: Using a Non-Expert Crowd to Annotate Research Aspects on 10,000+ Abstracts in the COVID-19 Open Research Dataset" (https://arxiv.org/abs/2005.02367)

csfaculty.github.io

Interview questions for Computer Science faculty jobs

enzyme-datasets

Enzyme datasets used to benchmark enzyme-substrate promiscuity models

BioREx

Megatron-LLM

distributed trainer for LLMs

rufes

Scripts for supporting TAC KBP Recognizing Ultra Fine-grained EntitieS Task (RUFES)