jongwon-jay-lee

AgentGym

Code and implementations for the paper "AgentGym: Evolving Large Language Model-based Agents across Diverse Environments" by Zhiheng Xi et al.

Awesome-Embodied-Agent-with-LLMs

This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates!

bert

TensorFlow code and pre-trained models for BERT

bigcode-dataset

bigscience

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

c4-dataset-script

Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese data processing and cleaning methods in MassiveText.

data-engineering

deduplicate-text-datasets

DeepLearningExamples

Deep Learning Examples

DPR

Dense Passage Retriever - is a set of tools and models for open domain Q&A task.

dps

Data processing system for polyglot

Dreambooth-Stable-Diffusion

Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion

finetune-gpt2xl

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

google-research

Google Research

imagen-pytorch

Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

kenlm

KenLM: Faster and Smaller Language Model Queries

KoAlpaca

KoAlpaca: Korean Alpaca Model based on Stanford Alpaca (feat. LLAMA and Polyglot-ko)

KoBERTScore

BERTScore for Korean

llama

Inference code for LLaMA models

LLMs-Planning

An extensible benchmark for evaluating large language models on planning

llmss

LLM simple serving (tensor model parallel, pubsub, grpc)

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

Megatron-LM

Ongoing research training transformer models at scale

openai-quickstart-python

Python example app from the OpenAI API quickstart tutorial

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

text-dedup

All-in-one text de-duplication

text-generation-inference

Large Language Model Text Generation Inference

tppys

Text processing by pyspark (just sample project)

transformers

🤗 Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.

triton-server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.