jongwon-jay-lee's repositories
AgentGym
Code and implementations for the paper "AgentGym: Evolving Large Language Model-based Agents across Diverse Environments" by Zhiheng Xi et al.
Awesome-Embodied-Agent-with-LLMs
This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates!
bert
TensorFlow code and pre-trained models for BERT
bigscience
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
c4-dataset-script
Inspired by google c4, here is a series of colossal clean data cleaning scripts focused on CommonCrawl data processing. Including Chinese data processing and cleaning methods in MassiveText.
DeepLearningExamples
Deep Learning Examples
DPR
Dense Passage Retriever - is a set of tools and models for open domain Q&A task.
dps
Data processing system for polyglot
Dreambooth-Stable-Diffusion
Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion
finetune-gpt2xl
Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed
google-research
Google Research
imagen-pytorch
Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
kenlm
KenLM: Faster and Smaller Language Model Queries
KoAlpaca
KoAlpaca: Korean Alpaca Model based on Stanford Alpaca (feat. LLAMA and Polyglot-ko)
KoBERTScore
BERTScore for Korean
llama
Inference code for LLaMA models
LLMs-Planning
An extensible benchmark for evaluating large language models on planning
llmss
LLM simple serving (tensor model parallel, pubsub, grpc)
lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
Megatron-LM
Ongoing research training transformer models at scale
openai-quickstart-python
Python example app from the OpenAI API quickstart tutorial
peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
text-dedup
All-in-one text de-duplication
text-generation-inference
Large Language Model Text Generation Inference
tppys
Text processing by pyspark (just sample project)
transformers
🤗 Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.
triton-server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.