RossSong's repositories
alpaca-lora
Code for reproducing the Stanford Alpaca InstructLLaMA result on consumer hardware
atlas
Code repository for supporting the paper "Atlas Few-shot Learning with Retrieval Augmented Language Models",(https//arxiv.org/abs/2208.03299)
auto-cot
Official implementation for "Automatic Chain of Thought Prompting in Large Language Models" (stay tuned & more will be updated)
awesome-chatgpt-prompts
This repo includes ChatGPT prompt curation to use ChatGPT better.
CodeGen
CodeGen is an open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
concrete-ml
Concrete-ML is a Privacy-Preserving Machine Learning (PPML) open-source set of tools which aims to simplify the use of fully homomorphic encryption (FHE) for data scientists. Particular care was given to the simplicity of our Python package in order to make it usable by any data scientist, even those without prior cryptography knowledge.
flash-attention
Fast and memory-efficient exact attention
FlexGen
Running large language models like GPT-3/OPT-175B on a single GPU. Up to 100x faster than other offloading systems.
GLM
GLM (General Language Model)
lm-human-preferences
Code for the paper Fine-Tuning Language Models from Human Preferences
LMOps
General technology for enabling AI capabilities w/ LLMs and Generative AI models
local-attention
An implementation of local windowed attention for language modeling
Long-context-transformers
Exploring finetuning public checkpoints on filter 8K sequences on Pile
minRLHF
A (somewhat) minimal library for finetuning language models with PPO on human feedback.
musiclm-pytorch
Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
NPM
The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)
OpenELM
Evolution Through Large Models
PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
pecab
Pure python Korean morpheme analyzer based on Mecab
prompt-engine
A library for helping developers craft prompts for Large Language Models
Prompt-Engineering-Guide
:octopus: Guide and resources for prompt engineering
Promptify
Prompt Engineering | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
python-mecab-kor
Yet another python binding for mecab-ko
RL4LMs
A modular RL library to fine-tune language models to human preferences
self-instruct
Aligning pretrained language models with instruction data generated by themselves.
setfit
Efficient few-shot learning with Sentence Transformers
structured-prompt-generator
Construct well formed prompts for Disco Diffusion and other text to image generators
TextRL
Reinforcement learning in text generation with transformers
torchscale
Transformers at any scale