CG80499

KAN-GPT-2

Training small GPT-2 style models using Kolmogorov-Arnold networks.

trlx-with-T5

[Added T5 support to TRLX] A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

Attention-only-transformers

Climatehack-2022

The code I used to score 0.748 in Climatehack 2022. It also includes code for loading data quickly in PyTorch. In addition to an optical flow model based on Deepmind's Perceiver network.

langchain

⚡ Building applications with LLMs through composability ⚡

mpt-play

Command-line script for inferencing from models such as MPT-7B-Chat