Kye Gomez's repositories
autogpt-tot
Simple Autogpt with tree of thoughts
segment-geospatial
A Python package for segmenting geospatial data with the Segment Anything Model (SAM)
Infinite-X
Open-source repository dedicated to advancing AI Reasoning towards superintelligence.
all-books-on-libgen
Scripts for harvesting all the data from libgen for massive AI pretraining
lightspeed
Lightspeed is an ultra-fast experimentation framework for State of The Art AI Research
youtubeURL-to-text
Transform youtube URL into text 100x faster with whisperx
The-Cortex
An groundbreaking mesh of Standard Operating Procedures and playbooks to conducting AI research that matters.
The-Harvestor
Multi Modality Data Harvestor From The Internet
torchscale-flash
Torchscale has great stuff but their attention no no good! Here is fix!
multimodal-self-distillation
A generalized self-supervised training paradigm for unimodal and multimodal alignment and fusion.
model-training-template-for-aws
Boilerplate template to train AI models on AWS with CUDA
PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
nucleotide-transformer
🧬 Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human Genomics
Conditional-Flash-Attention
Conditional Flash Attention Fusing Flash Attention and CoLT5 architecture
APAC-SCALE
Transformers at any scale
FLASHATTENION-LION-OPTIMIZE
Fast and memory-efficient exact attention coupled with the LION Optimizer for ultra fast performance
visual-chatgpt
VisualChatGPT
GATO-by-Deepmind
Unofficial GATO: Ready to train
small-books
Small books on popular frameworks such as Next js, React js, and Airflow amongst others!
flash-attention-jax
Implementation of Flash Attention in Jax
LaMDA-pytorch
Open-source pre-training implementation of Google's LaMDA in PyTorch.
RETRO-pytorch
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch