Sophia Wisdom's repositories
Stimulator
Interactive simulator of walking in the city
rust_scraping
Scraper, in Rust, of literotica.com
sophiawisdom
for my readme
benchmarks-adafactor
Fast and flexible reference benchmarks
small_games
small games
annotated-s4-tpu
tpu fork of https://srush.github.io/annotated-s4
bettor
visualize iterated betting
composer-gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
cutlass
CUDA Templates for Linear Algebra Subroutines
girlsurgery
html for girl.surgery
js_compression_experiments
random experiments with trying to make javascript compression better
manifold
Manifold Markets: A market for every question
min-dalle
min(DALL·E) is a fast, minimal port of DALL·E Mini to PyTorch
RWKV-LM
RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
slither_slimmer
slim slither outputs
streaming
A Data Streaming Library for Efficient Neural Network Training
TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
triton
Development repository for the Triton language and compiler