neverix

saex

SAEs in Jax

Triton-Puzzles

Triton puzzles solutions

equinox

Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/

hacky-lm-attack-24

micrlhf-progress

Jax+Penzai GGUF quantized inference, fast SAE code and interpretability experiments

pygguf

GGUF parser in Python

Score-Entropy-Discrete-Diffusion

Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)

text-writing-diffusion

Text-writing denoising diffusion (and much more)

jif

jax text diffusion (mdlm)

vaov

nf4 matmuls for jax

3DViewer

coin-flipping-thht

closed form (?) solution (?) for https://twitter.com/littmath/status/1769044719034647001

diffuser

Code for the paper "Planning with Diffusion for Flexible Behavior Synthesis"

ext4ract

Extract ext4 image files

gguf-requant

Requantize GGUF to lower precision (so layer scans work)

giffuser

grok-1

Grok open release

halutmatmul

Hashed Lookup Table based Matrix Multiplication (halutmatmul) - Stella Nera accelerator (added lower K support)

jax-smi

JAX Synergistic Memory Inspector

MindEyeV2

nanopar

deGPLification of tinypar with DPO

neverix.github.io

My website

open_clip

An open source implementation of CLIP.

rlhf-trojan-2024-cod

https://arxiv.org/abs/2404.14461 team Cod solution

rlhf_trojan_competition

splatmul

Sparse matmul for https://github.com/neverix/micrlhf-progress/blob/main/micrlhf/offload.ipynb

t5x

top-quarks-ARC-solution

Trying to run it on modern compilers

torch-splatting

A pure pytorch implementation of 3D gaussian splatting

weblog