Beast code in Giters

GlassRoom's repositories

heinsen_routing

Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.

Language:PythonMIT172 6 3

heinsen_sequence

Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)

MIT94 2 1

git-gpg

Use git on an untrusted server via a GPG-encrypted repository.

Language:PythonMIT34 4 3

heinsen_attention

Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)

Language:PythonMIT24 2 1

heinsen_tree

Reference implementation of "Tree Methods for Hierarchical Classification in Parallel" (Heinsen, 2022) in PyTorch.

Language:PythonMIT14 20

torch_parallel_scan

Simple and fast parallel scan over sequences of tensors, with any binary associative function you specify, for PyTorch (Franz A. Heinsen, 2024)

Language:PythonMIT10 10

heinsen_position_embeddings

Reference implementation of "Encoding Position by Decaying and Updating Different Exponentiated States Differently," as proposed by Franz A. Heinsen in March 2024

Language:PythonMIT5 20

torch_lsuv_init

Layer Sequential Unit Variance (LSUV) Initialization for PyTorch

Language:PythonMIT2 30

heinsen_routing_2022_paper

Instructions for replicating the results in "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022).

Language:Jupyter NotebookMIT1 2 1

torch_train_test_loop

Composable training/testing of PyTorch models with minimal overhead

Language:PythonMIT1 20

heinsen_routing_2019_paper

Instructions for replicating the results in "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019).

Language:Jupyter NotebookMIT010