Kale Champagnie's repositories
selective-language-modeling
An implementation of selective language modeling (SLM) loss from "Rho-1: Not All Tokens Are What You Need".
axial-attention
An implementation of axial attention in PyTorch.
axial-rope
A simple implementation of Axial RoPE in PyTorch.
cone
Implementation of Cone, ParabolicCone and ParameterizedCone activation functions.
density-estimation
Literature on density estimation.
hourglass-vq-vae
An Hourglass Transformer VQ-VAE architecture.
masked-linear
An implementation of a masked linear layer, as used by MADE.
mixture-of-layers
An implementation of Mixture of Layers (MoL) in PyTorch.
sd-vae
SD-VAE implementation in PyTorch.
semantic-shapes
Semantic shapes for deep neural networks.
sprite-diffusion
Pixel art sprite generation using diffusion.
stanford-encyclopedia-of-philosophy-corpus
A corpus containing all entries in the Stanford Encyclopedia of Philosophy (as of January 2024).
super-attention
An implementation of super attention in PyTorch.
temporal-language-model
An implementation of Temporal Language Model from "Temporal Attention for Language Models", in PyTorch.
unsplash-dataset-builder
A Colab for building Unsplash datasets.
unsplash-iterable-dataset
An iterable dataset that downloads image-text pairs from Unsplash.
vanilla-gan
An implementation of a vanilla GAN in PyTorch.
variational-behaviour-models
An implementation of Variational Behaviour Models in PyTorch (WIP).