Zack Ankner's repositories
VQ-ViT-Bert
ππ€ Masked token prediction for bidirectional vision transformers based on vector quantized latent representations
WinningTickets
π Wrapper to extract winning tickets from any pytorch model
ApproximateBrainDamage
π§ Model sparsity based on parameter contribution to generalization error
autofaiss
Automatically create Faiss knn indices with the most optimal similarity search parameters.
axolotl
Go ahead and axolotl questions
composer
Train neural networks up to 7x faster
doremi
Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets
facial-rec
Facial Recognition Software to unlock doors
filesystem_spec
A specification that python filesystems should adhere to.
GPTQModel
An easy-to-use LLM quantization and inference toolkit based on GPTQ algorithm (weight-only quantization).
llm-foundry
LLM training code for Databricks foundation models
LTH-Reinit
π Reinitializing pruned weights from the winning ticket
mlm-scoring
Python library & examples for Masked Language Model Scoring (ACL 2020)
PerceptToWorldModel
Final project for 9.66 (Comp Cog Sci)
torch-template
Template of pytorch lighting infrastructure to ease research process
vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
winningtickets.ai
Hub for winning lottery tickets
zackankner.com
They told me I couldn't use zackankner.skin π