nanowell's starred repositories
GoodbyeDPI
GoodbyeDPI — Deep Packet Inspection circumvention utility (for Windows)
AI-Scientist
The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑🔬
x-transformers
A concise but complete full-attention transformer with a set of promising experimental features from various papers
matmulfreellm
Implementation for MatMul-free LM.
ByeDPIAndroid
App to bypass censorship on Android
audiolm-pytorch
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
nano-llama31
nanoGPT style version of Llama 3.1
Qwen2-Audio
The official repo of Qwen2-Audio chat & pretrained large audio language model proposed by Alibaba Cloud.
rtvi-web-demo
Example UI implementing the RTVI web client
autoregressive-diffusion-pytorch
Implementation of Autoregressive Diffusion in Pytorch
PEER-pytorch
Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
adam-atan2-pytorch
Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
scaling-with-vocab
[NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
diffusion-forcing-transformer
Transformer implementation for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"
Q-Sparse-LLM
My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
Speech-to-Speech-LM
Native Speech to Speech Language Model