Adalberto's starred repositories
llama-cpp-python
Python bindings for llama.cpp
efficient-kan
An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).
matmulfreellm
Implementation for MatMul-free LM.
awesome-kan
A comprehensive collection of KAN(Kolmogorov-Arnold Network)-related resources, including libraries, projects, tutorials, papers, and more, for researchers and developers in the Kolmogorov-Arnold Network field.
LLMTest_NeedleInAHaystack
Doing simple retrieval from LLM models at various context lengths to measure accuracy
conditional-flow-matching
TorchCFM: a Conditional Flow Matching library
Triton-Puzzles
Puzzles for learning Triton
RETRO-pytorch
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
quiet-star
Code for Quiet-STaR
InfiniTransformer
Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
infini-transformer
PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)
AutoCompressors
[EMNLP 2023] Adapting Language Models to Compress Long Contexts
neuron_as_deep_net
Code behind the work "Single Cortical Neurons as Deep Artificial Neural Networks", published in Neuron 2021
smaller-transformers
Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.
flow-matching
Annotated Flow Matching paper
1.58BitNet
Experimental BitNet Implementation