multi-query-attention

There are 0 repository under multi-query-attention topic.

knotgrass / attention
several types of attention modules written in PyTorch
attention attention-mechanism grouped-query-attention multi-head-attention multi-query-attention pytorch scale-dot-product-attention softmax-layer transformer transformers
Language:Python 27
M-e-r-c-u-r-y / pytorch-transformers
Collection of different types of transformers for learning purposes
pytorch transformers multi-head-attention multi-query-attention einsum-notation
Language:Jupyter Notebook 14