Giters

marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Mistral Sliding Window Attention (SWA)

stygmate opened this issue · comments

commented

Does ctransformers support Sliding Window Attention (SWA) ?

commented

Mistral works with ctransformer - I tested v0.2 ...