Giters

mistralai / mistral-inference

Official inference library for Mistral models

Home Page:https://mistral.ai/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Mixtral sliding window

tuyaao opened this issue · comments

commented

What is the sliding window size for Mixtral training, Is it 32k or 8k