Question about synthetic dataset.

[Samuel Arcadinho]

Hi,

I just finish reading you hyena paper, and first of all great work 💪

I wanted to do the same synthetic experiments that you did in order to get a sense why the other models are failing.

However, I didn’t understand how you generate the dataset. For example, in the majority voting/counting do you add a token distinguishing the input from the output?