HazyResearch / zoology

Understand and test language model architectures on synthetic tasks.

HazyResearch/zoology Issues

arxiv24_based_figure2 'NoneType' object has no attribute 'float'
Updated 2 months ago1
Questions about the data lengths for Figure 2
Updated 3 months ago
Testing `MQAR` without training?
Closed 3 months ago2
MQAR mamba training
Closed 4 months ago1
Two `head_num` variables?
Closed 4 months ago3
File has not been merged
Closed 4 months ago1
Cannot run Based model
Closed 5 months ago2
On index bug-fix of AR experiments script and corresponding paper results
Closed 5 months ago1
Pile experiment
Closed 5 months ago2
About mistakes in the implementation of SMA
Updated 5 months ago
State Mixer
Closed 5 months ago2
Potential bug in data generation code?
Closed 6 months ago1
no LICENSE file
Closed 6 months ago1
CUDA implementation of TaylorExp linear attention?
Closed 6 months ago2
Mamba MQAR evauation
Closed 7 months ago2
Positional embedding in based model?
Closed 7 months ago1
Config files for the experiments from blog post
Closed 7 months ago2
Broken link
Closed 7 months ago1