[TEST] models/test_andromeda num_tokens attribute
evelynmitchell opened this issue · comments
FAILED models/test_andromeda.py::test_initial_parameters - AttributeError: 'Andromeda' object has no attribute 'num_tokens'
FAILED models/test_andromeda.py::test_forward_successful - ImportError: import error in zeta.models.AutoregressiveWrapper: No module named 'zeta.models.Au...
FAILED models/test_andromeda.py::test_forward_exception - ImportError: import error in zeta.models.AutoregressiveWrapper: No module named 'zeta.models.Au...
When I took a look at what Attributes Andromeda has, I don't see num_tokens, even though andromeda.py says it should be there:
['Andromeda', 'T_destination', '__annotations__', '__call__', '__class__', '__delattr__', '__dict__', '__dir__', '__doc__', '__eq__', '__format__', '__ge__', '__getattr__', '__getattribute__', '__getstate__', '__gt__', '__hash__', '__init__', '__init_subclass__', '__le__', '__lt__', '__module__', '__ne__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__setstate__', '__sizeof__', '__str__', '__subclasshook__', '__weakref__', '_apply', '_backward_hooks', '_backward_pre_hooks', '_buffers', '_call_impl', '_compiled_call_impl', '_forward_hooks', '_forward_hooks_always_called', '_forward_hooks_with_kwargs', '_forward_pre_hooks', '_forward_pre_hooks_with_kwargs', '_get_backward_hooks', '_get_backward_pre_hooks', '_get_name', '_is_full_backward_hook', '_load_from_state_dict', '_load_state_dict_post_hooks', '_load_state_dict_pre_hooks', '_maybe_warn_non_full_backward_hook', '_modules', '_named_members', '_non_persistent_buffers_set', '_parameters', '_register_load_state_dict_pre_hook', '_register_state_dict_hook', '_replicate_for_data_parallel', '_save_to_state_dict', '_slow_forward', '_state_dict_hooks', '_state_dict_pre_hooks', '_version', '_wrapped_call_impl',
'add_module', 'apply',
'bfloat16', 'buffers',
'call_super_init', 'children', 'compile', 'cpu', 'cuda',
'decoder', 'double', 'dump_patches',
'eval', 'extra_repr',
'float', 'forward',
'get_buffer', 'get_extra_state', 'get_parameter', 'get_submodule',
'half',
'ipu',
'load_state_dict',
'modules',
'named_buffers', 'named_children', 'named_modules', 'named_parameters', 'parameters',
'register_backward_hook', 'register_buffer', 'register_forward_hook', 'register_forward_pre_hook', 'register_full_backward_hook', 'register_full_backward_pre_hook', 'register_load_state_dict_post_hook', 'register_module', 'register_parameter', 'register_state_dict_pre_hook', 'requires_grad_',
'set_extra_state', 'share_memory', 'state_dict',
'to', 'to_empty', 'train', 'training', 'type',
'xpu',
'zero_grad']
``
Andromeda is a Transformer model, but also, I don't see num_tokens there either.
Do those attributes look familiar?
<!-- POLAR PLEDGE BADGE START -->
## Upvote & Fund
- We're using [Polar.sh](https://polar.sh/kyegomez) so you can upvote and help fund this issue.
- We receive the funding once the issue is completed & confirmed by you.
- Thank you in advance for helping prioritize & fund our backlog.
<a href="https://polar.sh/kyegomez/zeta/issues/96">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="https://polar.sh/api/github/kyegomez/zeta/issues/96/pledge.svg?darkmode=1">
<img alt="Fund with Polar" src="https://polar.sh/api/github/kyegomez/zeta/issues/96/pledge.svg">
</picture>
</a>
<!-- POLAR PLEDGE BADGE END -->
Stale issue message