test: generator methods should return objects of correct type
leondz opened this issue · comments
_call_model and generate type signatures are important. generator compliance can be automatically tested.
Run the relevant items from tests/generators/test_generators.py over all generators available
test presence and compliance of generations_this_call parameter
create garak-specific exception for missing API key, and skip test if raised. e.g.
@skip_on(garak.exception.NoAPIKey, reason="No API key was found for this generator")