Protocol typing is not working
masahi opened this issue · comments
masahi commented
I had to add type: ignore
to the following places since mypy doesn't seem to understand the ModelModule
protocol.
https://github.com/octoml/mlc-llm/blob/batch-serving/serve/mlc_serve/run.py#L75
https://github.com/octoml/mlc-llm/blob/batch-serving/serve/mlc_serve/run.py#L86
https://github.com/octoml/mlc-llm/blob/batch-serving/serve/mlc_serve/model/paged_cache_model.py#L705-L706