feat: WASI-NN GGML backend handled prompt too long at set_input
dm4 opened this issue · comments
Summary
When calling set_input() with long prompt text, it will throw ErrNo::InvalidArgument. We need to avoid it.
Details
Move the prompt length check to compute() and add ErrNo::PromptTooLong.
Appendix
No response