Support disabling storing message context
kibertoad opened this issue · comments
Describe the feature
In case whole conversation is short, it doesn't make sense to waste memory and CPU by keeping its context, it is sufficient to pass prior context manually.
For such use-cases it would be great if there was an option to disable context storing entirely.
If this is approved, I can prepare a PR.