IQSS / askdataverse

Experimental code leveraging LLM applications within Dataverse

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Not sure what this error is, feel free to update this issue when someone figures it out

sbarbosadataverse opened this issue · comments

I asked the data a question, and got this

Screen Shot 2024-02-26 at 12 31 58 PM

The error means that the data is too long for the context window for the LLM used.

Either changes in chunking needed on the askdataverse bot side, or upgrade to model with bigger context window on API endpoint side.