zabirauf / AutoGPT.js

Auto-GPT on the browser

Home Page:https://autogptjs.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Summarize Website on long Websites not handled

PhillipRt opened this issue · comments

Long Websites should be chunked and summaized in parts or at least cut off. Currently I am getting this issue:
Website Content Summary:

Error calling API with status code 400 and message "{

"error": {

"message": "This model's maximum context length is 4097 tokens. However, your messages resulted in 45439 tokens. Please reduce the length of the messages.",

"type": "invalid_request_error",

"param": "messages",

"code": "context_length_exceeded"

}

}

Maybe we can add a chunked summarization?