Summarize Website on long Websites not handled
PhillipRt opened this issue · comments
Phillip Rath commented
Long Websites should be chunked and summaized in parts or at least cut off. Currently I am getting this issue:
Website Content Summary:
Error calling API with status code 400 and message "{
"error": {
"message": "This model's maximum context length is 4097 tokens. However, your messages resulted in 45439 tokens. Please reduce the length of the messages.",
"type": "invalid_request_error",
"param": "messages",
"code": "context_length_exceeded"
}
}
Shamoon Siddiqui commented
Maybe we can add a chunked summarization?