Giters

danny-avila / LibreChat

Enhanced ChatGPT Clone: Features Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development.

Home Page:https://librechat.ai/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Bug]: Chat Comparison Azure & Bedrock

reramjiawan opened this issue · comments

commented

What happened?

When doing a chat comparison with Azure Open AI and Bedrock. Bedrock fails to generate a response.

Steps to Reproduce

1.) Select Bedrock
2.) Move to Azure Open AI Chat
3.) Ask to write a poem
4.) Fails to generate a poem in Bedrock

What browsers are you seeing the problem on?

No response

Relevant log output

{"$fault":"server","$metadata":{},"level":"error","message":"[api/server/controllers/agents/client.js #sendCompletion] Unhandled error type Bedrock is unable to process your request.","name":"ServiceUnavailableException","stack":"ServiceUnavailableException: Bedrock is unable to process your request.\n    at de_ServiceUnavailableExceptionRes (/app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1170:21)\n    at de_ServiceUnavailableException_event (/app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1382:10)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async /app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1259:38\n    at async Object.deserializer (/app/node_modules/@smithy/eventstream-serde-universal/dist-cjs/index.js:127:37)\n    at async _SmithyMessageDecoderStream.asyncIterator (/app/node_modules/@smithy/eventstream-serde-universal/node_modules/@smithy/eventstream-codec/dist-cjs/index.js:430:28)\n    at async ChatBedrockConverse._streamResponseChunks (/app/node_modules/@langchain/aws/dist/chat_models.cjs:697:30)\n    at async ChatBedrockConverse._generateUncached (/app/node_modules/@langchain/aws/node_modules/@langchain/core/dist/language_models/chat_models.cjs:157:34)\n    at async ChatBedrockConverse.invoke (/app/node_modules/@langchain/aws/node_modules/@langchain/core/dist/language_models/chat_models.cjs:60:24)\n    at async RunnableLambda.func (/app/node_modules/@librechat/agents/dist/cjs/graphs/Graph.cjs:214:34)"}
{"$fault":"server","$metadata":{},"level":"error","message":"[handleAbortError] AI response error; aborting request: Bedrock is unable to process your request.","name":"ServiceUnavailableException","stack":"ServiceUnavailableException: Bedrock is unable to process your request.\n    at de_ServiceUnavailableExceptionRes (/app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1170:21)\n    at de_ServiceUnavailableException_event (/app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1382:10)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async /app/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1259:38\n    at async Object.deserializer (/app/node_modules/@smithy/eventstream-serde-universal/dist-cjs/index.js:127:37)\n    at async _SmithyMessageDecoderStream.asyncIterator (/app/node_modules/@smithy/eventstream-serde-universal/node_modules/@smithy/eventstream-codec/dist-cjs/index.js:430:28)\n    at async ChatBedrockConverse._streamResponseChunks (/app/node_modules/@langchain/aws/dist/chat_models.cjs:697:30)\n    at async ChatBedrockConverse._generateUncached (/app/node_modules/@langchain/aws/node_modules/@langchain/core/dist/language_models/chat_models.cjs:157:34)\n    at async ChatBedrockConverse.invoke (/app/node_modules/@langchain/aws/node_modules/@langchain/core/dist/language_models/chat_models.cjs:60:24)\n    at async RunnableLambda.func (/app/node_modules/@librechat/agents/dist/cjs/graphs/Graph.cjs:214:34)"}

Screenshots

image

Code of Conduct

  • I agree to follow this project's Code of Conduct