Giters

promptfoo / promptfoo

Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

Home Page:https://www.promptfoo.dev/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

No Amazon Bedrock models can be used as embedding providers for similarity assertion

markstownsend opened this issue · comments

commented

Hello,
No Amazon Bedrock models can be used as embedding providers for similarity assertion. I have tried all of them with these results:

Provider bedrock:cohere.embed-english-v3 is not a valid embedding provider for 'similarity check', falling back to default
Provider bedrock:amazon.titan-embed-text-v2:0 is not a valid embedding provider for 'similarity check', falling back to default
Provider bedrock:amazon.titan-embed-text-v1 is not a valid embedding provider for 'similarity check', falling back to default

If it is a new feature rather than my mistake and, you think its doable for a newbie I'm happy to try and create a PR for it. It seems I would need to implement BedrockEmbeddingProvider class in bedrock.ts.
Cheers,
Mark

commented

#797 adds support for Bedrock embedding models!

commented

Released in 0.59.0!