Giters

promptfoo / promptfoo

Test your prompts, agents, and RAGs. Redteaming, pentesting, vulnerability scanning for LLMs. Improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

Home Page:https://www.promptfoo.dev/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support Cloudflare Workers AI

CamdenClark opened this issue · comments

commented

Leaving a ticket here for something I want to implement shortly: supporting cf workers AI.

They have beta support for uploading lora finetunes and could support very low latencies. So I think it's a great target to support in promptfoo.

commented

Sounds good, the API looks nice and clean so hopefully not much of a lift!