Giters

promptfoo / promptfoo

Test your prompts, agents, and RAGs. Redteaming, pentesting, vulnerability scanning for LLMs. Improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

Home Page:https://www.promptfoo.dev/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Save evals in self hosted machine when running it from another machine

NoAchache opened this issue · comments

commented

[Continuation of past issue as I do not seem to be able to reopen it: /issues/578]

My team and myself want to be able to run the eval in their own machine and push the results to a machine which serves the promptfoo server.

Also for security reasons we cannot directly ssh to the other machine to manually copy the results and we can only reach predefined ports.

commented

I understand what you're saying. Right now promptfoo share is the best way to do this. Are you saying that you'd prefer something that automatically shares/pushes to the remote machine?

commented

Actually I thought share was not working (it was a config error on the server). It is ok then thanks