promptfoo / promptfoo

Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

Home Page:https://www.promptfoo.dev/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Feature Request: CLI command to retrieve results after manual labelling in csv file

NoAchache opened this issue · comments

Hello, would it be possible to add a CLI to download the results from an experiment in the web UI, ideally in a csv file (rather than manually fetching the json files). Ideally the columns would be:

  • the prompt
  • the variables
  • the score
  • the result (pass / fail)
  • Whether the result is a manual label or not (this one is very important)

Yes, this should be fairly straightforward. I can add this to #482

Change was released in 0.50.0