promptfoo / promptfoo

Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

Home Page:https://www.promptfoo.dev/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

`eval` successfully done but error code is not 0

sangwoo-joh opened this issue · comments

I ran npx promptfoo eval and I can see the result with npx prompt view, but npx promptfoo eval itself returned 100 not 0 (checked by echo $?). What is the reason for this?

The process exits with status code 100 if there are any failures in the tests. This was intentionally added in #335, useful for CI

Thanks for the clarification!