`eval` successfully done but error code is not 0
sangwoo-joh opened this issue · comments
Sangwoo Joh commented
I ran npx promptfoo eval
and I can see the result with npx prompt view
, but npx promptfoo eval
itself returned 100
not 0
(checked by echo $?
). What is the reason for this?
Ian Webster commented
The process exits with status code 100 if there are any failures in the tests. This was intentionally added in #335, useful for CI
Sangwoo Joh commented
Thanks for the clarification!