Giters

citadel-ai / langcheck

Simple, Pythonic building blocks to evaluate LLM applications.

Home Page:https://langcheck.readthedocs.io/en/latest/index.html

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Follow up `use_async` option

Alnusjaponica opened this issue · comments

commented

#104 introduced asynchronous API calls of OpenAI-based evaluator and there are some follow-up tasks:

  • Skip API call at the second time (calculation of scores) when unstructured assessment failed.
  • Add test for use_async option
  • Show progress bar when using async call.