citadel-ai / langcheck

Simple, Pythonic building blocks to evaluate LLM applications.

Home Page:https://langcheck.readthedocs.io/en/latest/index.html

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Pin versions for HuggingFace models

kennysong opened this issue · comments

As mentioned in #67 (comment), it would be ideal to pin the versions of models downloaded from HF so the scores don't unexpectedly change.

We can explicitly increment model versions in LangCheck releases.

Hi, let me work on this issue!

Hi @ThanhChinhBK! Are you still planning to work on this issue?

hi @kennysong sorry for the delay, was busy in a while, I will start working on this issue from this Saturday, is it fine?

No worries! That's totally fine, just wanted to make sure you intended to work on this. If not, we can assign it to someone else.