argilla-io / argilla-plugins

🔌 Open-source plugins for with practical features for Argilla using listeners.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

end of life with backup

bengsoon opened this issue · comments

A wild idea sparked when @davidberenstein1957 shared the cool end of life plugin #7 with me:

  • to create a plugin that automatically serialize a particular dataset push to dvc or git at the end of life, or when the dataset is fully labeled

something like this:

import os
from argilla_plugins.datasets import end_of_life_with_backup

# get git credentials from OS environment
GIT_CREDENTIALS = os.environ["git_credential"]

# commit message when dataset reaches end of life
msg="End of life of dataset"

# set up end_of_life_with_backup plugin
end_of_life_with_backup(name="dataset", end_of_life=1, git_credentials=GIT_CREDENTIALS, commit_message=msg)

# start plugin
end_of_life_with_backup.start()

Thanks @bengsoon! It looks great, however, some additional config for DVC would also need to be done:)

Also, I'm not sure if DVC is the most practical option, but we will figure something out.

yeah i was thinking of that too -- I think DVC will add a few more lines of code 😅