end of life with backup
bengsoon opened this issue · comments
Bengsoon Chuah commented
A wild idea sparked when @davidberenstein1957 shared the cool end of life plugin #7 with me:
- to create a plugin that automatically serialize a particular dataset push to dvc or git at the end of life, or when the dataset is fully labeled
something like this:
import os
from argilla_plugins.datasets import end_of_life_with_backup
# get git credentials from OS environment
GIT_CREDENTIALS = os.environ["git_credential"]
# commit message when dataset reaches end of life
msg="End of life of dataset"
# set up end_of_life_with_backup plugin
end_of_life_with_backup(name="dataset", end_of_life=1, git_credentials=GIT_CREDENTIALS, commit_message=msg)
# start plugin
end_of_life_with_backup.start()
David Berenstein commented
Thanks @bengsoon! It looks great, however, some additional config for DVC would also need to be done:)
David Berenstein commented
Also, I'm not sure if DVC is the most practical option, but we will figure something out.
Bengsoon Chuah commented
yeah i was thinking of that too -- I think DVC will add a few more lines of code