Switch truth update to use covidHubUtils + covidData on the VM
Khoale1096 opened this issue · comments
Description
We would like to move from using the python scripts under data-truth/
directory to using covidHubUtils/covidData to update the truth for GitHub and Zoltar, mainly because:
- All codes for truth aggregation and the creation of corresponding csv files are centralized and unit-tested in covidHubUtils/covidData, so we want to make use of that, instead of the non unit-tested python scripts as of currently
- With the Virtual Machine being ready, we now have enough capacity to frequently utilize covidData.
Steps of Actions
- Install covidData on the VM.
- Install covidHubUtils on the VM.
- Creates a cron job that daily update covidData & covidHubUitls to have the latest features
- Automate hospitalization truth as part of the move
- Creates another cron job that weekly update the truth csv files using a script similar to this, making use of those 2 packages and push to GitHub.
- Add a GitHub action that can trigger this action on the VM and retire the current github action that perform weekly truth update
- Update truth wiki to reflect this change
Is there anything you need from me for configuration, etc.? FYI all code is located at /code
on the VM.
Github Action reaches capacity limit. Can use maximize-build-space github action to increase limit