reichlab / covid19-forecast-hub

Projections of COVID-19, in standardized format

Home Page:https://covid19forecasthub.org

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Switch truth update to use covidHubUtils + covidData on the VM

Khoale1096 opened this issue · comments

Description

We would like to move from using the python scripts under data-truth/ directory to using covidHubUtils/covidData to update the truth for GitHub and Zoltar, mainly because:

  1. All codes for truth aggregation and the creation of corresponding csv files are centralized and unit-tested in covidHubUtils/covidData, so we want to make use of that, instead of the non unit-tested python scripts as of currently
  2. With the Virtual Machine being ready, we now have enough capacity to frequently utilize covidData.

Steps of Actions

  • Install covidData on the VM.
  • Install covidHubUtils on the VM.
  • Creates a cron job that daily update covidData & covidHubUitls to have the latest features
  • Automate hospitalization truth as part of the move
  • Creates another cron job that weekly update the truth csv files using a script similar to this, making use of those 2 packages and push to GitHub.
  • Add a GitHub action that can trigger this action on the VM and retire the current github action that perform weekly truth update
  • Update truth wiki to reflect this change

Is there anything you need from me for configuration, etc.? FYI all code is located at /code on the VM.

Github Action reaches capacity limit. Can use maximize-build-space github action to increase limit