catalyst-cooperative / pudl-archiver

A tool for capuring snapshots of public data sources and archiving them on Zenodo for programmatic use.

catalyst-cooperative/pudl-archiver Issues

Make key quality of life updates to automated archiving
Updated 16 days ago
Publish September 1st 2024 archives
Closed 23 days ago1
Publish September 2nd 2024 archives
Closed 23 days ago1
Publish September 3rd 2024 archives
Closed 23 days ago1
Validate `datapackage.json` checksums against Zenodo checksums
Updated 2 months ago
Publish August 1st 2024 archives
Closed 2 months ago7
Publish August 6th 2024 archives
Closed 2 months ago
Publish August 1st 2024 archives
Closed 2 months ago1
Investigate partition "changes" when updating FERC archives
Updated 2 months ago
Publish July 30th 2024 archives
Closed 2 months ago1
Publish July 31st 2024 archives
Closed 2 months ago1
Publish July 26th 2024 archives
Closed 2 months ago1
Publish July 27th 2024 archives
Closed 2 months ago1
Publish July 28th 2024 archives
Closed 2 months ago1
Publish July 29th 2024 archives
Closed 2 months ago1
Publish July 10th 2024 archives
Closed 3 months ago1
Improve archivers and automated workflow to support faster data integration
Closed 3 months ago1
Remove hard-coded year from EIA AEO archiver
Updated 3 months ago
Publish July 4th 2024 archives
Closed 3 months ago1
Publish July 4th 2024 archives
Closed 3 months ago1
Publish July 1st 2024 archives
Closed 3 months ago1
Better reporting & notification of archive creation and validation failures
Updated 3 months ago
Update FERC archivers to handle multiple taxonomies in one year
Closed 3 months ago1
nrelatb - Deleted record error
Closed 3 months ago5
Publish archives for the month of June 2024
Closed 3 months ago1
ferc1 - "The following files have absolute changes in file size >|25%|: {'ferc1-xbrl-2023.zip': 0.33220136677183526}". INVESTIGATE - File shrinks in size by 33%.
Closed 3 months ago2
Publish June 18th 2024 archives
Closed 3 months ago1
Automatically create archive approval checklist
Updated 3 months ago
Publish June 19th 2024 archives
Closed 3 months ago1
Publish June 18th 2024 archives
Closed 3 months ago1
Publish June 18th 2024 archives
Closed 3 months ago1
Add creation of a Github issue to the `run-archiver.yml` workflow
Closed 3 months ago2
phmsagas validation failure
Closed 3 months ago2
Publish archives for the month of May 2024
Closed 4 months ago4
Fix intermittent failures of integration tests
Updated 5 months ago
ferc1, ferc6, ferc60, ferc714 logon request error
Closed 5 months ago
`ID_NUMBER` shows up in draft sandbox path URLs
Closed 5 months ago
Duplicate filename warnings while archiving FERC XBRL data
Updated 5 months ago1
Update archives for the month of April
Closed 5 months ago5
Investigate failed FERC1 archive for April 2024
Closed 5 months ago
Fix invalid constructed URL in phmsagas archiver
Closed 6 months ago
Add month of data availability into Zenodo archive description
Updated 6 months ago
Automate remaining archive runs
Closed 6 months ago
Fix broken archivers
Closed 6 months ago3
Archive GridPath RA toolkit hourly renewable energy generation profiles
Closed 6 months ago3
Archive bulk EIA930 data
Closed 6 months ago
Archive NREL ATB data
Closed 6 months ago
Archive the EIA AEO bulk data
Closed 6 months ago
Fix GHA-only Access Denied errors for EIA 176 archiver
Closed 7 months ago
Update EIA 176 archiver to grab CSVs, rather than bundled data
Closed 8 months ago