odtp-org / odtp-eqasim-dataloader

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

odtp-eqasim-dataloader

This is the component that will download and arrange files to make it compatible with eqasim pipeline.

ODTP Command

odtp new odtp-component-entry \
--name odtp-eqasim-dataloader \
--component-version 0.3.2 \
--repository https://github.com/odtp-org/odtp-eqasim-dataloader

Tutorial

This component is a temporal solution until we have dataloaders defined for each source of data. This component accept one link to switchdrive and the download and uncompress it content to an output folder.

Therefore, the only ENV variable available is:

  • LINK:

Changelog

  • v0.3.2

    • Ubuntu fixed at 22.04
    • Python fixed at 3.10
  • v0.3.1

    • Updated odtp-component-client
    • Added quiet to unzip
  • v0.3.0 Updated odtp.yml

Development

Developed by SDSC/CSFM

About

License:GNU Affero General Public License v3.0


Languages

Language:Dockerfile 93.6%Language:Shell 6.4%