Giters

common-workflow-language / common-workflow-language

Repository for the CWL standards. Use https://cwl.discourse.group/ for support 😊

Home Page:https://www.commonwl.org

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Request for Multiple docker images

sagnikbanerjee15 opened this issue · comments

commented

Hello,

I am working in multiple environments that have access to different ECRs. I was wondering if it would be possible for CWL scripts to have multiple dockerPull statements of different docker images, such that the CWL script would attempt to pull from each and on success would proceed with the rest of the script. I understand that this is a bit complicated but it would be nice to have something like this.

Thank you.

commented

Hello @sagnikbanerjee15,

We don't have that as a feature in the CWL standards itself.

However you could

  1. use dockerPull without the registry (debian:slim instead of docker.io/debian:slim)
  2. And work with your CWL vendor to cycle through a variety of container registries provided by a separate configuration mechanism for those dockerPull entriws that don't have an explicit registry specified.

Perhaps those registries could be specified in an additional field in DocketRequirment in a future version of the CWL standards (or as a vendor specific extension now), but I feel like such a list would be quite site specific. So I don't know if it makes sense to include in CommandLineTool/Workflow which are supposed to be portable.

Perhaps this situation could also be solved by the use of https://github.com/ga4gh/data-repository-service-schemas for the container. But support for GA4GH DRS is not part of CWL v1.0 through v1.2, so use of it could impact portability.