microsoft / CromwellOnAzure

Microsoft Genomics implementation of the Broad Institute's Cromwell workflow engine on Azure

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Add support for Nextflow, MiniWDL, Toil and create runnable samples for all workflows

MattMcL4475 opened this issue · comments

Problem:
Add support for running Nextflow, MiniWDL, Toil workflows and also add runnable samples for all public workflows

Solution:

  • Add command-line options to deploy/configure Cromwell, Nextflow, MiniWDL, Toil. The user may install one or all of them.
  • If the workflow engine doesn't have a server mode, then run the workflow engine on the smallest viable VM as a dedicated machine, configured to use TES as the backend and call back to TES. Ensure network communication can occur between this dedicated VM and the TES server. Modify the trigger service to call TES directly (instead of the Cromwell REST API) in this case.
  • Rename this repo (or create a new repo if permanent redirection is unavailable), to https://github.com/microsoft/WorkflowEnginesOnAzure or
    WorkflowEnginesOnAzure
    WorkflowsOnAzure
    OmicsOnAzure
    OmicsWorkflowsOnAzure
    OmicsWorkflowEnginesOnAzure
    GenomicsWorkflowsOnAzure
    GenomicsWorkflowEnginesOnAzure
  • Programmatically create docs with runnable samples using OpenAI API for all publicly available workflows