Slugger70 / idc

Intergalactic (reference) Data Commission

IDC - Intergalactic (reference) Data Commission

What the IUC (Intergalactic Utilities Commission) is for Galaxy tools is the IDC for (reference) Data.

This repository is the entry point to contribute to the community-maintained CVMFS data repository, hosting approximately 6TB of public and open reference datasets.

Currently, we foresee two distinct modes of this repositoy:

• single data-managers that do not depend on other data managers, e.g. metaphlan2
• data-managers that depend on other data managers and needs to be executed in a workflow-like fashion, e.g. hisat2

The single data-managers are easy to run and all you need is a specification on how to run your data manager in a YAML file. An example is the humann2 data manager:

---
data_managers:
    - id: toolshed.g2.bx.psu.edu/repos/iuc/data_manager_humann2_database_downloader/data_manager_humann2_download/0.9.9
      # HUMAnN2 database: Nucleotide database: full chocophlan
      # these params correspond to the Galaxy data manager parameters
      params:
          - 'db|database': 'chocophlan'
          - 'db|build': '{{ item }}'
      items:
          - full
      data_table_reload:
          - humann2_nucleotide_database

If you want to add a new reference genome to our community storage, you probably want to include the FASTA file, the bowtie2 and Star indexes, and so on. For this please just add and entry to our genome file.

For example, adding new reference data for mouse (mm10) would look like that.

genomes:
  - id: mm9
    name: M. musculus July 2007 (NCBI37/mm9)

How to use the reference data

If you want to use the reference data, please have a look at our ansible-role and the example playbook.