mar-file-system / marfs

MarFS provides a scalable near-POSIX file system by using one or more POSIX file systems as a scalable metadata component and one or more data stores (object, file, etc) as a scalable data component.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

configuration should allow generation of FTA names

jti-lanl opened this issue · comments

... something like what we do with hosts, for example:

# supposing we have batch-FTAs named "fta02.my.org" and "fta03.my.org"
<bfta_pattern> "fta%02d.my.org" </bfta_pattern>
<bfta_offset> 2 </bfta_offset>
<bfta_count> 2  </bfta_count>

And then similarly for interactive-FTAs.

Then update marfs_config to parse this out, so it can be used by scripts. pipetool does already randomize its load across known FTAs, but this would allow it to automatically accommodate changes in the site architecture (or to run at other sites).