Giters

your-tools / tsrc

Manage groups of git repositories

Home Page:https://your-tools.github.io/tsrc/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Add ability to configure default number of jobs

yawor opened this issue · comments

commented
  • Update command line parsing code
  • Update --help message
  • Update documentation
  • Add tests
  • Update changelog

edit by @dmerejkowsky : add a task list

Is your feature request related to a problem? Please describe.
Currently, the number of parallel jobs is set to auto by default, which is ok in most cases. But it can become a problem with newer CPUs. For example I have a 12 cores/24 threads CPU, which sets the job count to 24. This causes issues when trying to access a self hosted gitlab instance. There are no limits set in the gitlab regarding number of parallel requests, but I consistently get some failed tasks when trying to sync more than 11-12 repositories at once.

Describe the solution you'd like
I know there already were some requests regarding providing extra settings using either manifest or a global configuration file, which were dismissed, so maybe instead of using files, it would be acceptable to use environment variables to define default values? It would still be possible to override options values using command line arguments, but at least one could set their defaults in a shell rc file or in ~/.profile.

commented

would be acceptable to use environment variables to define default values?

Yup ;)

commented

but I consistently get some failed tasks when trying to sync more than 11-12 repositories at once.

Fun fact: we got the exact same problem when using qisrc (from https://github.com/aldebaran/qibuild)
... in 2015.

I guess some things don't change :)