Lightning-AI / lightning-Habana

Lightning support for Intel Habana accelerators.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

extend CI with multiple agents on single machine

Borda opened this issue Β· comments

πŸš€ Feature

Running multiple agents on a single bare-metal machine. As most of the tests are not compute-extensive that shall not limit or increase the execution time...

Motivation

Boost the CI by adding new agents to process the queue while preserving the cost

Limitations

We would change the multi-card scenario such that we won't run on all 8cards but assuming that 2 cards validation is sufficient for preserving the package quality

Additional context

HPU allows setting card visibility so we can for each agent/flow adjust this visibility only for particular indexes, see: https://docs.habana.ai/en/latest/PyTorch/PT_Multiple_Tenants_on_HPU/index.html

Hi! thanks for your contribution!, great first issue!