nebuly-ai / optimate

A collection of libraries to optimise AI model performances

Home Page:https://www.nebuly.com/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Nebullvm] Add option to Nebullvm auto-installer for installing **all** libraries

Telemaco019 opened this issue · comments

Description

The Nebullvm auto-installer (nebullvm.installers.auto_installer) installs only the libraries available for the current hardware, even when --all options are specified. This means that if I run the installer on a machine with no GPUs available, all the libraries required for GPU optimization won't be installed.

It would be useful to have an option that allows installing all libraries, including GPU ones, even if no GPUs are available. Without this option, when using the installer inside a Docker image build, it is required to build the image on a GPU-enabled node. Otherwise, all the GPUs libraries won't be installed.

This prevents me from using the Nebullvm auto-installer in GitHub actions used for building Docker images, as no GPUs are available.

Proposed solution

Add --all option to auto_installer CLI