allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

Home Page:https://clear.ml/docs

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Invalid requirement error when having clearml[gs] installed

HackXIt opened this issue · comments

Describe the bug

When running an agent inside google colab, I always get this error after dependency installation:

2024-04-27 16:54:12
ERROR: Invalid requirement: 'google google_api_core'
RequirementsManager handler <clearml_agent.helper.package.external_req.ExternalRequirements object at 0x7b81f4a81450> raised exception: Failed installing GIT/HTTPs package 'google google_api_core'
clearml_agent: ERROR: Could not install task requirements!
Failed installing GIT/HTTPs package 'google google_api_core'
2024-04-27 16:54:12
Process failed, exit code 1

The google_api_core package is a dependency of google_cloud_storage
The package itself is malformed and cannot be parsed.

To reproduce

  1. Install clearml[gs]
  2. Run task locally
  3. Reproduce the executed task in google colab agent

In the reproduced task, the following package list shows up:

...
clearml == 1.15.1
google google_api_core
google_cloud_storage == 2.16.0
...

Expected behaviour

google_api_core should not appear in the package list or at least be in the correct format.

Environment

  • Server type: app.clear.ml
  • 1.15.1
  • 3.11.2 on my local machine, 3.10.12 in the container run by clearml-agent
  • OS: Linux

Related Discussion

https://clearml.slack.com/archives/CTK20V944/p1714229813244889

The task log where the error occured for me:
Log - e10d786796b74c239a45f81f61532416.txt

Thanks for reporting @HackXIt - We'll update when a fix is available.