allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

Home Page:https://clear.ml/docs

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Expecting a list of configurations dictionaries

WHPAN0108 opened this issue · comments

Describe the bug

I am new in clearml and I can not get the dataset from the server.
It is the same when i use SDK

There is no issue for my colleagues, but it does not work in my WSL environment.
I guess that might be the issue with my terminal / font

image

To reproduce

Exact steps to reproduce the bug. Provide example code if possible.

from clearml import Dataset

dataset_path = Dataset.get(
    dataset_id="cbe55e59413c4149a08e3b5e7e546165"
)
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Untitled-1.ipynb Cell 1 line 6
      [2](vscode-notebook-cell:Untitled-1.ipynb?jupyter-notebook#W0sdW50aXRsZWQ%3D?line=1) dataset_project = "NASH"
      [4](vscode-notebook-cell:Untitled-1.ipynb?jupyter-notebook#W0sdW50aXRsZWQ%3D?line=3) from clearml import Dataset
----> [6](vscode-notebook-cell:Untitled-1.ipynb?jupyter-notebook#W0sdW50aXRsZWQ%3D?line=5) dataset_path = Dataset.get(
      [7](vscode-notebook-cell:Untitled-1.ipynb?jupyter-notebook#W0sdW50aXRsZWQ%3D?line=6)     dataset_id="cbe55e59413c4149a08e3b5e7e546165"
      [8](vscode-notebook-cell:Untitled-1.ipynb?jupyter-notebook#W0sdW50aXRsZWQ%3D?line=7) )

File [~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1778](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1778), in Dataset.get(cls, dataset_id, dataset_project, dataset_name, dataset_tags, only_completed, only_published, include_archived, auto_create, writable_copy, dataset_version, alias, overridable, shallow_search, **kwargs)
   [1774](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1774)     instance = Dataset.create(
   [1775](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1775)         dataset_name=dataset_name, dataset_project=dataset_project, dataset_tags=dataset_tags
   [1776](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1776)     )
   [1777](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1777)     return finish_dataset_get(instance, instance._id)
-> [1778](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1778) instance = get_instance(dataset_id)
   [1779](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1779) # Now we have the requested dataset, but if we want a mutable copy instead, we create a new dataset with the
   [1780](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1780) # current one as its parent. So one can add files to it and finalize as a new version.
   [1781](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1781) if writable_copy:

File [~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1682](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1682), in Dataset.get.<locals>.get_instance(dataset_id_)
   [1680](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1680) force_download = False if task.status in ("stopped", "published", "closed", "completed") else True
   [1681](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1681) if cls.__state_entry_name in task.artifacts:
-> [1682](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1682)     local_state_file = StorageManager.get_local_copy(
   [1683](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1683)         remote_url=task.artifacts[cls.__state_entry_name].url,
   [1684](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1684)         cache_context=cls.__cache_context,
...
---> [60](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/backend_config/bucket_config.py:60)         raise ValueError("Expecting a list of configurations dictionaries")
     [61](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/backend_config/bucket_config.py:61)     configs = [cls(**entry) for entry in dict_list]
     [62](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/backend_config/bucket_config.py:62)     valid_configs = [conf for conf in configs if conf.is_valid()]

ValueError: Expecting a list of configurations dictionaries

Expected behaviour

What is the expected behaviour? What should've happened but didn't?

Environment

  • Server type (self hosted \ app.clear.ml)
  • ClearML SDK Version 1.13.2
  • ClearML Server Version (Only for self hosted). Can be found on the bottom right corner of the settings screen.
    WebApp: 1.12.1-397 • Server: 1.12.1-397 • API: 2.26
  • Python Version 3.10.13
  • OS (Windows \ Linux \ Macos) WSL2

Related Discussion

If this continues a slack thread, please provide a link to the original slack thread.