llm-random / llm-random

Home Page:https://llm-random.github.io/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

batch_size_heuristic doesn't work

sebastianjaszczur opened this issue · comments

batch_size_heuristic relies on get_machine_backend from grid_utils, which returns MachineBackend.LOCAL . That get_machine_backend functions, I think, works for grid, but it doesn't work inside singularity.

Oh, right. Should it also work inside singularity?