mschubert / clustermq

R package to send function calls as jobs on LSF, SGE, Slurm, PBS/Torque, or each via SSH

https://mschubert.github.io/clustermq/

mschubert/clustermq Issues

Specify ports used by zeromq
Closed 2 months ago2
When using clustermq in a foreach, data.table loses their data.table class although is.data.table returns TRUE in workers
Updated 2 months ago
Outdated ZeroMQ on system trumps bundled version(?)
Updated 3 months ago3
clustermq 0.9.3 worker stats NA?
Closed 3 months ago3
Error in qsys$cleanup() : argument "success" is missing, with no default
Closed 3 months ago2
0.9.0+ crashing on AWS parallel cluster with slurm & several hundred cores
Closed 5 months ago6
Cleanup issues
Closed 6 months ago
S3 method handlers are not exported automatically on R>4.0
Closed 6 months ago2
cannot customize ports in ssh options
Closed 6 months ago4
Clustermq 0.8.96 fails with error on `foreach ... %dopar% ...` in Jupyter lab R console/notebooks
Closed 6 months ago2
Trouble using clustermq as the backend for BiocParallel
Closed 6 months ago6
Repeatedly calling Q() in clustermq 0.9.0 leads to "job not found" messages
Closed 6 months ago6
jobs won't run from R Jupyter notebooks in VS Code, for SGE
Closed 6 months ago3
recv() hangs on Mac OS
Closed 6 months ago3
`max_calls_worker` argument is not functional
Closed 6 months ago
Memory options missing from SGE template
Closed a year ago3
Running multiple jobs on SLURM scheduler through SSH
Closed 6 months ago3
Can't register backend after upgrading to 0.9.0
Closed 6 months ago3
new feature making clustermq "pipeable"
Updated 6 months ago4
clustermq was removed from CRAN?
Closed 6 months ago3
Simple receive hangs on macOS
Closed 8 months ago23
Receiving data after shutting down workers results in a segfault
Closed 8 months ago9
Q() segfaults on Windows & Linux with multiprocess scheduler with clustermq 0.9.0
Closed 8 months ago8
Error in w$poll() : Unexpected peer disconnect
Closed 8 months ago4
`v0.9.0` backwards compatibility
Closed 9 months ago14
Local processing reports errors only after all calls complete
Updated 9 months ago1
Error/warning summary does not prioritize correctly
Closed 9 months ago
(develop) torque/PBS- In worker cleanup, seems to be sending job names instead of PBS ids (Apparent regression of #186)
Closed a year ago4
`max_calls_worker` may provide insufficient slots to finish jobs
Closed a year ago
Is it confusing to call ssh a clustermq scheduler?
Closed a year ago
common data warning message
Closed a year ago
Can we improve error message for missing packages on the worker?
Closed a year ago2
Worker API does not properly document requirements for `common_data`
Closed a year ago4
Job port is set to NA after binding failure
Closed a year ago11
Expose run time as an option whilst submitting a function
Closed a year ago3
Segfault with purrr 1.0.0
Closed a year ago2
More user friendly timeouts
Closed 2 years ago1
SGE submission fails due to invalid parallel environment in default template
Closed 2 years ago7
SGE template: defaulting to user R path?
Closed 2 years ago7
Nonstandard R path via SSH
Closed 2 years ago3
some progress with future.clustermq
Closed 2 years ago2
targets stalls using the worker API with the multiprocess backend
Closed 3 years ago1
Question about the R session on the worker
Closed 3 years ago2
(develop) : submodules not pulled in configure
Closed 3 years ago
Q_rows fails with log_worker=F
Closed 3 years ago2
Warning in sprintf(log_file, i): one argument not used by format '|'
Closed 3 years ago3
Expected PROXY_READY, recieve 'PROXY_ERROR: no file found'
Closed 3 years ago2
Using a Singularity Container as Environment for Simulations
Closed 3 years ago6
SLURM starts jobs, but they don't finish
Closed 3 years ago5
Reports of large memory usage on workers
Closed 3 years ago5