Cloud Config: Missing `worker_pool_name` from experiment config template.

Question

Cloud Config: Missing `worker_pool_name` from experiment config template.

mvanotti opened this issue a year ago · comments

I am trying to set up a cloud project for running my own experiment, and following the steps in "Running an experiment" they provide a sample experiment-config.

However, when I try to run it with a config derived from it, I get an error:

ERROR:root:Config does not contain required parameter "worker_pool_name".

I made up a name for it, but I am not sure how to complete that.

Dongge Liu · Answer 1 · Mon Apr 03 2023 08:47:46 GMT+0800 (China Standard Time)

Ah, sorry, it seems that the documentation is a bit outdated.
Please refer to this example for the latest setting that we use to run experiments.

Marco Vanotti · Answer 2 · Mon Apr 03 2023 21:31:32 GMT+0800 (China Standard Time)

Thanks for the reply!

Are the worker pools something that needs to be configured? Do we need to do something besides enabling the worker pools api as instructed by the documentation?

Marco Vanotti · Answer 3 · Wed Apr 05 2023 05:42:50 GMT+0800 (China Standard Time)

It seems like private worker pools can be created from the gcloud console.
One of the fields they specify is the virtual network. For now I am leaving it empty.

Marco Vanotti · Answer 4 · Wed Apr 19 2023 21:59:11 GMT+0800 (China Standard Time)

I made a bit of progress with this.

I was able to create the private worker pool (leaving virtual network details empty).

The project needs a cloud bucket to be created to store the cloud artifacts, that's not documented anywhere. The service account in GCE needs access to this workerpool, as well as "Viewer" role for the whole project (?????) in order for it to stream the logs for building.

It would be really nice if these steps were documented anywhere, as otherwise it is just trial an error reverse engineering each error u_u