[Question] How to connect to RBD when not in the same network as the Ceph Demo containers

[francoposa-digitalocean]

Is this a bug report or feature request?

• Just a Question

We have had success with the Ceph Demo Container, and running an app connecting to RBD via go-ceph rados module. This works when the Go app runs in the docker network, or when the Ceph container runs with host networking and the Go app runs locally.

We would like to be able to hook up a locally running app to a remote containerized dev/test environment. We are using devspace with port forwarding to spin up the demo container image in a remote k8s environment, then running and debugging the app we are developing locally, as this provides the fastest iteration.

Generally in our connection configs, we only worry about specifying the Mon IP and port, and then passing those to the RBD connection params. However when we run the Go app outside the network that the demo container runs in, and only forward that one port 6789, we are unable to connect (error code -22).

I have found this, but I am not sure how to apply it: https://docs.ceph.com/en/latest/rados/configuration/network-config-ref/

Environment:

• OS: Fedora 36
• Kernel: 5.19.16-200.fc36.x86_64
• Docker version: 20.10.20
• Ceph version: 12, 14, and 16