Cannot run fi_msg_bw with verbs provider

[Rohit Zambre]

Running the server with fi_msg_bw -p verbs -S 2 and the client with fi_msg_bw -p verbs -S 2 <server-hostname>

The client complained (fi_getinfo was successful on the server):

fi_getinfo(): common/shared.c:627, ret=-61 (No data available)

The error is a -1 from rdma_create_qp in fi_ibv_create_ep<-fi_ibv_handle_sock_addr<-fi_ibv_get_match_infos<-fi_ibv_getinfo<-ft_getinfo<-ft_client_connect

To work around this, I set node to null in ft_getinfo. But the client now complains:

fi_enable(): common/shared.c:965, ret=-22 (Invalid argument)

The error is an EINVAL is from rdma_create_qp.

Any work arounds to get a msg_bw test to run with the verbs provider?

[arun ilango]

Is the IPoIB interface configured with an IP address on both server and client?

[Rohit Zambre]

You are right, the IPoIB interfaces on the cluster that I am running on are not set up. Running on another cluster with the IP addresses on the ib interfaces, the fi_msg_bw test works. Thank you!