Does local completion of fi_write imply remote completion?

[Jiakun Yan]

Just want a clarification: If a fi_write operation has been reported as completed locally through a completion queue, can we safely assume the data has been written to the remote memory?

[Chien Tin Tung]

If you are using verbs provider and device with proper support for RDMA write then yes, otherwise, you want to read up on fi_cq specifically FI_DELIVERY_COMPLETE

[Shi Jin]

we safely assume the data has been written to the remote memory?

if you have FI_DELIVERY_COMPLETE in flags, in Libfabric's point of view, the data should be written to the remote memory when Libfabric is writing the completion.

[Jiakun Yan]

Thanks! FI_DELIVERY_COMPLETE is exactly what I want!