segmentation of ingestion on mirroring

Question

segmentation of ingestion on mirroring

willscott opened this issue 2 years ago · comments

Will commented 2 years ago

mirroring does not currently chunk at 5000-advertisement chunks

Will · Answer 1 · Fri Aug 19 2022 00:13:59 GMT+0800 (China Standard Time)

would be god to have a sense of the distance between latest known ad and what we've most recently processed

Masih H. Derkani · Answer 2 · Fri Aug 19 2022 00:14:57 GMT+0800 (China Standard Time)

Move issue to index-provider since mirroring implementation is in that repo?

Andrew Gillis · Answer 3 · Tue Oct 24 2023 02:55:24 GMT+0800 (China Standard Time)

would be god to have a sense of the distance between latest known ad and what we've most recently processed

This can be accomplished using the ipni-cli, using the provider command with the --distance flag. It calculates the distance from the last seen advertisement to the provider's current head advertisement

ipni provider -i https://cid.contact -pid 12D3KooWKdbrF5ynUDa19nWPtpGNSgWj33py11p1C2w4zvuFptTT --distance