ipni / storetheindex

A directory of CIDs

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Do not fetch ad chain until done processing previous chain

gammazero opened this issue · comments

Need to make fetching ad chains wait until any previous chain from the same publisher has been completely processed. This means that the indexer code will need a way to tell dagsync when to handle new announces from a publisher and when to queue them for later processing.

This is fixed. Testing indicates there is an advantage to syncing the next portion of the ad chain while the previous one is being processed. The problem that inspired this issue was fixed here: ipni/go-libipni#62

There is a much more detailed discussion of the issue in that link. In summary, the fix allowed the next ad chain sync to only sync the unsynced portion of the ad chain, and prevent re-syncing anything that was already synced.