ipni / storetheindex

A directory of CIDs

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Long ad chains cause OOM restart

gammazero opened this issue · comments

Long advertisement chains are iterated and every advertisement is stored in memory until after the chain is processed. This is causing an out-of-memory condition and leading to crash/restart of indexers.

Fix this by not keeping all advertisements in memory at the same time and instead loading each advertisement at the time it is processed.