Document incremental updates setup
yolile opened this issue · comments
Some things to document:
- Do a first manual crawl if the crawl takes a long time to be finished (e.g. weeks)
- How to decide which spider to use
- How to decide if the "compiled_release" option is needed