[question] why was the event scraper pulled?
patcon opened this issue · comments
I'm just about to jump into this, as it's the main thing I need for the project I'm working on. To be efficient with my time, can I ask for the context on disabling the event scraper?
The event scraper was very slow - and although at the time I had identified some basic things to change to make it faster, I didn't have the time to refactor. You can enable/rework it.
Thanks for the info!
Think it'd be alright to just scrape X days into the future and the past, and then following trails accordingly, using this view:
So it would assume that a big scrape had been imported manually, and then it would scan around the current day, looking for cancellations or updated agendas or vote results. Once I get your previous scraper working (it's progressing great btw), I'm planning to deal with updates that way.