Scrape error

Question

Scrape error

yringler opened this issue 5 years ago · comments

Section: https://insidechassidus.org/jewish-and-chassidic-calendar/shvat/215-10-shvat/1070-the-frierdike-rebbe-rayatz

Missing: https://insidechassidus.org/winter/215-10-shvat/1070-the-frierdike-rebbe-rayatz

Yehuda Ringler · Answer 1 · Mon Jul 29 2019 22:50:32 GMT+0800 (China Standard Time)

The problem was that there was some classes different in the header, regarding current place in navigation. Solution: when comparing body, parse with goquery and compare main_container

Yehuda Ringler · Answer 2 · Mon Jul 29 2019 23:03:06 GMT+0800 (China Standard Time)

https://insidechassidus.org/sichos/288-toras-menachem/12-tamuz-5719:
Scraped, removed by fix

Yehuda Ringler · Answer 3 · Mon Jul 29 2019 23:54:35 GMT+0800 (China Standard Time)

Weird. Seems I was fixing the old JSON...