Time restrictions
Scrapnon opened this issue · comments
Hello,
Are there any available details regarding time restrictions, such as requests per hour or per day, and on which sites, in order to adjust sleep timers accordingly to those limitations?
Edit: Talking of the bot detection by ImmoScout24.
Best
Hi @Scrapnon,
We don't have explicit support for that in Flathunter, but if you're
running the crawler out of cron or systemd, you can obviously configure the
frequency of the runs there. Doing that on a per-site basis would be more
complicated.
We have had other requests to limit the rate of crawling. It would
certainly be an interesting feature to have.
Scrapnon ***@***.***> schrieb am Do., 25. Jan. 2024, 15:50:
… Hello,
Are there any available details regarding time restrictions, such as
requests per hour or per day, and on which sites, in order to adjust sleep
timers accordingly to those limitations?
Best
—
Reply to this email directly, view it on GitHub
<#522>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AAAEK5VLOIBWTX6IEMAH3NDYQJWK7AVCNFSM6AAAAABCKU4V6OVHI2DSMVQWIX3LMV43ASLTON2WKOZSGEYDANJVHA4DGNY>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>