aliir74 / IranAdPlatformCrawler

Iranian Ad Sites Crawler (Divar, ...)

Ad Sites Crawler

This is a site crawler written based on crawling the iranian ad sites. For now, it only supports Divar.

Run

• Install docker and docker-compose.
• Run sysctl vm.overcommit_memory=1 or set vm.overcommit_memory=1 in /etc/sysctl.conf on your host and reboot your system.
• Copy .env.sample file to .env and change the values as you want.
• Run docker-compose up --build.

Note

• You should create a IFTTT webhook (3 value option) and set your account information on .env to get a notification when the crawler finds a new/changed ad.