Salt Crawler is a distributed web crawler based on the Salt remote execution framework. It is currently only for demonstration purposes, but it is likely to expand to a more powerful web crawling engine.
A Salt-based web spidering engine
Salt Crawler is a distributed web crawler based on the Salt remote execution framework. It is currently only for demonstration purposes, but it is likely to expand to a more powerful web crawling engine.
A Salt-based web spidering engine
Other