postmodern/spidr Issues
Thank you
Closed 1Add Logging
UpdatedWrite specs for Agent.domain
Closed 1Switch to using async-http
Updated 1Infinite path loop
Updated 2Use webmock and to_rack in specs
Closed 1fetch_titles not following 301
Closed 2Following redirects
Updated 4`ignore_links` not working.
Closed 4Multithreading
Updated 13unable to ignore links
Closed 4Skip processing of pages
Closed 1Session handling
Closed 1Crawling a specific page
Closed 2how to login via submit a form
Closed 1SSL session reuse may fail
Updated 1HTTP Basic auth problem
Closed 4catching SSLErrors
Closed 2Link depth?
Closed 6trailing slashes
Closed 1