duanebester / scraper.clj

Scraping product info with Clojure

Web scraping w/ Clojure

As seen in the blog post: Web Scraping with Clojure

Docker

Stand up Redis and Mongo

docker compose up -d

Mostly everything is in core.clj. The code from the blog post is in blog_post.clj.

Uses async channels to send urls to the Scraper record.