dinocajic / bash-crawler

Created a website-crawler in bash. Note, it's for a specific website and will not work unless you know the site.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

bash-crawler

Created a website-crawler in bash. Note, it's for a specific website and will not work unless you know the site.

You can see the code and follow it by starting with run.sh

run.sh

  • get_item_links.sh
    • get_skus.sh
  • split_skus.sh
  • loop_through_sku_files.sh
    • create_query.sh
      • get_pricing.sh
  • check_if_lowest_price.sh

About

Created a website-crawler in bash. Note, it's for a specific website and will not work unless you know the site.

License:MIT License


Languages

Language:Shell 100.0%