khaledbnmohamed / scraper-ruby

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Getting Started

Prerequisites

  • Ruby (2.7 or later)
  • Docker

Usage

Running the Script in Docker

  1. Build the project:
docker-compose up fetcher --build
  1. Running examples:
docker-compose run fetcher https://www.google.com https://autify.com
docker-compose run fetcher --metadata https://www.fast.com

Additional Enhancements

  1. Add more specific error handling
  2. Add tests
  3. Provide more options for the user to specify the output format
  4. Apply the await function properly in case of batch requests

About


Languages

Language:HTML 98.1%Language:Ruby 1.8%Language:Dockerfile 0.1%