ruby-journal / cricos_scrape.rb

An data scraper for CRICOS site in Ruby

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Build Status Code Climate From Vietnam with <3 Made in Vietnam Built with WeBuild

CRICOS Scraper

CRICOS Logo

CRICOS lacks API for data retrieval (so do many government-based services). This gem helps scrape data from http://cricos.education.gov.au.

NOTE: The data.gov.au has provided basic information about CRICOS institutions and courses via static Excel file and DataAPI. As of 2021, the data from this source is still lacking information (for example contact details). But I do believe DataAPI will eventually replace this scraper in the near future. For the time-being, please use both sources.

Features

Support scrapping following entities:

  • Institution
  • Course
  • Contact

Installation

gem install cricos_scrape

Usage

Please consult cricos_scrape -h command line.

Testing

The tests are in the spec directory. Here syntax to test this gem.

rspec

License

MIT

About

An data scraper for CRICOS site in Ruby

License:MIT License


Languages

Language:Ruby 100.0%