konyan / ruby-job-scrapper

Web Crawler Project that was a capstone project for ruby.The project that quite literally scrapes or gathers data off of job's website.

Console Jobs

A Web Scraper is a program that quite literally scrapes or gathers data off of job's website.

Table of Contents

• About the Project
  • Built With
• Getting Started
  • Prerequisites
  • Installation
• Unit Testing
  • Prerequisites
  • Installation
• Contributing
• License
• Contact
• Acknowledgements

About The Project

This is capstone project of Microverse Ruby Curriculum.Project Name is Console Jobs. Web scraping is the process of gathering information from the Internet. Even copy-pasting the lyrics of your favorite song is a form of web scraping! However, the words “web scraping” usually refer to a process that involves automation. In my case, I gather data from one of the most popular job site from myanmar that name is jobnet. In my project, ther is three part.

• Job Function
• Each Position Job Listing
• Job Detail

Built With

For the whole project, I used following tools and language.

• Ruby
• Nokogiri
• Colorize
• Open Uri

Getting Started

This is an example of how you may give instructions on setting up your project locally. To get a local copy up and running follow these simple example steps.

Prerequisites

This is an example of how to list things you need to use the software and how to install them.

• ruby

https://www.ruby-lang.org/en/downloads/

• gem

gem install nokogiri
gem install colorize

Installation

1. Clone the repo

git clone https://github.com/konyan/ruby-job-scrapper.git

2. Install gem packages

gem install

3. Run main.rb file

ruby bin/main.rb

Unit Testing

Prerequisites

This is an example of how to list things you need to use the software and how to install them.

• ruby

gem install rspec

Installation

1. Run spec files at Spec Folder

rspec spec/job_spec.rb
rspec spec/joburl_spec.rb
rspec spec/position_spec.rb

Contributing

Contributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are greatly appreciated.

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
3. Commit your Changes (git commit -m 'Add some AmazingFeature')
4. Push to the Branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

License

Distributed under the MIT License. See LICENSE for more information.

Contact

@devkonyan - [e-mail]

Project Link: https://github.com/your_username/repo_name

Acknowledgements

• Job Site