iphyman / website-scraper

A simple NodeJS template app to scrape data from any website.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Nest Logo

A simple web scraper to extract data from your favourite websites

Description

This simple nestJS app allows you to extract data from any website, for the sample provided in the app service, we defined a getCoingecko method to extract cryptocurrency name, logo and symbol. The extracted data is then either written to a file or outputed to the route specified in the app controller.

Installation

$ yarn

Running the app

# development
$ yarn start

# watch mode
$ yarn start:dev

# production mode
$ yarn start:prod

Test

# unit tests
$ npm run test

# e2e tests
$ npm run test:e2e

# test coverage
$ npm run test:cov

License

Nest is MIT licensed.

About

A simple NodeJS template app to scrape data from any website.


Languages

Language:TypeScript 84.6%Language:JavaScript 15.4%