DenisLebedinsky / crawler-server

crawler-server

Youtube crawler server

Backend side app: https://github.com/DenisLebedinsky/crawler-client

Table of Contents

• About the Project
  • Built With
• Getting Started
  • Prerequisites
  • Installation
• Usage
• Contributing
• License
• Contact

About The Project

Youtube crawler is an app for CRUD data from Youtube.com to database

Deployed on Heroku: https://scrapy-youtube.herokuapp.com/
Client: https://crawler-client.herokuapp.com/

Built With

• Flask
• Pymongo
• MongoDB

Getting Started

To get a local copy up and running follow steps below.

Prerequisites

You need to install the following:

pip 19.0.2
Python 3.7.3
MongoDB 

Installation

1. Clone the repo

git clone https://github.com/DenisLebedinsky/crawler-server.git

2. Install pip packages

pip3 install -r requirements.txt

3. Set env

VIRTUAL_ENV = <production>|<development>|<test> 
HOST = <your host>
PORT = <your port>
MONGODB_URI = <URI MongoDB>

Usage

Run client ([https://github.com/DenisLebedinsky/Astroscreen]) and it will communicate with this app

Contact

Denis Lebedinsky - [e-mail]