trinh-hoang-hiep / movies-musics-database

I'm scraping movies metadata from imdb website, and each movies songs from tunefind website. I'm planning to store the scraped in a postgresql database and use it in a web app.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

movies - musics database:

I'm scraping movies metadata from imdb website, and each movies songs from tunefind website. I'm planning to store the scraped in a postgresql database and use it in a web app.

installation:

  1. clone the repo git clone https://github.com/cs-fedy/movies-musics-database
  2. change your current directory to scraper dir: cd movies-musics-database
  3. install virtualenv using pip: sudo pip install virtualenv
  4. create a new virtualenv: virtualenv venv
  5. activate the virtualenv: source venv/bin/activate
  6. install requirements: pip install requirements.txt
  7. run the script and enjoy: python main.py

used tools:

  1. requests: Requests is a simple, yet elegant, HTTP library.
  2. BeautifulSoup: Beautiful Soup is a library that makes it easy to scrape information from web pages. It sits atop an HTML or XML parser, providing Pythonic idioms for iterating, searching, and modifying the parse tree.

Author:

created at 🌙 with 💻 and ❤ by f0ody

About

I'm scraping movies metadata from imdb website, and each movies songs from tunefind website. I'm planning to store the scraped in a postgresql database and use it in a web app.


Languages

Language:Python 100.0%