I'm scraping drugs details from drugs, and i want to store them in a postgresql database. My future plans, use this data base and make a full stack app.
P.S: docker is required
- clone the repo
git clone https://github.com/cs-fedy/drugs-database
- run
docker compose up -d --build
to start the db. - install virtualenv using pip:
sudo pip install virtualenv
- create a new virtualenv:
virtualenv venv
- activate the virtualenv:
source venv/bin/activate
- install requirements:
pip install requirements.txt
- run the script and enjoy:
python main.py
- selenium: Primarily it is for automating web applications for testing purposes, but is certainly not limited to just that. Boring web-based administration tasks can (and should) also be automated as well.
- BeautifulSoup: Beautiful Soup is a library that makes it easy to scrape information from web pages. It sits atop an HTML or XML parser, providing Pythonic idioms for iterating, searching, and modifying the parse tree.
- python-dotenv: Add .env support to your django/flask apps in development and deployments.
- psycopg2: psycopg2 - Python-PostgreSQL Database Adapter.
- tabulate: Pretty-print tabular data.
- requests: Python HTTP for Humans.
- markdownify: Convert HTML to markdown.
created at 🌙 with 💻 and ❤ by f0ody
- Fedi abdouli - drugs database - fedi abdouli
- my twitter account FediAbdouli
- my instagram account f0odyy