codeberrypro / my_parsers

This is a small scripts for parsing data from the site. Where I bypassed the captcha, used cookies and bypassed the site's security. I hope the code will be useful for beginners and not only

Some of my freelance projects

Note. The repository was tested at the time of 05/12/2023, so some functions may not work.

Installation

Clone the Repository:

https://github.com/codeberrypro/my_parsers

Activate :

python -m venv venv
source venv/bin/activate (Linux/Mac)
venv\Scripts\activate (Windows)

Install poetry:

curl -sSL https://install.python-poetry.org | python3 -

Libraries Used:

• requests
• BeautifulSoup
• selenium
• UserAgent
• selenium-wire

Sites

name	url
wayfair	https://www.wayfair.com
target	https://www.target.com
samsclub	https://www.samsclub.com
dou.ua	https://dou.ua
olx	https://www.olx.ua