toannguyen3105 / pdt-crawler-dmarket-items

pdt-crawler-dmarket-items

Crawl all items from D-Market

• This is public project to crawl all items from D-Market

Features

• Crawl all items from MIN_PRICE to MAX_PRICE with price desc.

Prerequisites

Before you continue, ensure you meet the following requirements:

• You have installed the latest version of Browser (Chrome, Firefox, Edge).
• You are using a Windows, Linux or MacOS machine.

Installation

pip3 install -r requirements.txt

Usage

scrapy crawl items -O items.csv

• If you want to update price filter, let open items.py file and update MIN_PRICE, MAX_PRICE variables.

Donate

Liked some of my work? Buy me a coffee (or more likely a beer)