This web crawler targets korean online shopping mall comments.
python src/main.py -url "http://item.gmarket.co.kr/Item?goodscode=2405613985&ver=638083484789237196"- G마켓
- 11번가 (wip)
- Naver shopping
- coupang (wip)
Comment crawler uses flags to specify
| Flags | type | description | default |
|---|---|---|---|
| url | string | URL link of the online shopping website. | None |
| max_collect | int | Maximum number of comments to collect. -1 if no limit. | -1 |
| collect_empty | boolean | Collects empty comments if set to True | True |
| browser | enum | Browser used for selenium. Can choose between Safari and Firefox | 'Safari' |