hsuanchi / crawler_shopee_public

蝦皮非同步爬蟲 + 競品賣家分析

Home Page:https://www.maxlist.xyz/2020/04/14/shopee-crawler/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

API returns 403 error

ryomasuda4611 opened this issue · comments

I got an 403 status error when I started the script.

Recently, Shopee makes api v4 access more strict.. I think this error is caused by the changes..
Any ideas to solve the error?

Thank you in advance!

08/15/2023 09:23:52 AM INFO ⌲ Step 0: Test the IP you're using 5 times.
08/15/2023 09:23:53 AM INFO └── IP: 133.165.184.67
08/15/2023 09:23:53 AM INFO └── IP: 133.165.184.67
08/15/2023 09:23:53 AM INFO └── IP: 133.165.184.67
08/15/2023 09:23:53 AM INFO └── IP: 133.165.184.67
08/15/2023 09:23:53 AM INFO └── IP: 133.165.184.67
08/15/2023 09:23:53 AM INFO <function CheckIPAddress.__call__> - Time Coast: 0.98s 

08/15/2023 09:23:53 AM INFO ⌲ Step 1: Total shop detail fetchedd:
08/15/2023 09:23:53 AM WARNING Exception: rsp status 403, https://shopee.tw/api/v4/shop/get_shop_base?entry_point=ShopByPDP&need_cancel_rate=true&request_source=shop_home_page&version=1&username=fulinxuan
08/15/2023 09:23:53 AM INFO <function ShopDetailCrawler.__call__> - Time Coast: 0.15s 

08/15/2023 09:23:53 AM INFO ⌲ Step 2: Total pdp detail fetched:
08/15/2023 09:23:53 AM INFO <function ProductDetailCrawler.__call__> - Time Coast: 0.01s 

08/15/2023 09:23:53 AM INFO <function Crawler.__call__> - Time Coast: 1.14s 

Same, do you have any solution to that?