Key error: 'listnum'
Ivan-Fan opened this issue · comments
Really thanks for your great work! However, recently I have met a strange problem like the following.
Any suggestions would help!
Keywords: 杨凡小时候
Number: 100
Face Only: False
Safe Mode: True
Query URL: https://image.baidu.com/search/index?tn=baiduimage&word=%E6%9D%A8%E5%87%A1%E5%B0%8F%E6%97%B6%E5%80%99
Traceback (most recent call last):
File "Myimage_downloader.py", line 143, in
main(sys.argv[1:])
File "Myimage_downloader.py", line 76, in main
browser=args.driver)
File "Image-Downloader-master\crawler.py", line 326, in crawl_image_urls
proxy=proxy, proxy_type=proxy_type)
File "Image-Downloader-master\crawler.py", line 207, in baidu_get_image_url_using_api
total_num = init_json['listNum']
KeyError: 'listNum'
same error...
http log:
{"antiFlag":1,"message":"Forbid spider access","bfe_log_id":"9576621861689003963"}
emmm..... , I have a tmp solution, change get url way from baidu_get_image_url_using_api to baidu_image_url_from_webpage in image_downloader.py function crawl_image_urls, it can download.