furquan-lp / indeed-scraper

Web Scraper for Indeed.com (70k+ jobs scraped so far and stored on MongoDB)

Home Page:https://indeed-scraper-one.vercel.app

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[scraper] Scraper sends status code 500 when the search results in no results

furquan-lp opened this issue · comments

On the except clause on line 96:

except Exception as e:
    global_logger.error(f'An error occurred while fetching job IDs: {e}')
    return 500

This sends the 500 code because an IndexError is thrown in the the try block.